Presentation given to CRCMining Automation Technical Committee

1. www.csiro.au
Autonomous
Systems Lab
CRC Meeting Meeting June 2016

2. ASL History (1995-2010)
Dragline Swing Automation Shovel/Excavator Automation Rockbreaker/Shiploader
LHD Automation (Caterpillar) Longwall Automation (CESRE)Explosive Loading (ORICA)

3. A world in which humans and autonomous systems
are able to seamlessly, reliably and safely collaborate.
ASL Vision 2005
45
40
15

4. ASL Research Today
Robotics
Persistent
Bespoke
Awareness
Reality
Capture
Reality
Display
Sensing
Pervasive
Connected
High
Performance
Workplace
Autonomous
Exploration
& Science

5. Persistent Robotics
• Autonomous Unmanned Helicopters
• Smart Skies (with Boeing)
• ResQu
• Ground Vehicles
• Hot Metal Carrier (with RioTinto)
• Autonomous Science Rover
Information Driven Manufacturing
• Dependable hardware and software,
• Precise control, robust state estimation
• Obstacle avoidance, autonomous planning,
• Health monitoring, reasoning and decision making
• Power and energy management
• Advanced Engineering

6. Bespoke Robotics
1. Task Based Design
• Confined space inspection
2. Reconfigurable
• Anyleg / Anywheel
3. Extreme Locomotion
• Hexapod platform
Information Driven Manufacturing
• Real-time proprioceptive
• Machine learning
• Energetics based gait switching
• Stabilisation in unstructured terrain
• Ground cover classification
• Rapid Prototyping to high TRL

7. Reality Capture (Situational Awareness)
1. Lidar, Vision, Thermal
• Zebedee
• Heatwave
• Hovermap
2. Hyper spectral
3. Gas and RF
• Plant Mapping
Information Driven Manufacturing
• Simultaneous Localisation and Mapping (SLAM)
• Data Fusion and Registration
• Compressive Sensing
• Design lead engineering (Product development)

8. Reality Display (Human Machine Interface)
1. Augmented Reality
• ReMote Tele-Maintanence
2. Augmented Virtuality
• 3P Learning - Endeavour tour
3. Panomersive Video streaming
• National Museum Tele-presense
Information Driven Manufacturing
• Wearable technology
• Immersive technology
• Human Factors / Ethics

9. Pervasive Sensing (Monitoring and Tracking)
• Longevity
• Springbrook with Fleck
• Scale
• Digital Homestead
• Sense-T with PACP
• Mobility
• Batmon with Camazotz
• Passive
• People Tracking
• Smart Homes
Information Driven Manufacturing
• Delay tolerant networking
• Energy Management, Radio Diversity
• Mobile Analytics, distributed processing
• Spatiotemporal Modelling

10. Connected Sensing (Internet of Things)
1. Sensor Data Models and Management
• SenseT / SenseDB
2. Interoperability
• OpenIoT / BIoTope
3. Security and Trust
• AU2EU
4. Collaboration
• Industrial Internet Consortium
Information Driven Manufacturing

11. Problem 1: The Mixed Traffic Problem
• 20 years ago automation
was driven by safety
• Lead to the automation of
specialized vehicles
• Equal performance of a human driver
• Forced to isolate the machines
• This impacted the existing workflow
(Maintenance, exploration)
Increase Safety Change in Workflow Loss in Productivity

12. Solution 1: Global Situational Awareness
1. Technology that allows humans and robots
to interact safety and productively
2. To do this we need to provide fail-safe
people detection
3. No such technology exists
4. Put intelligence into the environment
rather than the machine
5. Detect absence rather than presence
6. Autonomous safety.

13. Robotics in the IoT Landscape

14. Potential Solutions

15. Problem 2: Interoperability
• 10 years ago, investment was driven by
labor force availability and productivity
• We were able to automate a rock-breaker,
but it does not exceed the performance of
the human operator
• Productivity gains can only be realized if
we integrate the upstream and
downstream processes
Fleet Management Rock Breaker Processing

16. Unified User Interface
3DCMM
Communications Infrastructure
Digital Model
Exploration
MinePlanning
Drilling
Excavation
Blasting
Haulage
RockBreaking
Processing
Train
ShipLoading
Process
Surveying Analysis Infrastructure Maintenance LogisticsSupport
Framework of Standards
Remote
Operations
Solution 2: Common Mine Model
Vendors

17. Industry Engagement

18. Software systems in Manufacturing
I Manufacturing – “A Glass Half Full”
ISA-95

19. Trends in Future Manufacturing
•New Workflows
•New Business
Models
•New Enterprises
•New Processes
•New Materials
•New Production
•Mass
Customization
•Maximize
Flexibility
•Mass
Production
•Minimize Waste
Lean Agile
SmartAdvanced
Great
Expectations
Digital
Immersion
MoreFrom
Less

20. Manufacturing Terminology
Industrial
Internet (GE)
Industry 4.0
(Germany)
Network
Enabled
Manufacturing
(Boeing)
Smart
Manufacturing
(Rockwell)

21. Trends in Manufacturing
Traditional
Automation
Rigid
Bulky
Expensive
Unsafe
Lightweight
Technology
Flexible
Lightweight
Affordable
Human-centered
Easy-to-use

22. Lightweight
Technologies
HMI
ICT
Perception
Robotics
Mobile
Tele-presence
Lightweight
Robotics
Mirror
Worlding
Social
Networking
Sensing in
Unstructured
Dynamic
Environments
Field
Robotics
Dependability
Robustness
Military/Mining
Collective
Intelligence
Cloud
ServicesBig Data
Internetofthings
Cheap sensor,
processors
and actuation
Consumer
Devices
Immersive
Interfaces
Gaming
AdditiveManufacturing
Intuitive
interfaces
Mobile
Devices
Ubiquitous
Connectivity
Locationbasedservice
Technology/Trendsto
DevelopAssistiveRobotics

23. Virtual Factory – Executive Layer
• Simulation of factory and the world around it.
• Interactive and collaborative user interface
• Decision support (simulated scenarios)
Digital Factory – Strategic Layer
• Live (Real-time) digital model of factory
• Fully Integrated across the production cycle - Data Fusion
• Optimization of production based upon demands
Smart Factory – Tactical Layer
• Smarter sensing and actuation around each process
• Reconfigurable / Adaptive / Responsive processes
• Improved situational awareness - QA/QC
External Forces
Demands
Demands
Demands
Data
Intelligence
Layered Architecture
CRM
Customer
Relationship
Management
PLM
Product
LifeCycle
Management
SCM
Supply Chain
Management
ERP
Enterprise
Resource
Planning
MES
Manufacturing
Execution System
SCADA

24. Connected Architecture
CRM
PLM
SCM
ERP
MES
SCADA
CRM
PLM
SCM
ERP
MES
SCADA
CRM
PLM
SCM
ERP
MES
SCADA

25. subcontracting process
Engineer at company A defines
product specification in in-
house ERP A
raises purchase order and
generates further
specifications in ERP A
Engineer at company
B retypes
specification in in-
house ERP B
ERP A ERP B
Engineer at company
B retypes
specification in in-
house ERP C
ERP C
Status Quo

26. iManufacturing Initiative
26 |

27. Presentation title | Presenter name27 |

28. Pegasus
• Bespoke solution are not scalable.
• Previously required installation of software on-site.
• Too expensive for SME.
• The cloud can provide off-load the software
• But still have a problem with inter-connections.
Solution
• Objects with relationships to other objects across strata exist.
• Management by Semantic Web
• Deliver information flows to the supply chain to allow secure, fit for purpose,
interoperability across various platforms and processes

29. Human
Services
Client
data
Supply chain
events
Supplier
data
ICT Automation,
IoT, Robotics
Factory
events
Factory
data
End to end
data
Material, Products
and Processes
Product
data
Process
data
Supply chain
management
Assistive
technologies
Design,
customisation
Direction of
data flow
Nodes
Sustainable
manufacturingRelationship
Management
Informatics
Workforce skills
What are the information flows
At the nodes, we need Informatics

30. Guardian Angel
• Monitors environment
• Tracks people and assets
• Make work safer for humans
Guardian Mentor
• Worker augmentation
• Provides skills and training
• Make work easier for human
Guardian Helper
• Provides physical assistance
• Robotic co-workers
• Works with humans
Guardian Worker
• Provides remote assistance
• Tele-operated robotics
• Work for humans
High Performance Workplace
Augmentation
• Collaboration
• Interface
• Observatory
Assistive
• Navigation
• Manipulation
• Cooperation
Awareness
• Monitoring
• Modeling
• Management
Social Science
Human Factors
Informatics
Communications
Sensors
Robotics
Engineering
Investment Innovation Impact
Worker Centric:
Increase productivity, safety and
adaptability of future workforce through
virtual and assistive automation
technologies
• Low-cost, from purchasing price and installation costs, to
reprogramming and maintenance costs
• Easy to use, without the need of technical expertise to deploy, operate
and reconfigure the systems
• Support mass customisation, ideal for small runs of multiple types of
products

31. Guardian – Mobile Industrial Internet
CSIRO – Digital Productivity Flagship

32. Objectives.
• Enhances the productivity and safety of the
industrial workplace. This is achieved with the
development and integration of a number of
situational awareness, decision support and
assistive technologies.
Key Research Challenges
• Large scale Integration
across heterogeneous systems
• Managing and predicting risk
Partners
• Boeing, GE
• Woodside, Chevron
• IIC, ROS Industrial
• IMCRC, ASC
Guardian Facility:
High Performance Workplace

33. Guardian Facilities at QCAT
Guardian
Managed
Work Zone
Manufacturing
Work Zone
Situational
Wall
Remote
Management

34. Operations in a dynamic industrial environment
• Seamless Connections / Exchange between
• Workshop (Tactical) & The Control Room (Executive)

35. Thankyou
35 |

36. iManufacturing

37. History
Presentation title | Presenter name37 |