SlideShare a Scribd company logo
1 of 24
Download to read offline
Towards the Targeted Environment-
Specific Evolution of Robot Components
DATA61
Jack Collins1,2
PhD Student
Dr. David Howard1
Research Scientist
Frederic Maire2
Senior Lecturer
Wade Geles1
Industrial Trainee
1 with Data61, Commonwealth Scientific and Industrial Research Organisation (CSIRO), Brisbane, Australia
2 with the Science and Engineering Faculty, Queensland University of Technology (QUT), Brisbane, Australia
• Design of robots typically involves:
• Expert knowledge
• Many man-hours
• Product iterations
• Influenced by human preconceptions
• i.e. This shape performs well in this environment because …
Motivation
2 |
• Ubiquity of Additive Manufacturing
• Stereolithography (SLA)
• Selective Laser Sintering (SLS)
• Fused Deposition Modeling (3D Printing)
• ect.
• Growing assortment of construction materials
• Thermoplastics (ABS, PLA, Nylon, ect.)
• Metals (Steel, Stainless Steel, Titanium, Gold, Silver)
• Glass
• Ceramic
Motivation
3 |
• Evolutionary Robotics – “Automated creation of autonomous
robots inspired by Darwinian Evolution”
• Brain and Body Co-evolved
• Evolutionary Art
• Our Approach
– Mature Control Stack
– Targeted Evolution
– No Controller Evolution
4 |
Karl Sims, 1994
Jeff Clune, 2013
1: High
Outline
Design Space: 16x16X32 (8192) Voxels
5 |
0 = Empty
1 = Full
A voxel
Project Chrono
• Project Chrono: A high-fidelity physics simulator
– Rigid Body
– Flexible Body
– Fluid Dynamics
– Granular Terrain
Modules for:
• FEA
• Parallel
• Fluid-Solid Interaction
• Irrlicht
• OpenGL
• Rendering
• Python interface
• Matlab Interface
• Solidworks Plug-in
http://projectchrono.org/ & http://sbel.wisc.edu/Animations/
6 |
Evaluation~
Soil Gravel
~
Fluid
7 |
1: High
• Multiple Beziers with varying control points and thicknesses.
Encoding (Representation)
Bezier graphic from http://graphics.cs.ucdavis.edu/~joy/GeometricModelingLectures/Unit-4/Unit4.html
8 |
1: High
• Multiple Beziers with varying control points and thicknesses.
Encoding (Representation)
Bezier graphic from http://graphics.cs.ucdavis.edu/~joy/GeometricModelingLectures/Unit-4/Unit4.html
9 |
1: High
• Multiple Beziers with varying control points and thicknesses.
Encoding (Representation)
Bezier graphic from http://graphics.cs.ucdavis.edu/~joy/GeometricModelingLectures/Unit-4/Unit4.html
10 |
1: High
• Multiple Beziers with varying control points and thicknesses.
Encoding (Representation)
Bezier graphic from http://graphics.cs.ucdavis.edu/~joy/GeometricModelingLectures/Unit-4/Unit4.html
11 |
Fitness Function
• Fitness of an individual is calculated using:
– 𝜏: Accumulated Torque
– 𝛿: Percentage of occupied voxels
• A lower fitness is the objective
𝑓 =
𝜏
𝑛 𝑠𝑡𝑒𝑝𝑠
+
𝜏
𝑛 𝑠𝑡𝑒𝑝𝑠
×
𝛿
5
12 |
Genetic Algorithm
• Combination of the parents and children.
• Deletion of the worst performing half.
• Elitism retains fittest parent.
• Selection through tournament selection.
• Crossover using a two-point crossover method, with the two crossover
points randomly chosen values within the range of the shortest parents
genotype.
• Mutation
– Gaussian distribution of each Bezier control point
– Change Bezier thickness (20%)
– Add/remove control point (20%)
– Add/remove Bezier (10%)
13 |
Simulations
14 |
Experimental Setup
• Population of 20 legs
• Optimised for 100 generations
• 30 experiments in total
• 10 Experiments per environment
– Soil - 7 Hours
– Gravel – 2.7 Days
– Fluid – 9.4 Days
• Parallelised using OpenMP
• Run on HPC
• Across 600 cores
• Not GPU enabled
15 |
Results
16 |
Results
17 |
Shared Voxels
18 |
Correlation between: Avg.
Percentage:
Soil Soil 91.8%
Soil Granite 74.1%
Soil Fluid 54.4%
Granite Granite 72.0%
Granite Fluid 59.6%
Fluid Fluid 67.5%
Environmental Comparison
Legs
Environ.
Fluid Granite Soil
Fluid 13.3767 8.6355 0.1537
Granite 58.5300 8.0856 0.1404
Soil 86.9735 117.0014 0.0904
19 |
Results
Soil Leg Gravel Leg
20 |
Instantiated Legs
21 |
Contributions & Future Work
• High Fidelity Simulation
• Representation
• Easily Instantiable
• Fully functioning & applicable
• FEA (Finite Element Analysis)
• Real-world Validation
• Further representations
• Evolving mind and body
22 |
Data61
Jack Collins
e jack.collins@data61.com.au
DATA61
Thank you
CPPNs
24 |

More Related Content

Similar to Towards the targeted environment-specific evolution of robot components

Jillian ms defense-4-14-14-ja
Jillian ms defense-4-14-14-jaJillian ms defense-4-14-14-ja
Jillian ms defense-4-14-14-ja
Jillian Aurisano
 
Using Feature Grouping as a Stochastic Regularizer for High Dimensional Noisy...
Using Feature Grouping as a Stochastic Regularizer for High Dimensional Noisy...Using Feature Grouping as a Stochastic Regularizer for High Dimensional Noisy...
Using Feature Grouping as a Stochastic Regularizer for High Dimensional Noisy...
WiMLDSMontreal
 
Discovering Common Motifs in Cursor Movement Data
Discovering Common Motifs in Cursor Movement DataDiscovering Common Motifs in Cursor Movement Data
Discovering Common Motifs in Cursor Movement Data
Yandex
 
대용량 데이터 분석을 위한 병렬 Clustering 알고리즘 최적화
대용량 데이터 분석을 위한 병렬 Clustering 알고리즘 최적화대용량 데이터 분석을 위한 병렬 Clustering 알고리즘 최적화
대용량 데이터 분석을 위한 병렬 Clustering 알고리즘 최적화
NAVER Engineering
 
A Multi-Objective Refactoring Approach to Introduce Design Patterns and Fix A...
A Multi-Objective Refactoring Approach to Introduce Design Patterns and Fix A...A Multi-Objective Refactoring Approach to Introduce Design Patterns and Fix A...
A Multi-Objective Refactoring Approach to Introduce Design Patterns and Fix A...
Ali Ouni
 

Similar to Towards the targeted environment-specific evolution of robot components (20)

Pixelor presentation slides for SIGGRAPH Asia 2020
Pixelor presentation slides for SIGGRAPH Asia 2020Pixelor presentation slides for SIGGRAPH Asia 2020
Pixelor presentation slides for SIGGRAPH Asia 2020
 
ObjRecog2-17 (1).pptx
ObjRecog2-17 (1).pptxObjRecog2-17 (1).pptx
ObjRecog2-17 (1).pptx
 
DutchMLSchool 2022 - History and Developments in ML
DutchMLSchool 2022 - History and Developments in MLDutchMLSchool 2022 - History and Developments in ML
DutchMLSchool 2022 - History and Developments in ML
 
Artificial Neural Networks_Bioinsspired_Algorithms_Nov 20.ppt
Artificial Neural Networks_Bioinsspired_Algorithms_Nov 20.pptArtificial Neural Networks_Bioinsspired_Algorithms_Nov 20.ppt
Artificial Neural Networks_Bioinsspired_Algorithms_Nov 20.ppt
 
To bag, or to boost? A question of balance
To bag, or to boost? A question of balanceTo bag, or to boost? A question of balance
To bag, or to boost? A question of balance
 
3D Scan to Product Design: Methods, Techniques, and Cases
3D Scan to Product Design: Methods, Techniques, and Cases3D Scan to Product Design: Methods, Techniques, and Cases
3D Scan to Product Design: Methods, Techniques, and Cases
 
Genetic Algorithm
Genetic Algorithm Genetic Algorithm
Genetic Algorithm
 
Presentation Selan dos Santos 4Eyes Lab
Presentation Selan dos Santos 4Eyes LabPresentation Selan dos Santos 4Eyes Lab
Presentation Selan dos Santos 4Eyes Lab
 
Jillian ms defense-4-14-14-ja
Jillian ms defense-4-14-14-jaJillian ms defense-4-14-14-ja
Jillian ms defense-4-14-14-ja
 
Lecture 2.B: Computer Vision Applications - Full Stack Deep Learning - Spring...
Lecture 2.B: Computer Vision Applications - Full Stack Deep Learning - Spring...Lecture 2.B: Computer Vision Applications - Full Stack Deep Learning - Spring...
Lecture 2.B: Computer Vision Applications - Full Stack Deep Learning - Spring...
 
Genetic algorithm
Genetic algorithmGenetic algorithm
Genetic algorithm
 
LT1.ppt
LT1.pptLT1.ppt
LT1.ppt
 
Using Feature Grouping as a Stochastic Regularizer for High Dimensional Noisy...
Using Feature Grouping as a Stochastic Regularizer for High Dimensional Noisy...Using Feature Grouping as a Stochastic Regularizer for High Dimensional Noisy...
Using Feature Grouping as a Stochastic Regularizer for High Dimensional Noisy...
 
Large Scale Data Clustering: an overview
Large Scale Data Clustering: an overviewLarge Scale Data Clustering: an overview
Large Scale Data Clustering: an overview
 
[SEKE 2014] Practical Human Resource Allocation in Software Projects Using Ge...
[SEKE 2014] Practical Human Resource Allocation in Software Projects Using Ge...[SEKE 2014] Practical Human Resource Allocation in Software Projects Using Ge...
[SEKE 2014] Practical Human Resource Allocation in Software Projects Using Ge...
 
4 visualization inter
4 visualization inter4 visualization inter
4 visualization inter
 
Discovering Common Motifs in Cursor Movement Data
Discovering Common Motifs in Cursor Movement DataDiscovering Common Motifs in Cursor Movement Data
Discovering Common Motifs in Cursor Movement Data
 
대용량 데이터 분석을 위한 병렬 Clustering 알고리즘 최적화
대용량 데이터 분석을 위한 병렬 Clustering 알고리즘 최적화대용량 데이터 분석을 위한 병렬 Clustering 알고리즘 최적화
대용량 데이터 분석을 위한 병렬 Clustering 알고리즘 최적화
 
A Multi-Objective Refactoring Approach to Introduce Design Patterns and Fix A...
A Multi-Objective Refactoring Approach to Introduce Design Patterns and Fix A...A Multi-Objective Refactoring Approach to Introduce Design Patterns and Fix A...
A Multi-Objective Refactoring Approach to Introduce Design Patterns and Fix A...
 
3D Shape Analysis .ppt
3D Shape Analysis .ppt3D Shape Analysis .ppt
3D Shape Analysis .ppt
 

Recently uploaded

TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc
 
Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...
FIDO Alliance
 
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptxHarnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
FIDO Alliance
 
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
Muhammad Subhan
 
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
panagenda
 

Recently uploaded (20)

Vector Search @ sw2con for slideshare.pptx
Vector Search @ sw2con for slideshare.pptxVector Search @ sw2con for slideshare.pptx
Vector Search @ sw2con for slideshare.pptx
 
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
 
Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...
 
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptxHarnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
 
Introduction to FIDO Authentication and Passkeys.pptx
Introduction to FIDO Authentication and Passkeys.pptxIntroduction to FIDO Authentication and Passkeys.pptx
Introduction to FIDO Authentication and Passkeys.pptx
 
AI in Action: Real World Use Cases by Anitaraj
AI in Action: Real World Use Cases by AnitarajAI in Action: Real World Use Cases by Anitaraj
AI in Action: Real World Use Cases by Anitaraj
 
Frisco Automating Purchase Orders with MuleSoft IDP- May 10th, 2024.pptx.pdf
Frisco Automating Purchase Orders with MuleSoft IDP- May 10th, 2024.pptx.pdfFrisco Automating Purchase Orders with MuleSoft IDP- May 10th, 2024.pptx.pdf
Frisco Automating Purchase Orders with MuleSoft IDP- May 10th, 2024.pptx.pdf
 
AI mind or machine power point presentation
AI mind or machine power point presentationAI mind or machine power point presentation
AI mind or machine power point presentation
 
Design Guidelines for Passkeys 2024.pptx
Design Guidelines for Passkeys 2024.pptxDesign Guidelines for Passkeys 2024.pptx
Design Guidelines for Passkeys 2024.pptx
 
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
 
Top 10 CodeIgniter Development Companies
Top 10 CodeIgniter Development CompaniesTop 10 CodeIgniter Development Companies
Top 10 CodeIgniter Development Companies
 
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
 
2024 May Patch Tuesday
2024 May Patch Tuesday2024 May Patch Tuesday
2024 May Patch Tuesday
 
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontology
 
Microsoft CSP Briefing Pre-Engagement - Questionnaire
Microsoft CSP Briefing Pre-Engagement - QuestionnaireMicrosoft CSP Briefing Pre-Engagement - Questionnaire
Microsoft CSP Briefing Pre-Engagement - Questionnaire
 
ERP Contender Series: Acumatica vs. Sage Intacct
ERP Contender Series: Acumatica vs. Sage IntacctERP Contender Series: Acumatica vs. Sage Intacct
ERP Contender Series: Acumatica vs. Sage Intacct
 
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
 
Introduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDMIntroduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDM
 
ADP Passwordless Journey Case Study.pptx
ADP Passwordless Journey Case Study.pptxADP Passwordless Journey Case Study.pptx
ADP Passwordless Journey Case Study.pptx
 

Towards the targeted environment-specific evolution of robot components

  • 1. Towards the Targeted Environment- Specific Evolution of Robot Components DATA61 Jack Collins1,2 PhD Student Dr. David Howard1 Research Scientist Frederic Maire2 Senior Lecturer Wade Geles1 Industrial Trainee 1 with Data61, Commonwealth Scientific and Industrial Research Organisation (CSIRO), Brisbane, Australia 2 with the Science and Engineering Faculty, Queensland University of Technology (QUT), Brisbane, Australia
  • 2. • Design of robots typically involves: • Expert knowledge • Many man-hours • Product iterations • Influenced by human preconceptions • i.e. This shape performs well in this environment because … Motivation 2 |
  • 3. • Ubiquity of Additive Manufacturing • Stereolithography (SLA) • Selective Laser Sintering (SLS) • Fused Deposition Modeling (3D Printing) • ect. • Growing assortment of construction materials • Thermoplastics (ABS, PLA, Nylon, ect.) • Metals (Steel, Stainless Steel, Titanium, Gold, Silver) • Glass • Ceramic Motivation 3 |
  • 4. • Evolutionary Robotics – “Automated creation of autonomous robots inspired by Darwinian Evolution” • Brain and Body Co-evolved • Evolutionary Art • Our Approach – Mature Control Stack – Targeted Evolution – No Controller Evolution 4 | Karl Sims, 1994 Jeff Clune, 2013
  • 5. 1: High Outline Design Space: 16x16X32 (8192) Voxels 5 | 0 = Empty 1 = Full A voxel
  • 6. Project Chrono • Project Chrono: A high-fidelity physics simulator – Rigid Body – Flexible Body – Fluid Dynamics – Granular Terrain Modules for: • FEA • Parallel • Fluid-Solid Interaction • Irrlicht • OpenGL • Rendering • Python interface • Matlab Interface • Solidworks Plug-in http://projectchrono.org/ & http://sbel.wisc.edu/Animations/ 6 |
  • 8. 1: High • Multiple Beziers with varying control points and thicknesses. Encoding (Representation) Bezier graphic from http://graphics.cs.ucdavis.edu/~joy/GeometricModelingLectures/Unit-4/Unit4.html 8 |
  • 9. 1: High • Multiple Beziers with varying control points and thicknesses. Encoding (Representation) Bezier graphic from http://graphics.cs.ucdavis.edu/~joy/GeometricModelingLectures/Unit-4/Unit4.html 9 |
  • 10. 1: High • Multiple Beziers with varying control points and thicknesses. Encoding (Representation) Bezier graphic from http://graphics.cs.ucdavis.edu/~joy/GeometricModelingLectures/Unit-4/Unit4.html 10 |
  • 11. 1: High • Multiple Beziers with varying control points and thicknesses. Encoding (Representation) Bezier graphic from http://graphics.cs.ucdavis.edu/~joy/GeometricModelingLectures/Unit-4/Unit4.html 11 |
  • 12. Fitness Function • Fitness of an individual is calculated using: – 𝜏: Accumulated Torque – 𝛿: Percentage of occupied voxels • A lower fitness is the objective 𝑓 = 𝜏 𝑛 𝑠𝑡𝑒𝑝𝑠 + 𝜏 𝑛 𝑠𝑡𝑒𝑝𝑠 × 𝛿 5 12 |
  • 13. Genetic Algorithm • Combination of the parents and children. • Deletion of the worst performing half. • Elitism retains fittest parent. • Selection through tournament selection. • Crossover using a two-point crossover method, with the two crossover points randomly chosen values within the range of the shortest parents genotype. • Mutation – Gaussian distribution of each Bezier control point – Change Bezier thickness (20%) – Add/remove control point (20%) – Add/remove Bezier (10%) 13 |
  • 15. Experimental Setup • Population of 20 legs • Optimised for 100 generations • 30 experiments in total • 10 Experiments per environment – Soil - 7 Hours – Gravel – 2.7 Days – Fluid – 9.4 Days • Parallelised using OpenMP • Run on HPC • Across 600 cores • Not GPU enabled 15 |
  • 18. Shared Voxels 18 | Correlation between: Avg. Percentage: Soil Soil 91.8% Soil Granite 74.1% Soil Fluid 54.4% Granite Granite 72.0% Granite Fluid 59.6% Fluid Fluid 67.5%
  • 19. Environmental Comparison Legs Environ. Fluid Granite Soil Fluid 13.3767 8.6355 0.1537 Granite 58.5300 8.0856 0.1404 Soil 86.9735 117.0014 0.0904 19 |
  • 22. Contributions & Future Work • High Fidelity Simulation • Representation • Easily Instantiable • Fully functioning & applicable • FEA (Finite Element Analysis) • Real-world Validation • Further representations • Evolving mind and body 22 |

Editor's Notes

  1. -Undergrad Work -QUT -CSIRO
  2. -Typically the design of robots requires … -And this is influenced by …
  3. The wide spread adoption of Additive Manufacturing Rapidly expanding assortment of construction materials
  4. -Evolutionary Robotics is -Early work by Jeff Clune -Evolutionary Art …. PicBreeder … EndlessForms -Our approach borrows from Evolutionary art in that we only evolve the morphology of robot components -Targeted evolution of components that face “ENVIRONMENTAL PRESSURES“ -This allows us to utilise the mature control stack
  5. -Design Space (Resolution) -Hypothesis –selected robot components—high fidelity simulation—high performance morphologies—environmental niche
  6. -American & Italy (Alessandra Tasoro) Irrlicht – 3D Engine
  7. -Trimesh (encoded with soil parameters-see white paper) -Particles = gravel -Particles = fluid
  8. -Bezier Spline – control points -direct encoding
  9. -3D Beziers -5-10 Beziers -3-8 control points -Length genotype
  10. -phenotype -STL -Spline thickness 1-3 -Meshlab processing
  11. -OBJ for Project Chrono -smooth -Decimate (10000 to less than 2000 faces) -Transform and Rotate
  12. -Two terms -Torque -Occupied Voxels -Remove redundant material -3D Printing
  13. Over 100 Days into 9.4 days
  14. -Soil legs being generally skinnier than the other two; as the leg cannot 'fall through' the soil, the second term in the fitness function has more influence on the final morphology. -Gravel legs having more bulk than soil legs, so as not to fall through the environment and require additional torque resulting from dragging a partially 'submerged' leg through the gravel. -Expect streamlined, thin design. -legs fall to the bottom of the environment container -large torque penalties regardless of morphology -local minima.
  15. Difficulty of environments: -Gravel converges in 20 generations, 8.7 to 8.1 -Fluid converges in 40 generations, 21.5 to 19.1 -Soil converges in 80 generations,
  16. -Soil mean of 425 -Gravel mean of 2071
  17. -Achieved a morphology similar to something human designed -multiple contact points in the environment -Redundant material -parts of splines that add useful structure or increase surface contact. -suggests an alternate representation may be preferred.