SlideShare a Scribd company logo
Applying Genetic
Algorithms for the
Improvement of an
Autonomous Fuzzy Driver
for Simulated Car Racing
•  Mohammed Salem (University of Mascara, Algeria)
•  Antonio Miguel Mora @amoragar and JJ Merelo @jjmerelo
(University of Granada, Spain)
•  Pablo García-Sánchez (University of Cádiz, Spain) @fergunet
Start your engines!
—  What is TORCS?
—  Description of our fuzzy controller
—  Genetic Algorithms
—  Compared fitness functions
—  Experimental setup
—  Results
—  Conclusions
What is TORCS?
—  The Open Racing Car Simulator
—  Used in Competitions and Testbed for AI
—  Controllers (Driving bots):
—  Sensors: Car and Track sensors
—  Actuators: Steer, Accelerator, Break, Gear
TORCS
Controller Architecture
Mamdani Fuzzy System
Trapezoidal Membership
SPEED Fuzzy
Controller
IF Front = High THEN TargetSpeed is 280
IF Front = Medium THEN TargetSpeed is 240
IF Front = Low AND M5 = High THEN TargetSpeed is 220
IF Front = Low AND M5 = Medium THEN TargetSpeed is 180
IF Front = Low AND M5 = Low AND M10 = High THEN TargetSpeed is 120
IF Front = Low AND M5 = Low AND M10 = Medium THEN TargetSpeed is 60
IF Front = Low AND M5 = Low AND M10 = Low THEN TargetSpeed is 30
IF Front = MAXDISTSPEED OR M5 = MAXDISTSPEED OR M10 =
MAXDISTSPEED
THEN TargetSpeed = 300
STEER Fuzzy Controller
IF Front = High THEN steer = 0
IF Front = Medium AND M10 = High THEN steer = 0.25
IF Front = Medium AND M10 = Medium AND M5 = Medium THEN steer =
0.25
IF Front = Medium AND M10 = Medium AND M5 = Low THEN steer = 0.5
IF Front = Low AND M10 = High THEN steer = 0.5
IF Front = Low AND M10 = Medium AND M5 = Medium THEN steer =
0.75
IF Front = Low AND M10 = Medium AND M5 = Low THEN steer = 0.75
Training (Genetic
Algorithms)
Fitness Functions compared
—  Minimize:
GA Parameters
—  Population size: 20 and 50
—  Generations: 50
—  Crossover rate: 0.7
—  Mutation rate: 0.3
—  Runs per configuration: 20
—  Circuit used for training: E-track5
—  Car used: car1-tbr1
—  Real coded individual
Post-optimization
experiments
—  Practice Race: GFC1 vs GFC2 vs AD (previous hand-
designed fuzzy controller. In E-Track and E-Road
(not used for optimization)
—  Real Races (5 laps):
—  E-Track
—  E-Road
—  A-Speedway
Final lap! (Results)
—  Controller behavior
—  more sensitive to middle distances of the inputs
—  Late breaking and selection of optimal trajectory
—  Practice Race (know and unknown circuits):
—  Damage reduced to 0
—  GFC2 uses TopSpeed for optimization->TopSpeed
increases
—  Real race in know circuit: 2nd position (no damage)
—  Real race in unknown circuit: 3rd position (no damage)
—  Real race in unknown and difficult circuit: 4th position
Finish Line! (Conclusions
and future work)
—  Optimized controllers obtained good positions in
real races
—  New controllers increase top speed and reduce
damage
—  Future work:
—  Improve the evaluation using several tracks
—  Combine optimized controllers
—  MOEAs
—  Genetic Programming for the rule base
Thank you!

More Related Content

Similar to IPMU TORCS

SideSlip Angle Estimator (SSE)
SideSlip Angle Estimator (SSE)SideSlip Angle Estimator (SSE)
SideSlip Angle Estimator (SSE)Enrico Busto
 
Body management presentation
Body management presentationBody management presentation
Body management presentationdarren panozzo
 
Encoding Robotic Sensor States for Q-Learning using the
Encoding Robotic Sensor States for Q-Learning using the Encoding Robotic Sensor States for Q-Learning using the
Encoding Robotic Sensor States for Q-Learning using the butest
 
Front Crash Prevention and AEB - Addendum, Adrian Lund, President IIHS & HLDI
Front Crash Prevention and AEB - Addendum, Adrian Lund, President IIHS & HLDIFront Crash Prevention and AEB - Addendum, Adrian Lund, President IIHS & HLDI
Front Crash Prevention and AEB - Addendum, Adrian Lund, President IIHS & HLDIGlobal NCAP
 
University Final Project
University Final ProjectUniversity Final Project
University Final ProjectReinaldo Wiener
 
Matthew Avery speaks at Global NCAP Annual Forum 2014 Melbourne
Matthew Avery speaks at Global NCAP Annual Forum 2014 MelbourneMatthew Avery speaks at Global NCAP Annual Forum 2014 Melbourne
Matthew Avery speaks at Global NCAP Annual Forum 2014 MelbourneGlobal NCAP
 
2010 Simulated Car Racing Championship @ GECCO-2010
2010 Simulated Car Racing Championship @ GECCO-20102010 Simulated Car Racing Championship @ GECCO-2010
2010 Simulated Car Racing Championship @ GECCO-2010Daniele Loiacono
 
Real time vision for intelligent vehicles
Real time vision for intelligent vehiclesReal time vision for intelligent vehicles
Real time vision for intelligent vehiclesI'am Ajas
 
Embedded Final Project
Embedded Final ProjectEmbedded Final Project
Embedded Final ProjectAmol Galande
 
MODELING AND DESIGN OF CRUISE CONTROL SYSTEM WITH FEEDFORWARD FOR ALL TERRIAN...
MODELING AND DESIGN OF CRUISE CONTROL SYSTEM WITH FEEDFORWARD FOR ALL TERRIAN...MODELING AND DESIGN OF CRUISE CONTROL SYSTEM WITH FEEDFORWARD FOR ALL TERRIAN...
MODELING AND DESIGN OF CRUISE CONTROL SYSTEM WITH FEEDFORWARD FOR ALL TERRIAN...cscpconf
 
An Overview of Vehicle Control Systems
An Overview of Vehicle Control SystemsAn Overview of Vehicle Control Systems
An Overview of Vehicle Control SystemsBehzad Samadi
 
Cruise contro in car
Cruise contro in carCruise contro in car
Cruise contro in carkmlthakur
 
Design and performance Analysis of a 5 Speed Manual Transmission System for I...
Design and performance Analysis of a 5 Speed Manual Transmission System for I...Design and performance Analysis of a 5 Speed Manual Transmission System for I...
Design and performance Analysis of a 5 Speed Manual Transmission System for I...IRJET Journal
 
Formula SAE: Racing Cars Built by Students
Formula SAE: Racing Cars Built by StudentsFormula SAE: Racing Cars Built by Students
Formula SAE: Racing Cars Built by StudentsSpeck&Tech
 
IRJET- Design, Development and Manufacturing of CVT for ATV through Real ...
IRJET-  	  Design, Development and Manufacturing of CVT for ATV through Real ...IRJET-  	  Design, Development and Manufacturing of CVT for ATV through Real ...
IRJET- Design, Development and Manufacturing of CVT for ATV through Real ...IRJET Journal
 
Gear Shifting Behavior Model for Ecodriving Simulations Based on Experimental...
Gear Shifting Behavior Model for Ecodriving Simulations Based on Experimental...Gear Shifting Behavior Model for Ecodriving Simulations Based on Experimental...
Gear Shifting Behavior Model for Ecodriving Simulations Based on Experimental...Olivier Orfila
 

Similar to IPMU TORCS (20)

Cruise control
Cruise controlCruise control
Cruise control
 
SideSlip Angle Estimator (SSE)
SideSlip Angle Estimator (SSE)SideSlip Angle Estimator (SSE)
SideSlip Angle Estimator (SSE)
 
Autonomous Cars
Autonomous CarsAutonomous Cars
Autonomous Cars
 
Body management presentation
Body management presentationBody management presentation
Body management presentation
 
Adaptive cruise control
Adaptive   cruise  control Adaptive   cruise  control
Adaptive cruise control
 
Encoding Robotic Sensor States for Q-Learning using the
Encoding Robotic Sensor States for Q-Learning using the Encoding Robotic Sensor States for Q-Learning using the
Encoding Robotic Sensor States for Q-Learning using the
 
Front Crash Prevention and AEB - Addendum, Adrian Lund, President IIHS & HLDI
Front Crash Prevention and AEB - Addendum, Adrian Lund, President IIHS & HLDIFront Crash Prevention and AEB - Addendum, Adrian Lund, President IIHS & HLDI
Front Crash Prevention and AEB - Addendum, Adrian Lund, President IIHS & HLDI
 
Session 50Josef Nilsson
Session 50Josef NilssonSession 50Josef Nilsson
Session 50Josef Nilsson
 
University Final Project
University Final ProjectUniversity Final Project
University Final Project
 
Matthew Avery speaks at Global NCAP Annual Forum 2014 Melbourne
Matthew Avery speaks at Global NCAP Annual Forum 2014 MelbourneMatthew Avery speaks at Global NCAP Annual Forum 2014 Melbourne
Matthew Avery speaks at Global NCAP Annual Forum 2014 Melbourne
 
2010 Simulated Car Racing Championship @ GECCO-2010
2010 Simulated Car Racing Championship @ GECCO-20102010 Simulated Car Racing Championship @ GECCO-2010
2010 Simulated Car Racing Championship @ GECCO-2010
 
Real time vision for intelligent vehicles
Real time vision for intelligent vehiclesReal time vision for intelligent vehicles
Real time vision for intelligent vehicles
 
Embedded Final Project
Embedded Final ProjectEmbedded Final Project
Embedded Final Project
 
MODELING AND DESIGN OF CRUISE CONTROL SYSTEM WITH FEEDFORWARD FOR ALL TERRIAN...
MODELING AND DESIGN OF CRUISE CONTROL SYSTEM WITH FEEDFORWARD FOR ALL TERRIAN...MODELING AND DESIGN OF CRUISE CONTROL SYSTEM WITH FEEDFORWARD FOR ALL TERRIAN...
MODELING AND DESIGN OF CRUISE CONTROL SYSTEM WITH FEEDFORWARD FOR ALL TERRIAN...
 
An Overview of Vehicle Control Systems
An Overview of Vehicle Control SystemsAn Overview of Vehicle Control Systems
An Overview of Vehicle Control Systems
 
Cruise contro in car
Cruise contro in carCruise contro in car
Cruise contro in car
 
Design and performance Analysis of a 5 Speed Manual Transmission System for I...
Design and performance Analysis of a 5 Speed Manual Transmission System for I...Design and performance Analysis of a 5 Speed Manual Transmission System for I...
Design and performance Analysis of a 5 Speed Manual Transmission System for I...
 
Formula SAE: Racing Cars Built by Students
Formula SAE: Racing Cars Built by StudentsFormula SAE: Racing Cars Built by Students
Formula SAE: Racing Cars Built by Students
 
IRJET- Design, Development and Manufacturing of CVT for ATV through Real ...
IRJET-  	  Design, Development and Manufacturing of CVT for ATV through Real ...IRJET-  	  Design, Development and Manufacturing of CVT for ATV through Real ...
IRJET- Design, Development and Manufacturing of CVT for ATV through Real ...
 
Gear Shifting Behavior Model for Ecodriving Simulations Based on Experimental...
Gear Shifting Behavior Model for Ecodriving Simulations Based on Experimental...Gear Shifting Behavior Model for Ecodriving Simulations Based on Experimental...
Gear Shifting Behavior Model for Ecodriving Simulations Based on Experimental...
 

Recently uploaded

Unveiling the National Logistics Policy (NLP) and navigating India's economic...
Unveiling the National Logistics Policy (NLP) and navigating India's economic...Unveiling the National Logistics Policy (NLP) and navigating India's economic...
Unveiling the National Logistics Policy (NLP) and navigating India's economic...TQSLogistics
 
Exploring Montreal's Artistic Heritage Top Art Galleries and Museums to Visit
Exploring Montreal's Artistic Heritage Top Art Galleries and Museums to VisitExploring Montreal's Artistic Heritage Top Art Galleries and Museums to Visit
Exploring Montreal's Artistic Heritage Top Art Galleries and Museums to VisitSpade & Palacio Tours
 
Agence Régionale du Tourisme Grand Est - brochure MICE 2024.pdf
Agence Régionale du Tourisme Grand Est - brochure MICE 2024.pdfAgence Régionale du Tourisme Grand Est - brochure MICE 2024.pdf
Agence Régionale du Tourisme Grand Est - brochure MICE 2024.pdfMICEboard
 
Exploring Heritage The Ultimate Cultural Tour in Palmer, Puerto Rico
Exploring Heritage The Ultimate Cultural Tour in Palmer, Puerto RicoExploring Heritage The Ultimate Cultural Tour in Palmer, Puerto Rico
Exploring Heritage The Ultimate Cultural Tour in Palmer, Puerto RicoCaribbean Breeze Adventures
 
TRAVEL TO MT. RWENZORI NATIONAL PARK WITH NILE ABENTEUER SAFARIS.docx
TRAVEL TO MT. RWENZORI NATIONAL PARK WITH NILE ABENTEUER SAFARIS.docxTRAVEL TO MT. RWENZORI NATIONAL PARK WITH NILE ABENTEUER SAFARIS.docx
TRAVEL TO MT. RWENZORI NATIONAL PARK WITH NILE ABENTEUER SAFARIS.docxnileabenteuersafaris
 
MC INTERNATIONALS | TRAVEL COMPANY IN JHANG
MC INTERNATIONALS | TRAVEL COMPANY IN JHANGMC INTERNATIONALS | TRAVEL COMPANY IN JHANG
MC INTERNATIONALS | TRAVEL COMPANY IN JHANGAshBhatt4
 
Hunza Cherry Blossom tour 2025- Hunza Adventure Tours
Hunza Cherry Blossom tour 2025- Hunza Adventure ToursHunza Cherry Blossom tour 2025- Hunza Adventure Tours
Hunza Cherry Blossom tour 2025- Hunza Adventure ToursHunza Adventure Tours
 
Explore India Buddhist Pilgrimage Tour Packages with IRCTC Buddhist Circuit.pptx
Explore India Buddhist Pilgrimage Tour Packages with IRCTC Buddhist Circuit.pptxExplore India Buddhist Pilgrimage Tour Packages with IRCTC Buddhist Circuit.pptx
Explore India Buddhist Pilgrimage Tour Packages with IRCTC Buddhist Circuit.pptxIRCTCBuddhisttrain
 
欧洲杯开户-信誉的欧洲杯开户-正规欧洲杯开户|【​网址​🎉ac123.net🎉​】
欧洲杯开户-信誉的欧洲杯开户-正规欧洲杯开户|【​网址​🎉ac123.net🎉​】欧洲杯开户-信誉的欧洲杯开户-正规欧洲杯开户|【​网址​🎉ac123.net🎉​】
欧洲杯开户-信誉的欧洲杯开户-正规欧洲杯开户|【​网址​🎉ac123.net🎉​】bljeremy734
 
How To Change Name On Volaris Ticket.pdf
How To Change Name On Volaris Ticket.pdfHow To Change Name On Volaris Ticket.pdf
How To Change Name On Volaris Ticket.pdfnamechange763
 
Présentation About Algiers City (noureddine boureneb)
Présentation About Algiers City (noureddine boureneb)Présentation About Algiers City (noureddine boureneb)
Présentation About Algiers City (noureddine boureneb)klaisaci
 
Winter Festivities in Italy
Winter Festivities in ItalyWinter Festivities in Italy
Winter Festivities in ItalyTime for Sicily
 
Understanding the Running Costs of Electric Scooters.pptx
Understanding the Running Costs of Electric Scooters.pptxUnderstanding the Running Costs of Electric Scooters.pptx
Understanding the Running Costs of Electric Scooters.pptxZivah ElectriVa Private Limited
 
Golden Triangle Tour India_ Explore the Beauty of Delhi, Agra, and Jaipur.pdf
Golden Triangle Tour India_ Explore the Beauty of Delhi, Agra, and Jaipur.pdfGolden Triangle Tour India_ Explore the Beauty of Delhi, Agra, and Jaipur.pdf
Golden Triangle Tour India_ Explore the Beauty of Delhi, Agra, and Jaipur.pdfVardhman Vacations
 

Recently uploaded (15)

Unveiling the National Logistics Policy (NLP) and navigating India's economic...
Unveiling the National Logistics Policy (NLP) and navigating India's economic...Unveiling the National Logistics Policy (NLP) and navigating India's economic...
Unveiling the National Logistics Policy (NLP) and navigating India's economic...
 
Exploring Montreal's Artistic Heritage Top Art Galleries and Museums to Visit
Exploring Montreal's Artistic Heritage Top Art Galleries and Museums to VisitExploring Montreal's Artistic Heritage Top Art Galleries and Museums to Visit
Exploring Montreal's Artistic Heritage Top Art Galleries and Museums to Visit
 
Agence Régionale du Tourisme Grand Est - brochure MICE 2024.pdf
Agence Régionale du Tourisme Grand Est - brochure MICE 2024.pdfAgence Régionale du Tourisme Grand Est - brochure MICE 2024.pdf
Agence Régionale du Tourisme Grand Est - brochure MICE 2024.pdf
 
Exploring Heritage The Ultimate Cultural Tour in Palmer, Puerto Rico
Exploring Heritage The Ultimate Cultural Tour in Palmer, Puerto RicoExploring Heritage The Ultimate Cultural Tour in Palmer, Puerto Rico
Exploring Heritage The Ultimate Cultural Tour in Palmer, Puerto Rico
 
TRAVEL TO MT. RWENZORI NATIONAL PARK WITH NILE ABENTEUER SAFARIS.docx
TRAVEL TO MT. RWENZORI NATIONAL PARK WITH NILE ABENTEUER SAFARIS.docxTRAVEL TO MT. RWENZORI NATIONAL PARK WITH NILE ABENTEUER SAFARIS.docx
TRAVEL TO MT. RWENZORI NATIONAL PARK WITH NILE ABENTEUER SAFARIS.docx
 
MC INTERNATIONALS | TRAVEL COMPANY IN JHANG
MC INTERNATIONALS | TRAVEL COMPANY IN JHANGMC INTERNATIONALS | TRAVEL COMPANY IN JHANG
MC INTERNATIONALS | TRAVEL COMPANY IN JHANG
 
Hunza Cherry Blossom tour 2025- Hunza Adventure Tours
Hunza Cherry Blossom tour 2025- Hunza Adventure ToursHunza Cherry Blossom tour 2025- Hunza Adventure Tours
Hunza Cherry Blossom tour 2025- Hunza Adventure Tours
 
Explore India Buddhist Pilgrimage Tour Packages with IRCTC Buddhist Circuit.pptx
Explore India Buddhist Pilgrimage Tour Packages with IRCTC Buddhist Circuit.pptxExplore India Buddhist Pilgrimage Tour Packages with IRCTC Buddhist Circuit.pptx
Explore India Buddhist Pilgrimage Tour Packages with IRCTC Buddhist Circuit.pptx
 
欧洲杯开户-信誉的欧洲杯开户-正规欧洲杯开户|【​网址​🎉ac123.net🎉​】
欧洲杯开户-信誉的欧洲杯开户-正规欧洲杯开户|【​网址​🎉ac123.net🎉​】欧洲杯开户-信誉的欧洲杯开户-正规欧洲杯开户|【​网址​🎉ac123.net🎉​】
欧洲杯开户-信誉的欧洲杯开户-正规欧洲杯开户|【​网址​🎉ac123.net🎉​】
 
How To Change Name On Volaris Ticket.pdf
How To Change Name On Volaris Ticket.pdfHow To Change Name On Volaris Ticket.pdf
How To Change Name On Volaris Ticket.pdf
 
Paddle, Float, and Explore The Ultimate River Tour Experience in Monitor, WA
Paddle, Float, and Explore The Ultimate River Tour Experience in Monitor, WAPaddle, Float, and Explore The Ultimate River Tour Experience in Monitor, WA
Paddle, Float, and Explore The Ultimate River Tour Experience in Monitor, WA
 
Présentation About Algiers City (noureddine boureneb)
Présentation About Algiers City (noureddine boureneb)Présentation About Algiers City (noureddine boureneb)
Présentation About Algiers City (noureddine boureneb)
 
Winter Festivities in Italy
Winter Festivities in ItalyWinter Festivities in Italy
Winter Festivities in Italy
 
Understanding the Running Costs of Electric Scooters.pptx
Understanding the Running Costs of Electric Scooters.pptxUnderstanding the Running Costs of Electric Scooters.pptx
Understanding the Running Costs of Electric Scooters.pptx
 
Golden Triangle Tour India_ Explore the Beauty of Delhi, Agra, and Jaipur.pdf
Golden Triangle Tour India_ Explore the Beauty of Delhi, Agra, and Jaipur.pdfGolden Triangle Tour India_ Explore the Beauty of Delhi, Agra, and Jaipur.pdf
Golden Triangle Tour India_ Explore the Beauty of Delhi, Agra, and Jaipur.pdf
 

IPMU TORCS

  • 1. Applying Genetic Algorithms for the Improvement of an Autonomous Fuzzy Driver for Simulated Car Racing •  Mohammed Salem (University of Mascara, Algeria) •  Antonio Miguel Mora @amoragar and JJ Merelo @jjmerelo (University of Granada, Spain) •  Pablo García-Sánchez (University of Cádiz, Spain) @fergunet
  • 2. Start your engines! —  What is TORCS? —  Description of our fuzzy controller —  Genetic Algorithms —  Compared fitness functions —  Experimental setup —  Results —  Conclusions
  • 3. What is TORCS? —  The Open Racing Car Simulator —  Used in Competitions and Testbed for AI —  Controllers (Driving bots): —  Sensors: Car and Track sensors —  Actuators: Steer, Accelerator, Break, Gear
  • 5.
  • 8. SPEED Fuzzy Controller IF Front = High THEN TargetSpeed is 280 IF Front = Medium THEN TargetSpeed is 240 IF Front = Low AND M5 = High THEN TargetSpeed is 220 IF Front = Low AND M5 = Medium THEN TargetSpeed is 180 IF Front = Low AND M5 = Low AND M10 = High THEN TargetSpeed is 120 IF Front = Low AND M5 = Low AND M10 = Medium THEN TargetSpeed is 60 IF Front = Low AND M5 = Low AND M10 = Low THEN TargetSpeed is 30 IF Front = MAXDISTSPEED OR M5 = MAXDISTSPEED OR M10 = MAXDISTSPEED THEN TargetSpeed = 300
  • 9. STEER Fuzzy Controller IF Front = High THEN steer = 0 IF Front = Medium AND M10 = High THEN steer = 0.25 IF Front = Medium AND M10 = Medium AND M5 = Medium THEN steer = 0.25 IF Front = Medium AND M10 = Medium AND M5 = Low THEN steer = 0.5 IF Front = Low AND M10 = High THEN steer = 0.5 IF Front = Low AND M10 = Medium AND M5 = Medium THEN steer = 0.75 IF Front = Low AND M10 = Medium AND M5 = Low THEN steer = 0.75
  • 12. GA Parameters —  Population size: 20 and 50 —  Generations: 50 —  Crossover rate: 0.7 —  Mutation rate: 0.3 —  Runs per configuration: 20 —  Circuit used for training: E-track5 —  Car used: car1-tbr1 —  Real coded individual
  • 13. Post-optimization experiments —  Practice Race: GFC1 vs GFC2 vs AD (previous hand- designed fuzzy controller. In E-Track and E-Road (not used for optimization) —  Real Races (5 laps): —  E-Track —  E-Road —  A-Speedway
  • 14. Final lap! (Results) —  Controller behavior —  more sensitive to middle distances of the inputs —  Late breaking and selection of optimal trajectory —  Practice Race (know and unknown circuits): —  Damage reduced to 0 —  GFC2 uses TopSpeed for optimization->TopSpeed increases —  Real race in know circuit: 2nd position (no damage) —  Real race in unknown circuit: 3rd position (no damage) —  Real race in unknown and difficult circuit: 4th position
  • 15. Finish Line! (Conclusions and future work) —  Optimized controllers obtained good positions in real races —  New controllers increase top speed and reduce damage —  Future work: —  Improve the evaluation using several tracks —  Combine optimized controllers —  MOEAs —  Genetic Programming for the rule base