SlideShare a Scribd company logo
1 of 18
Download to read offline
Deep Reinforcement Learning for traffic
lights timing to minimize Commuting
Time
By Transparentor
Thailand
1
2
Transparencyis an act of government sharing the
nation their data. So, their citizens and different sectors of
those governments can create solutions ,or business from that
data which it would be hard/impossible before.
3
Study the international research
to solve this problem
Reference: http://news.mit.edu/2014/traffic-lights-theres-a-better-way-0707
If you ever come to Bangkok.
You may have seen these things
4
Problem
▫ Thailand, World worst traffic jam.
Reference: http://inrix.com/resources/inrix-2016-global-traffic-scorecard
5
6
By person
Assume working 8 hr/day 300 Bath
Lost value 61✕300 ⁄ 8 * 3,564,635 Baht
By the whole city
Fuel lost 0.025 litre/minute
Latest fuel cost 28 Baht/litre
Population in city 1782371.5
Reference:
http://inrix.com/resources/inrix-2016-global-traffic-scorecard
https://www.quora.com/How-much-gas-does-a-car-burn-per-hour-while-idling
https://www.edf.org/climate/reports/idling
Wasted time average 61 hours/year/person
Fuel lost/year 1810 million Baht
Total time value loss/year 8,154 million Baht
(Only people locate in Bangkok)
Total value loss for traffic jam 9,964 million Baht
Solutions
7
DQN + Simulation
8
Why deep reinforcement learning?
● Can learns transition probability by trial-error
● Can handle unexpected situation
9
Datasets
Dataset Source (Government Organization)
Traffic status
กรมการขนสงทางบก (Department of Land Transportation)
จส.100 (JS100)
กระทรวงคมนาคม (Ministry of Transport)
Weather data กรมอุตุนิยมวิทยา (The Meteorological Department)
Event data Social Network
Date/Time Local date/time
10
Use deep reinforcement learning to control lights timing
Reinforcement
learning
model
Input
Simulation
Real traffic
light
Sensor/Data stream
Decisión
Decisión
Sensor/Data stream
11
12
13
Avg fix timing
DQN
14
Our DQN model just had been
trained(simulation elapsed time)
in average waiting time compare to the fix
time approach
20 min
trained
8%improved
The individual result may vary on many factors such as train time, random seed, distribution, fidelity of simulation, etc.
15
Conclusion
Looking at whole system Minimize
commuting
timeFast execution
Impacted field Result
Logistic Shipping faster
Individual More free time to
family
Environment Less pollution
Emotional People happier
Transportation Ordering of traffic
16
github.com/wasdee
/trafficLightDQN
Code - Result - Slides
17
Study about index that measure the congestion of traffic
Provided by iTIC and T-Square
18
Simple Simulation Design
Time
8.00 17.00
Congestiontraffic
Vehicle
Sensor
12.00 22.00

More Related Content

What's hot

CDP Cities How to Participate Webinar
CDP Cities How to Participate WebinarCDP Cities How to Participate Webinar
CDP Cities How to Participate WebinarSara Telahoun
 
Future transportation
Future transportationFuture transportation
Future transportationkamran kami
 
Cp18 call for papers uic nextstation en
Cp18 call for papers uic nextstation enCp18 call for papers uic nextstation en
Cp18 call for papers uic nextstation enUICcom
 
Adelaide’s Transport – Rail, Air, Bus, Car | Biocity Studio
Adelaide’s Transport – Rail, Air, Bus, Car | Biocity StudioAdelaide’s Transport – Rail, Air, Bus, Car | Biocity Studio
Adelaide’s Transport – Rail, Air, Bus, Car | Biocity StudioBiocity Studio
 
CK2018: Exploring Collaborative Models for Public and On-demand Bus Transport
CK2018: Exploring Collaborative Models for Public and On-demand Bus TransportCK2018: Exploring Collaborative Models for Public and On-demand Bus Transport
CK2018: Exploring Collaborative Models for Public and On-demand Bus TransportWRI Ross Center for Sustainable Cities
 
A case study of ICAO Next Generation Aviation Professional Development Strate...
A case study of ICAO Next Generation Aviation Professional Development Strate...A case study of ICAO Next Generation Aviation Professional Development Strate...
A case study of ICAO Next Generation Aviation Professional Development Strate...Universiti Kuala Lumpur
 
Internet of vehicles (io v) for traffic management
Internet of vehicles (io v) for traffic managementInternet of vehicles (io v) for traffic management
Internet of vehicles (io v) for traffic managementANTONY P SAIJI
 
Smart Logistics event in Vantaa on 14th May 2019
Smart Logistics event in Vantaa on 14th May 2019Smart Logistics event in Vantaa on 14th May 2019
Smart Logistics event in Vantaa on 14th May 2019Helsinki Region Infoshare
 

What's hot (18)

Transport Thursday driving to driverless
Transport Thursday driving to driverlessTransport Thursday driving to driverless
Transport Thursday driving to driverless
 
CDP Cities How to Participate Webinar
CDP Cities How to Participate WebinarCDP Cities How to Participate Webinar
CDP Cities How to Participate Webinar
 
Dario Hidalgo: Financing urban transport policies and programs
Dario Hidalgo: Financing urban transport policies and programsDario Hidalgo: Financing urban transport policies and programs
Dario Hidalgo: Financing urban transport policies and programs
 
Future transportation
Future transportationFuture transportation
Future transportation
 
Nicolae Duduta: Saving Lives with Sustainable Transport
Nicolae Duduta: Saving Lives with Sustainable TransportNicolae Duduta: Saving Lives with Sustainable Transport
Nicolae Duduta: Saving Lives with Sustainable Transport
 
CK2018: Early Adopters of Electric Mobility
CK2018: Early Adopters of Electric MobilityCK2018: Early Adopters of Electric Mobility
CK2018: Early Adopters of Electric Mobility
 
Cp18 call for papers uic nextstation en
Cp18 call for papers uic nextstation enCp18 call for papers uic nextstation en
Cp18 call for papers uic nextstation en
 
Smart Mobility in Smart City in Africa
Smart Mobility in Smart City in AfricaSmart Mobility in Smart City in Africa
Smart Mobility in Smart City in Africa
 
Adelaide’s Transport – Rail, Air, Bus, Car | Biocity Studio
Adelaide’s Transport – Rail, Air, Bus, Car | Biocity StudioAdelaide’s Transport – Rail, Air, Bus, Car | Biocity Studio
Adelaide’s Transport – Rail, Air, Bus, Car | Biocity Studio
 
Unit 9 Power Point
Unit 9 Power PointUnit 9 Power Point
Unit 9 Power Point
 
3.1. paul kompfer
3.1. paul kompfer3.1. paul kompfer
3.1. paul kompfer
 
CK2018: Exploring Collaborative Models for Public and On-demand Bus Transport
CK2018: Exploring Collaborative Models for Public and On-demand Bus TransportCK2018: Exploring Collaborative Models for Public and On-demand Bus Transport
CK2018: Exploring Collaborative Models for Public and On-demand Bus Transport
 
Intelligent Mobility
Intelligent MobilityIntelligent Mobility
Intelligent Mobility
 
Road Safety and Urban Environment - Claudia Adriazola-Steil - EMBARQ
Road Safety and Urban Environment - Claudia Adriazola-Steil - EMBARQ Road Safety and Urban Environment - Claudia Adriazola-Steil - EMBARQ
Road Safety and Urban Environment - Claudia Adriazola-Steil - EMBARQ
 
A case study of ICAO Next Generation Aviation Professional Development Strate...
A case study of ICAO Next Generation Aviation Professional Development Strate...A case study of ICAO Next Generation Aviation Professional Development Strate...
A case study of ICAO Next Generation Aviation Professional Development Strate...
 
Ashen Interim
Ashen InterimAshen Interim
Ashen Interim
 
Internet of vehicles (io v) for traffic management
Internet of vehicles (io v) for traffic managementInternet of vehicles (io v) for traffic management
Internet of vehicles (io v) for traffic management
 
Smart Logistics event in Vantaa on 14th May 2019
Smart Logistics event in Vantaa on 14th May 2019Smart Logistics event in Vantaa on 14th May 2019
Smart Logistics event in Vantaa on 14th May 2019
 

Similar to Deep reinforcement learning for traffic lights timing to minimize commuting time

Government Policies – Transit - Canada - February 2018
Government Policies – Transit -  Canada - February 2018Government Policies – Transit -  Canada - February 2018
Government Policies – Transit - Canada - February 2018paul young cpa, cga
 
Close the Gap: Mobility Freedom
Close the Gap: Mobility FreedomClose the Gap: Mobility Freedom
Close the Gap: Mobility FreedomHeartland2050
 
Global Challenge Porjct Report -Coursework of University of Bristol
Global Challenge Porjct Report -Coursework of University of Bristol Global Challenge Porjct Report -Coursework of University of Bristol
Global Challenge Porjct Report -Coursework of University of Bristol ssusera0a3b6
 
Public Transit - Canada - June 2018
Public Transit - Canada - June 2018 Public Transit - Canada - June 2018
Public Transit - Canada - June 2018 paul young cpa, cga
 
A survey paper on Optimal Solution on Vehicular Adhoc Network for Congestion ...
A survey paper on Optimal Solution on Vehicular Adhoc Network for Congestion ...A survey paper on Optimal Solution on Vehicular Adhoc Network for Congestion ...
A survey paper on Optimal Solution on Vehicular Adhoc Network for Congestion ...IRJET Journal
 
Transit - Ridership and Transit Revenue - Canada - May 2018
Transit - Ridership and Transit Revenue - Canada - May 2018Transit - Ridership and Transit Revenue - Canada - May 2018
Transit - Ridership and Transit Revenue - Canada - May 2018paul young cpa, cga
 
Motorized Tricycle Transportation Business in Catanduanes
Motorized Tricycle Transportation Business in CatanduanesMotorized Tricycle Transportation Business in Catanduanes
Motorized Tricycle Transportation Business in Catanduanespaperpublications3
 
IRJET- To Check Feasibility of ERP (Electronic Road Pricing) System at C ...
IRJET-  	  To Check Feasibility of ERP (Electronic Road Pricing) System at C ...IRJET-  	  To Check Feasibility of ERP (Electronic Road Pricing) System at C ...
IRJET- To Check Feasibility of ERP (Electronic Road Pricing) System at C ...IRJET Journal
 
CrowdSmart Parking System
CrowdSmart Parking SystemCrowdSmart Parking System
CrowdSmart Parking SystemRiri Kusumarani
 
Smart City-Scale Taxi Ridesharing
Smart City-Scale Taxi RidesharingSmart City-Scale Taxi Ridesharing
Smart City-Scale Taxi RidesharingIRJET Journal
 
Dynamic Real time taxi ride-sharing android Application
Dynamic Real time taxi ride-sharing android Application  Dynamic Real time taxi ride-sharing android Application
Dynamic Real time taxi ride-sharing android Application IRJET Journal
 
Problems faced by RTO users
Problems faced by RTO usersProblems faced by RTO users
Problems faced by RTO usersKarthik Krishnan
 
Planning and Design; Sketch of Future Developments - Tonny Bosch - EMBARQ Turkey
Planning and Design; Sketch of Future Developments - Tonny Bosch - EMBARQ TurkeyPlanning and Design; Sketch of Future Developments - Tonny Bosch - EMBARQ Turkey
Planning and Design; Sketch of Future Developments - Tonny Bosch - EMBARQ TurkeyWRI Ross Center for Sustainable Cities
 
Research on "City Rickshaw Barrier to Entry", Bikalpa-an Alternative
Research on "City Rickshaw Barrier to Entry", Bikalpa-an AlternativeResearch on "City Rickshaw Barrier to Entry", Bikalpa-an Alternative
Research on "City Rickshaw Barrier to Entry", Bikalpa-an AlternativeBasanta Adhikari
 
Analysis of Public Transit - Canada - August 2018
Analysis of Public Transit - Canada - August 2018Analysis of Public Transit - Canada - August 2018
Analysis of Public Transit - Canada - August 2018paul young cpa, cga
 
Study HERE SBD - How autonomous vehicles could relieve or worsen traffic cong...
Study HERE SBD - How autonomous vehicles could relieve or worsen traffic cong...Study HERE SBD - How autonomous vehicles could relieve or worsen traffic cong...
Study HERE SBD - How autonomous vehicles could relieve or worsen traffic cong...Ludovic Privat
 
Analysis of Machine Learning Algorithm with Road Accidents Data Sets
Analysis of Machine Learning Algorithm with Road Accidents Data SetsAnalysis of Machine Learning Algorithm with Road Accidents Data Sets
Analysis of Machine Learning Algorithm with Road Accidents Data SetsDr. Amarjeet Singh
 
International Experience with Electric and Zero Emission Buses
International Experience with Electric and Zero Emission BusesInternational Experience with Electric and Zero Emission Buses
International Experience with Electric and Zero Emission BusesRay Minjares
 

Similar to Deep reinforcement learning for traffic lights timing to minimize commuting time (20)

Government Policies – Transit - Canada - February 2018
Government Policies – Transit -  Canada - February 2018Government Policies – Transit -  Canada - February 2018
Government Policies – Transit - Canada - February 2018
 
Transit - Canada - May 2018
Transit -  Canada - May 2018Transit -  Canada - May 2018
Transit - Canada - May 2018
 
Close the Gap: Mobility Freedom
Close the Gap: Mobility FreedomClose the Gap: Mobility Freedom
Close the Gap: Mobility Freedom
 
Global Challenge Porjct Report -Coursework of University of Bristol
Global Challenge Porjct Report -Coursework of University of Bristol Global Challenge Porjct Report -Coursework of University of Bristol
Global Challenge Porjct Report -Coursework of University of Bristol
 
Public Transit - Canada - June 2018
Public Transit - Canada - June 2018 Public Transit - Canada - June 2018
Public Transit - Canada - June 2018
 
A survey paper on Optimal Solution on Vehicular Adhoc Network for Congestion ...
A survey paper on Optimal Solution on Vehicular Adhoc Network for Congestion ...A survey paper on Optimal Solution on Vehicular Adhoc Network for Congestion ...
A survey paper on Optimal Solution on Vehicular Adhoc Network for Congestion ...
 
Transit - Ridership and Transit Revenue - Canada - May 2018
Transit - Ridership and Transit Revenue - Canada - May 2018Transit - Ridership and Transit Revenue - Canada - May 2018
Transit - Ridership and Transit Revenue - Canada - May 2018
 
Motorized Tricycle Transportation Business in Catanduanes
Motorized Tricycle Transportation Business in CatanduanesMotorized Tricycle Transportation Business in Catanduanes
Motorized Tricycle Transportation Business in Catanduanes
 
Car Pooling Web App
Car Pooling Web AppCar Pooling Web App
Car Pooling Web App
 
IRJET- To Check Feasibility of ERP (Electronic Road Pricing) System at C ...
IRJET-  	  To Check Feasibility of ERP (Electronic Road Pricing) System at C ...IRJET-  	  To Check Feasibility of ERP (Electronic Road Pricing) System at C ...
IRJET- To Check Feasibility of ERP (Electronic Road Pricing) System at C ...
 
CrowdSmart Parking System
CrowdSmart Parking SystemCrowdSmart Parking System
CrowdSmart Parking System
 
Smart City-Scale Taxi Ridesharing
Smart City-Scale Taxi RidesharingSmart City-Scale Taxi Ridesharing
Smart City-Scale Taxi Ridesharing
 
Dynamic Real time taxi ride-sharing android Application
Dynamic Real time taxi ride-sharing android Application  Dynamic Real time taxi ride-sharing android Application
Dynamic Real time taxi ride-sharing android Application
 
Problems faced by RTO users
Problems faced by RTO usersProblems faced by RTO users
Problems faced by RTO users
 
Planning and Design; Sketch of Future Developments - Tonny Bosch - EMBARQ Turkey
Planning and Design; Sketch of Future Developments - Tonny Bosch - EMBARQ TurkeyPlanning and Design; Sketch of Future Developments - Tonny Bosch - EMBARQ Turkey
Planning and Design; Sketch of Future Developments - Tonny Bosch - EMBARQ Turkey
 
Research on "City Rickshaw Barrier to Entry", Bikalpa-an Alternative
Research on "City Rickshaw Barrier to Entry", Bikalpa-an AlternativeResearch on "City Rickshaw Barrier to Entry", Bikalpa-an Alternative
Research on "City Rickshaw Barrier to Entry", Bikalpa-an Alternative
 
Analysis of Public Transit - Canada - August 2018
Analysis of Public Transit - Canada - August 2018Analysis of Public Transit - Canada - August 2018
Analysis of Public Transit - Canada - August 2018
 
Study HERE SBD - How autonomous vehicles could relieve or worsen traffic cong...
Study HERE SBD - How autonomous vehicles could relieve or worsen traffic cong...Study HERE SBD - How autonomous vehicles could relieve or worsen traffic cong...
Study HERE SBD - How autonomous vehicles could relieve or worsen traffic cong...
 
Analysis of Machine Learning Algorithm with Road Accidents Data Sets
Analysis of Machine Learning Algorithm with Road Accidents Data SetsAnalysis of Machine Learning Algorithm with Road Accidents Data Sets
Analysis of Machine Learning Algorithm with Road Accidents Data Sets
 
International Experience with Electric and Zero Emission Buses
International Experience with Electric and Zero Emission BusesInternational Experience with Electric and Zero Emission Buses
International Experience with Electric and Zero Emission Buses
 

Recently uploaded

Brighton SEO | April 2024 | Data Storytelling
Brighton SEO | April 2024 | Data StorytellingBrighton SEO | April 2024 | Data Storytelling
Brighton SEO | April 2024 | Data StorytellingNeil Barnes
 
Low Rate Call Girls Bhilai Anika 8250192130 Independent Escort Service Bhilai
Low Rate Call Girls Bhilai Anika 8250192130 Independent Escort Service BhilaiLow Rate Call Girls Bhilai Anika 8250192130 Independent Escort Service Bhilai
Low Rate Call Girls Bhilai Anika 8250192130 Independent Escort Service BhilaiSuhani Kapoor
 
B2 Creative Industry Response Evaluation.docx
B2 Creative Industry Response Evaluation.docxB2 Creative Industry Response Evaluation.docx
B2 Creative Industry Response Evaluation.docxStephen266013
 
CebaBaby dropshipping via API with DroFX.pptx
CebaBaby dropshipping via API with DroFX.pptxCebaBaby dropshipping via API with DroFX.pptx
CebaBaby dropshipping via API with DroFX.pptxolyaivanovalion
 
Week-01-2.ppt BBB human Computer interaction
Week-01-2.ppt BBB human Computer interactionWeek-01-2.ppt BBB human Computer interaction
Week-01-2.ppt BBB human Computer interactionfulawalesam
 
Market Analysis in the 5 Largest Economic Countries in Southeast Asia.pdf
Market Analysis in the 5 Largest Economic Countries in Southeast Asia.pdfMarket Analysis in the 5 Largest Economic Countries in Southeast Asia.pdf
Market Analysis in the 5 Largest Economic Countries in Southeast Asia.pdfRachmat Ramadhan H
 
BPAC WITH UFSBI GENERAL PRESENTATION 18_05_2017-1.pptx
BPAC WITH UFSBI GENERAL PRESENTATION 18_05_2017-1.pptxBPAC WITH UFSBI GENERAL PRESENTATION 18_05_2017-1.pptx
BPAC WITH UFSBI GENERAL PRESENTATION 18_05_2017-1.pptxMohammedJunaid861692
 
April 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's AnalysisApril 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's Analysismanisha194592
 
VIP Call Girls in Amravati Aarohi 8250192130 Independent Escort Service Amravati
VIP Call Girls in Amravati Aarohi 8250192130 Independent Escort Service AmravatiVIP Call Girls in Amravati Aarohi 8250192130 Independent Escort Service Amravati
VIP Call Girls in Amravati Aarohi 8250192130 Independent Escort Service AmravatiSuhani Kapoor
 
BabyOno dropshipping via API with DroFx.pptx
BabyOno dropshipping via API with DroFx.pptxBabyOno dropshipping via API with DroFx.pptx
BabyOno dropshipping via API with DroFx.pptxolyaivanovalion
 
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al BarshaAl Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al BarshaAroojKhan71
 
BigBuy dropshipping via API with DroFx.pptx
BigBuy dropshipping via API with DroFx.pptxBigBuy dropshipping via API with DroFx.pptx
BigBuy dropshipping via API with DroFx.pptxolyaivanovalion
 
VIP High Profile Call Girls Amravati Aarushi 8250192130 Independent Escort Se...
VIP High Profile Call Girls Amravati Aarushi 8250192130 Independent Escort Se...VIP High Profile Call Girls Amravati Aarushi 8250192130 Independent Escort Se...
VIP High Profile Call Girls Amravati Aarushi 8250192130 Independent Escort Se...Suhani Kapoor
 
Carero dropshipping via API with DroFx.pptx
Carero dropshipping via API with DroFx.pptxCarero dropshipping via API with DroFx.pptx
Carero dropshipping via API with DroFx.pptxolyaivanovalion
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
Halmar dropshipping via API with DroFx
Halmar  dropshipping  via API with DroFxHalmar  dropshipping  via API with DroFx
Halmar dropshipping via API with DroFxolyaivanovalion
 
Data-Analysis for Chicago Crime Data 2023
Data-Analysis for Chicago Crime Data  2023Data-Analysis for Chicago Crime Data  2023
Data-Analysis for Chicago Crime Data 2023ymrp368
 
VidaXL dropshipping via API with DroFx.pptx
VidaXL dropshipping via API with DroFx.pptxVidaXL dropshipping via API with DroFx.pptx
VidaXL dropshipping via API with DroFx.pptxolyaivanovalion
 

Recently uploaded (20)

Brighton SEO | April 2024 | Data Storytelling
Brighton SEO | April 2024 | Data StorytellingBrighton SEO | April 2024 | Data Storytelling
Brighton SEO | April 2024 | Data Storytelling
 
Delhi 99530 vip 56974 Genuine Escort Service Call Girls in Kishangarh
Delhi 99530 vip 56974 Genuine Escort Service Call Girls in  KishangarhDelhi 99530 vip 56974 Genuine Escort Service Call Girls in  Kishangarh
Delhi 99530 vip 56974 Genuine Escort Service Call Girls in Kishangarh
 
Low Rate Call Girls Bhilai Anika 8250192130 Independent Escort Service Bhilai
Low Rate Call Girls Bhilai Anika 8250192130 Independent Escort Service BhilaiLow Rate Call Girls Bhilai Anika 8250192130 Independent Escort Service Bhilai
Low Rate Call Girls Bhilai Anika 8250192130 Independent Escort Service Bhilai
 
B2 Creative Industry Response Evaluation.docx
B2 Creative Industry Response Evaluation.docxB2 Creative Industry Response Evaluation.docx
B2 Creative Industry Response Evaluation.docx
 
CebaBaby dropshipping via API with DroFX.pptx
CebaBaby dropshipping via API with DroFX.pptxCebaBaby dropshipping via API with DroFX.pptx
CebaBaby dropshipping via API with DroFX.pptx
 
Week-01-2.ppt BBB human Computer interaction
Week-01-2.ppt BBB human Computer interactionWeek-01-2.ppt BBB human Computer interaction
Week-01-2.ppt BBB human Computer interaction
 
Market Analysis in the 5 Largest Economic Countries in Southeast Asia.pdf
Market Analysis in the 5 Largest Economic Countries in Southeast Asia.pdfMarket Analysis in the 5 Largest Economic Countries in Southeast Asia.pdf
Market Analysis in the 5 Largest Economic Countries in Southeast Asia.pdf
 
BPAC WITH UFSBI GENERAL PRESENTATION 18_05_2017-1.pptx
BPAC WITH UFSBI GENERAL PRESENTATION 18_05_2017-1.pptxBPAC WITH UFSBI GENERAL PRESENTATION 18_05_2017-1.pptx
BPAC WITH UFSBI GENERAL PRESENTATION 18_05_2017-1.pptx
 
April 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's AnalysisApril 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's Analysis
 
VIP Call Girls in Amravati Aarohi 8250192130 Independent Escort Service Amravati
VIP Call Girls in Amravati Aarohi 8250192130 Independent Escort Service AmravatiVIP Call Girls in Amravati Aarohi 8250192130 Independent Escort Service Amravati
VIP Call Girls in Amravati Aarohi 8250192130 Independent Escort Service Amravati
 
BabyOno dropshipping via API with DroFx.pptx
BabyOno dropshipping via API with DroFx.pptxBabyOno dropshipping via API with DroFx.pptx
BabyOno dropshipping via API with DroFx.pptx
 
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al BarshaAl Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
 
BigBuy dropshipping via API with DroFx.pptx
BigBuy dropshipping via API with DroFx.pptxBigBuy dropshipping via API with DroFx.pptx
BigBuy dropshipping via API with DroFx.pptx
 
VIP High Profile Call Girls Amravati Aarushi 8250192130 Independent Escort Se...
VIP High Profile Call Girls Amravati Aarushi 8250192130 Independent Escort Se...VIP High Profile Call Girls Amravati Aarushi 8250192130 Independent Escort Se...
VIP High Profile Call Girls Amravati Aarushi 8250192130 Independent Escort Se...
 
Sampling (random) method and Non random.ppt
Sampling (random) method and Non random.pptSampling (random) method and Non random.ppt
Sampling (random) method and Non random.ppt
 
Carero dropshipping via API with DroFx.pptx
Carero dropshipping via API with DroFx.pptxCarero dropshipping via API with DroFx.pptx
Carero dropshipping via API with DroFx.pptx
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Halmar dropshipping via API with DroFx
Halmar  dropshipping  via API with DroFxHalmar  dropshipping  via API with DroFx
Halmar dropshipping via API with DroFx
 
Data-Analysis for Chicago Crime Data 2023
Data-Analysis for Chicago Crime Data  2023Data-Analysis for Chicago Crime Data  2023
Data-Analysis for Chicago Crime Data 2023
 
VidaXL dropshipping via API with DroFx.pptx
VidaXL dropshipping via API with DroFx.pptxVidaXL dropshipping via API with DroFx.pptx
VidaXL dropshipping via API with DroFx.pptx
 

Deep reinforcement learning for traffic lights timing to minimize commuting time

  • 1. Deep Reinforcement Learning for traffic lights timing to minimize Commuting Time By Transparentor Thailand 1
  • 2. 2 Transparencyis an act of government sharing the nation their data. So, their citizens and different sectors of those governments can create solutions ,or business from that data which it would be hard/impossible before.
  • 3. 3 Study the international research to solve this problem Reference: http://news.mit.edu/2014/traffic-lights-theres-a-better-way-0707
  • 4. If you ever come to Bangkok. You may have seen these things 4
  • 5. Problem ▫ Thailand, World worst traffic jam. Reference: http://inrix.com/resources/inrix-2016-global-traffic-scorecard 5
  • 6. 6 By person Assume working 8 hr/day 300 Bath Lost value 61✕300 ⁄ 8 * 3,564,635 Baht By the whole city Fuel lost 0.025 litre/minute Latest fuel cost 28 Baht/litre Population in city 1782371.5 Reference: http://inrix.com/resources/inrix-2016-global-traffic-scorecard https://www.quora.com/How-much-gas-does-a-car-burn-per-hour-while-idling https://www.edf.org/climate/reports/idling Wasted time average 61 hours/year/person Fuel lost/year 1810 million Baht Total time value loss/year 8,154 million Baht (Only people locate in Bangkok) Total value loss for traffic jam 9,964 million Baht
  • 8. 8 Why deep reinforcement learning? ● Can learns transition probability by trial-error ● Can handle unexpected situation
  • 9. 9 Datasets Dataset Source (Government Organization) Traffic status กรมการขนสงทางบก (Department of Land Transportation) จส.100 (JS100) กระทรวงคมนาคม (Ministry of Transport) Weather data กรมอุตุนิยมวิทยา (The Meteorological Department) Event data Social Network Date/Time Local date/time
  • 10. 10 Use deep reinforcement learning to control lights timing Reinforcement learning model Input Simulation Real traffic light Sensor/Data stream Decisión Decisión Sensor/Data stream
  • 11. 11
  • 12. 12
  • 14. 14 Our DQN model just had been trained(simulation elapsed time) in average waiting time compare to the fix time approach 20 min trained 8%improved The individual result may vary on many factors such as train time, random seed, distribution, fidelity of simulation, etc.
  • 15. 15 Conclusion Looking at whole system Minimize commuting timeFast execution Impacted field Result Logistic Shipping faster Individual More free time to family Environment Less pollution Emotional People happier Transportation Ordering of traffic
  • 17. 17 Study about index that measure the congestion of traffic Provided by iTIC and T-Square
  • 18. 18 Simple Simulation Design Time 8.00 17.00 Congestiontraffic Vehicle Sensor 12.00 22.00