SlideShare a Scribd company logo
1 of 18
Download to read offline
Architecting a real-time
optimization framework for
Driver Positioning
Hao Yi Ong
w/ many others at Lyft
INFORMS Annual Meeting | Seattle | October 22, 2019
Overview
ResultsFormulationProblem
Problem
Dynamic pricing heatmap for drivers
Prime Time (PT)
Personal Power Zones (PPZ) product
Pre-empt general market imbalance
and help with events or demand
spikes
Algorithmically coordinate drivers
when whole cities light up with rider
demand
De-conflicting drivers Early signaling
Give a ride, get your bonus
#1
Drive into the purple zone,
guarantee a bonus on your next
ride.
#2
Drive into the pink zone, guarantee
an even bigger bonus
#3
Formulation
PT problem
The PT model maps market conditions (supply and demand) to the general notion of value.
// value; e.g., rides
// match supply/demand
// limit price
fixed parameter:
treatable supply
untreatable supply
price-adjusted
demand
reserved supply
PT problem
The PT model maps market conditions (supply and demand) to the general notion of value.
MKT model
demand by gh6
supply by gh6
value
PPZ problem
Supply and supply allocation are the PPZ decision variables (in addition to PT). The PPZ
model repositions supply to maximize value.
PPZ model
MKT model
forecasted demand by gh6
supply by gh6
value
iteratively refine
supply allocation
“feedback”
PPZ-induced value
// move supply
// allocation constraints
decision variable:
treatable supply
PPZ problem
Supply and supply allocation are the PPZ decision variables (in addition to PT). The PPZ
model repositions supply to maximize value. (Omitted: various other business constraints.)
decision variable:
supply allocation
initial treatable
supply
Results
Assumptions
● Drivers don’t reposition themselves for decision look-ahead
● Driver compliance exponentially decays as travel time increases (fitted)
● When drivers comply, they move to destination by the next time step
Methodology
● Historically accurate data importance-sampled over a quarter over top-10 cities
● “Fractional drivers” rounded down to the nearest integer to compute “actual value”
Results (varies by city)
● 1—4% incremental rides
● 0.2—1% incremental bookings
Numerical experiments
Methodology
● Time-split experiments infeasible due to product experience
● User-split testing is the least bad option
● Impact estimates derived from causal inference methods
Results (varies by city)
● ~0.3% incremental bookings
● Overall, drivers prefer PPZ over PT
● PPZ rolled out to virtually everywhere
User-split experiments
Work in-progress in collaboration with many teams at Lyft — join us!
Reach out!
haoyi@lyft.com

More Related Content

Similar to Architecting a real time optimization platform for driver positioning (informs 2019)

Food delivery - Supply Chain Logistics Model & Frame work
Food delivery - Supply Chain Logistics Model & Frame workFood delivery - Supply Chain Logistics Model & Frame work
Food delivery - Supply Chain Logistics Model & Frame workAlvis Lazarus
 
Strategic Product Development and Cost Estimates for Automotive Industry
Strategic Product Development and Cost Estimates for Automotive IndustryStrategic Product Development and Cost Estimates for Automotive Industry
Strategic Product Development and Cost Estimates for Automotive IndustryVedant Borse
 
3803_Strategic Product Development_ASUG v4
3803_Strategic Product Development_ASUG v43803_Strategic Product Development_ASUG v4
3803_Strategic Product Development_ASUG v4Vedant Borse
 
Elevate 2017- Pricing evolution: The Road to Dynamic Offer Generation
Elevate 2017- Pricing evolution: The Road to Dynamic Offer GenerationElevate 2017- Pricing evolution: The Road to Dynamic Offer Generation
Elevate 2017- Pricing evolution: The Road to Dynamic Offer GenerationATPCO
 
Scheduling And Revenue Management Process
Scheduling And Revenue Management ProcessScheduling And Revenue Management Process
Scheduling And Revenue Management Processahmad bassiouny
 
ChoiceModels_INFORMS_Nov2016
ChoiceModels_INFORMS_Nov2016ChoiceModels_INFORMS_Nov2016
ChoiceModels_INFORMS_Nov2016Emmanuel Carrier
 
A COMPARATIVE STUDY OF DIFFERENT INTEGRATED MULTIPLE CRITERIA DECISION MAKING...
A COMPARATIVE STUDY OF DIFFERENT INTEGRATED MULTIPLE CRITERIA DECISION MAKING...A COMPARATIVE STUDY OF DIFFERENT INTEGRATED MULTIPLE CRITERIA DECISION MAKING...
A COMPARATIVE STUDY OF DIFFERENT INTEGRATED MULTIPLE CRITERIA DECISION MAKING...Shankha Goswami
 
3G War: Who will be the winner?
3G War: Who will be the winner?3G War: Who will be the winner?
3G War: Who will be the winner?Alok Singh
 
Pros And Cons Of Outsourcing Bus Operations
Pros And Cons Of Outsourcing Bus OperationsPros And Cons Of Outsourcing Bus Operations
Pros And Cons Of Outsourcing Bus OperationsJaspal Singh
 
Industry 4.0: use cases for integrated supply chain
Industry 4.0: use cases for integrated supply chainIndustry 4.0: use cases for integrated supply chain
Industry 4.0: use cases for integrated supply chainAnubhav Dhiman
 
Ranking System for travel search (PoC)
Ranking System for travel search (PoC)Ranking System for travel search (PoC)
Ranking System for travel search (PoC)M Baddar
 
Implementation and Validation of Supplier Selection Model for Planner Machine...
Implementation and Validation of Supplier Selection Model for Planner Machine...Implementation and Validation of Supplier Selection Model for Planner Machine...
Implementation and Validation of Supplier Selection Model for Planner Machine...IJSRD
 
"Efficient and Effective Logistics by way of On Time Delivery (OTD)- A study ...
"Efficient and Effective Logistics by way of On Time Delivery (OTD)- A study ..."Efficient and Effective Logistics by way of On Time Delivery (OTD)- A study ...
"Efficient and Effective Logistics by way of On Time Delivery (OTD)- A study ...Ravinder Dahiya
 
Representing Cross-border Trade in Long-term Power System Planning Models wit...
Representing Cross-border Trade in Long-term Power System Planning Models wit...Representing Cross-border Trade in Long-term Power System Planning Models wit...
Representing Cross-border Trade in Long-term Power System Planning Models wit...IEA-ETSAP
 
LPC Transport Presentation introduction to PLC
LPC Transport Presentation introduction to PLCLPC Transport Presentation introduction to PLC
LPC Transport Presentation introduction to PLCthomas851723
 
Introduction to LPC - Facility Design And Re-Engineering
Introduction to LPC - Facility Design And Re-EngineeringIntroduction to LPC - Facility Design And Re-Engineering
Introduction to LPC - Facility Design And Re-Engineeringthomas851723
 
IRJET- Analysis and Prediction of Delay at Signalized Junctions in Bangalore
IRJET- Analysis and Prediction of Delay at Signalized Junctions in BangaloreIRJET- Analysis and Prediction of Delay at Signalized Junctions in Bangalore
IRJET- Analysis and Prediction of Delay at Signalized Junctions in BangaloreIRJET Journal
 
How Vnomics built a "Digital Twin" for Commercial Trucking
How Vnomics built a "Digital Twin" for Commercial TruckingHow Vnomics built a "Digital Twin" for Commercial Trucking
How Vnomics built a "Digital Twin" for Commercial TruckingLloyd Palum
 

Similar to Architecting a real time optimization platform for driver positioning (informs 2019) (20)

H1302023840
H1302023840H1302023840
H1302023840
 
Food delivery - Supply Chain Logistics Model & Frame work
Food delivery - Supply Chain Logistics Model & Frame workFood delivery - Supply Chain Logistics Model & Frame work
Food delivery - Supply Chain Logistics Model & Frame work
 
Secure Benchmarking
Secure BenchmarkingSecure Benchmarking
Secure Benchmarking
 
Strategic Product Development and Cost Estimates for Automotive Industry
Strategic Product Development and Cost Estimates for Automotive IndustryStrategic Product Development and Cost Estimates for Automotive Industry
Strategic Product Development and Cost Estimates for Automotive Industry
 
3803_Strategic Product Development_ASUG v4
3803_Strategic Product Development_ASUG v43803_Strategic Product Development_ASUG v4
3803_Strategic Product Development_ASUG v4
 
Elevate 2017- Pricing evolution: The Road to Dynamic Offer Generation
Elevate 2017- Pricing evolution: The Road to Dynamic Offer GenerationElevate 2017- Pricing evolution: The Road to Dynamic Offer Generation
Elevate 2017- Pricing evolution: The Road to Dynamic Offer Generation
 
Scheduling And Revenue Management Process
Scheduling And Revenue Management ProcessScheduling And Revenue Management Process
Scheduling And Revenue Management Process
 
ChoiceModels_INFORMS_Nov2016
ChoiceModels_INFORMS_Nov2016ChoiceModels_INFORMS_Nov2016
ChoiceModels_INFORMS_Nov2016
 
A COMPARATIVE STUDY OF DIFFERENT INTEGRATED MULTIPLE CRITERIA DECISION MAKING...
A COMPARATIVE STUDY OF DIFFERENT INTEGRATED MULTIPLE CRITERIA DECISION MAKING...A COMPARATIVE STUDY OF DIFFERENT INTEGRATED MULTIPLE CRITERIA DECISION MAKING...
A COMPARATIVE STUDY OF DIFFERENT INTEGRATED MULTIPLE CRITERIA DECISION MAKING...
 
3G War: Who will be the winner?
3G War: Who will be the winner?3G War: Who will be the winner?
3G War: Who will be the winner?
 
Pros And Cons Of Outsourcing Bus Operations
Pros And Cons Of Outsourcing Bus OperationsPros And Cons Of Outsourcing Bus Operations
Pros And Cons Of Outsourcing Bus Operations
 
Industry 4.0: use cases for integrated supply chain
Industry 4.0: use cases for integrated supply chainIndustry 4.0: use cases for integrated supply chain
Industry 4.0: use cases for integrated supply chain
 
Ranking System for travel search (PoC)
Ranking System for travel search (PoC)Ranking System for travel search (PoC)
Ranking System for travel search (PoC)
 
Implementation and Validation of Supplier Selection Model for Planner Machine...
Implementation and Validation of Supplier Selection Model for Planner Machine...Implementation and Validation of Supplier Selection Model for Planner Machine...
Implementation and Validation of Supplier Selection Model for Planner Machine...
 
"Efficient and Effective Logistics by way of On Time Delivery (OTD)- A study ...
"Efficient and Effective Logistics by way of On Time Delivery (OTD)- A study ..."Efficient and Effective Logistics by way of On Time Delivery (OTD)- A study ...
"Efficient and Effective Logistics by way of On Time Delivery (OTD)- A study ...
 
Representing Cross-border Trade in Long-term Power System Planning Models wit...
Representing Cross-border Trade in Long-term Power System Planning Models wit...Representing Cross-border Trade in Long-term Power System Planning Models wit...
Representing Cross-border Trade in Long-term Power System Planning Models wit...
 
LPC Transport Presentation introduction to PLC
LPC Transport Presentation introduction to PLCLPC Transport Presentation introduction to PLC
LPC Transport Presentation introduction to PLC
 
Introduction to LPC - Facility Design And Re-Engineering
Introduction to LPC - Facility Design And Re-EngineeringIntroduction to LPC - Facility Design And Re-Engineering
Introduction to LPC - Facility Design And Re-Engineering
 
IRJET- Analysis and Prediction of Delay at Signalized Junctions in Bangalore
IRJET- Analysis and Prediction of Delay at Signalized Junctions in BangaloreIRJET- Analysis and Prediction of Delay at Signalized Junctions in Bangalore
IRJET- Analysis and Prediction of Delay at Signalized Junctions in Bangalore
 
How Vnomics built a "Digital Twin" for Commercial Trucking
How Vnomics built a "Digital Twin" for Commercial TruckingHow Vnomics built a "Digital Twin" for Commercial Trucking
How Vnomics built a "Digital Twin" for Commercial Trucking
 

Recently uploaded

Thermal Engineering Unit - I & II . ppt
Thermal Engineering  Unit - I & II . pptThermal Engineering  Unit - I & II . ppt
Thermal Engineering Unit - I & II . pptDineshKumar4165
 
S1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptx
S1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptxS1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptx
S1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptxSCMS School of Architecture
 
Standard vs Custom Battery Packs - Decoding the Power Play
Standard vs Custom Battery Packs - Decoding the Power PlayStandard vs Custom Battery Packs - Decoding the Power Play
Standard vs Custom Battery Packs - Decoding the Power PlayEpec Engineered Technologies
 
DC MACHINE-Motoring and generation, Armature circuit equation
DC MACHINE-Motoring and generation, Armature circuit equationDC MACHINE-Motoring and generation, Armature circuit equation
DC MACHINE-Motoring and generation, Armature circuit equationBhangaleSonal
 
data_management_and _data_science_cheat_sheet.pdf
data_management_and _data_science_cheat_sheet.pdfdata_management_and _data_science_cheat_sheet.pdf
data_management_and _data_science_cheat_sheet.pdfJiananWang21
 
Hostel management system project report..pdf
Hostel management system project report..pdfHostel management system project report..pdf
Hostel management system project report..pdfKamal Acharya
 
HOA1&2 - Module 3 - PREHISTORCI ARCHITECTURE OF KERALA.pptx
HOA1&2 - Module 3 - PREHISTORCI ARCHITECTURE OF KERALA.pptxHOA1&2 - Module 3 - PREHISTORCI ARCHITECTURE OF KERALA.pptx
HOA1&2 - Module 3 - PREHISTORCI ARCHITECTURE OF KERALA.pptxSCMS School of Architecture
 
A Study of Urban Area Plan for Pabna Municipality
A Study of Urban Area Plan for Pabna MunicipalityA Study of Urban Area Plan for Pabna Municipality
A Study of Urban Area Plan for Pabna MunicipalityMorshed Ahmed Rahath
 
Work-Permit-Receiver-in-Saudi-Aramco.pptx
Work-Permit-Receiver-in-Saudi-Aramco.pptxWork-Permit-Receiver-in-Saudi-Aramco.pptx
Work-Permit-Receiver-in-Saudi-Aramco.pptxJuliansyahHarahap1
 
GEAR TRAIN- BASIC CONCEPTS AND WORKING PRINCIPLE
GEAR TRAIN- BASIC CONCEPTS AND WORKING PRINCIPLEGEAR TRAIN- BASIC CONCEPTS AND WORKING PRINCIPLE
GEAR TRAIN- BASIC CONCEPTS AND WORKING PRINCIPLEselvakumar948
 
Moment Distribution Method For Btech Civil
Moment Distribution Method For Btech CivilMoment Distribution Method For Btech Civil
Moment Distribution Method For Btech CivilVinayVitekari
 
kiln thermal load.pptx kiln tgermal load
kiln thermal load.pptx kiln tgermal loadkiln thermal load.pptx kiln tgermal load
kiln thermal load.pptx kiln tgermal loadhamedmustafa094
 
Tamil Call Girls Bhayandar WhatsApp +91-9930687706, Best Service
Tamil Call Girls Bhayandar WhatsApp +91-9930687706, Best ServiceTamil Call Girls Bhayandar WhatsApp +91-9930687706, Best Service
Tamil Call Girls Bhayandar WhatsApp +91-9930687706, Best Servicemeghakumariji156
 
Online food ordering system project report.pdf
Online food ordering system project report.pdfOnline food ordering system project report.pdf
Online food ordering system project report.pdfKamal Acharya
 
Unleashing the Power of the SORA AI lastest leap
Unleashing the Power of the SORA AI lastest leapUnleashing the Power of the SORA AI lastest leap
Unleashing the Power of the SORA AI lastest leapRishantSharmaFr
 
DeepFakes presentation : brief idea of DeepFakes
DeepFakes presentation : brief idea of DeepFakesDeepFakes presentation : brief idea of DeepFakes
DeepFakes presentation : brief idea of DeepFakesMayuraD1
 
Thermal Engineering-R & A / C - unit - V
Thermal Engineering-R & A / C - unit - VThermal Engineering-R & A / C - unit - V
Thermal Engineering-R & A / C - unit - VDineshKumar4165
 
NO1 Top No1 Amil Baba In Azad Kashmir, Kashmir Black Magic Specialist Expert ...
NO1 Top No1 Amil Baba In Azad Kashmir, Kashmir Black Magic Specialist Expert ...NO1 Top No1 Amil Baba In Azad Kashmir, Kashmir Black Magic Specialist Expert ...
NO1 Top No1 Amil Baba In Azad Kashmir, Kashmir Black Magic Specialist Expert ...Amil baba
 
Verification of thevenin's theorem for BEEE Lab (1).pptx
Verification of thevenin's theorem for BEEE Lab (1).pptxVerification of thevenin's theorem for BEEE Lab (1).pptx
Verification of thevenin's theorem for BEEE Lab (1).pptxchumtiyababu
 

Recently uploaded (20)

Thermal Engineering Unit - I & II . ppt
Thermal Engineering  Unit - I & II . pptThermal Engineering  Unit - I & II . ppt
Thermal Engineering Unit - I & II . ppt
 
S1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptx
S1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptxS1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptx
S1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptx
 
Standard vs Custom Battery Packs - Decoding the Power Play
Standard vs Custom Battery Packs - Decoding the Power PlayStandard vs Custom Battery Packs - Decoding the Power Play
Standard vs Custom Battery Packs - Decoding the Power Play
 
DC MACHINE-Motoring and generation, Armature circuit equation
DC MACHINE-Motoring and generation, Armature circuit equationDC MACHINE-Motoring and generation, Armature circuit equation
DC MACHINE-Motoring and generation, Armature circuit equation
 
data_management_and _data_science_cheat_sheet.pdf
data_management_and _data_science_cheat_sheet.pdfdata_management_and _data_science_cheat_sheet.pdf
data_management_and _data_science_cheat_sheet.pdf
 
Hostel management system project report..pdf
Hostel management system project report..pdfHostel management system project report..pdf
Hostel management system project report..pdf
 
HOA1&2 - Module 3 - PREHISTORCI ARCHITECTURE OF KERALA.pptx
HOA1&2 - Module 3 - PREHISTORCI ARCHITECTURE OF KERALA.pptxHOA1&2 - Module 3 - PREHISTORCI ARCHITECTURE OF KERALA.pptx
HOA1&2 - Module 3 - PREHISTORCI ARCHITECTURE OF KERALA.pptx
 
A Study of Urban Area Plan for Pabna Municipality
A Study of Urban Area Plan for Pabna MunicipalityA Study of Urban Area Plan for Pabna Municipality
A Study of Urban Area Plan for Pabna Municipality
 
Cara Menggugurkan Sperma Yang Masuk Rahim Biyar Tidak Hamil
Cara Menggugurkan Sperma Yang Masuk Rahim Biyar Tidak HamilCara Menggugurkan Sperma Yang Masuk Rahim Biyar Tidak Hamil
Cara Menggugurkan Sperma Yang Masuk Rahim Biyar Tidak Hamil
 
Work-Permit-Receiver-in-Saudi-Aramco.pptx
Work-Permit-Receiver-in-Saudi-Aramco.pptxWork-Permit-Receiver-in-Saudi-Aramco.pptx
Work-Permit-Receiver-in-Saudi-Aramco.pptx
 
GEAR TRAIN- BASIC CONCEPTS AND WORKING PRINCIPLE
GEAR TRAIN- BASIC CONCEPTS AND WORKING PRINCIPLEGEAR TRAIN- BASIC CONCEPTS AND WORKING PRINCIPLE
GEAR TRAIN- BASIC CONCEPTS AND WORKING PRINCIPLE
 
Moment Distribution Method For Btech Civil
Moment Distribution Method For Btech CivilMoment Distribution Method For Btech Civil
Moment Distribution Method For Btech Civil
 
kiln thermal load.pptx kiln tgermal load
kiln thermal load.pptx kiln tgermal loadkiln thermal load.pptx kiln tgermal load
kiln thermal load.pptx kiln tgermal load
 
Tamil Call Girls Bhayandar WhatsApp +91-9930687706, Best Service
Tamil Call Girls Bhayandar WhatsApp +91-9930687706, Best ServiceTamil Call Girls Bhayandar WhatsApp +91-9930687706, Best Service
Tamil Call Girls Bhayandar WhatsApp +91-9930687706, Best Service
 
Online food ordering system project report.pdf
Online food ordering system project report.pdfOnline food ordering system project report.pdf
Online food ordering system project report.pdf
 
Unleashing the Power of the SORA AI lastest leap
Unleashing the Power of the SORA AI lastest leapUnleashing the Power of the SORA AI lastest leap
Unleashing the Power of the SORA AI lastest leap
 
DeepFakes presentation : brief idea of DeepFakes
DeepFakes presentation : brief idea of DeepFakesDeepFakes presentation : brief idea of DeepFakes
DeepFakes presentation : brief idea of DeepFakes
 
Thermal Engineering-R & A / C - unit - V
Thermal Engineering-R & A / C - unit - VThermal Engineering-R & A / C - unit - V
Thermal Engineering-R & A / C - unit - V
 
NO1 Top No1 Amil Baba In Azad Kashmir, Kashmir Black Magic Specialist Expert ...
NO1 Top No1 Amil Baba In Azad Kashmir, Kashmir Black Magic Specialist Expert ...NO1 Top No1 Amil Baba In Azad Kashmir, Kashmir Black Magic Specialist Expert ...
NO1 Top No1 Amil Baba In Azad Kashmir, Kashmir Black Magic Specialist Expert ...
 
Verification of thevenin's theorem for BEEE Lab (1).pptx
Verification of thevenin's theorem for BEEE Lab (1).pptxVerification of thevenin's theorem for BEEE Lab (1).pptx
Verification of thevenin's theorem for BEEE Lab (1).pptx
 

Architecting a real time optimization platform for driver positioning (informs 2019)

  • 1. Architecting a real-time optimization framework for Driver Positioning Hao Yi Ong w/ many others at Lyft INFORMS Annual Meeting | Seattle | October 22, 2019
  • 4. Dynamic pricing heatmap for drivers Prime Time (PT)
  • 5. Personal Power Zones (PPZ) product Pre-empt general market imbalance and help with events or demand spikes Algorithmically coordinate drivers when whole cities light up with rider demand De-conflicting drivers Early signaling
  • 6. Give a ride, get your bonus #1
  • 7. Drive into the purple zone, guarantee a bonus on your next ride. #2
  • 8. Drive into the pink zone, guarantee an even bigger bonus #3
  • 10. PT problem The PT model maps market conditions (supply and demand) to the general notion of value. // value; e.g., rides // match supply/demand // limit price fixed parameter: treatable supply untreatable supply price-adjusted demand reserved supply
  • 11. PT problem The PT model maps market conditions (supply and demand) to the general notion of value. MKT model demand by gh6 supply by gh6 value
  • 12. PPZ problem Supply and supply allocation are the PPZ decision variables (in addition to PT). The PPZ model repositions supply to maximize value. PPZ model MKT model forecasted demand by gh6 supply by gh6 value iteratively refine supply allocation “feedback”
  • 13. PPZ-induced value // move supply // allocation constraints decision variable: treatable supply PPZ problem Supply and supply allocation are the PPZ decision variables (in addition to PT). The PPZ model repositions supply to maximize value. (Omitted: various other business constraints.) decision variable: supply allocation initial treatable supply
  • 15. Assumptions ● Drivers don’t reposition themselves for decision look-ahead ● Driver compliance exponentially decays as travel time increases (fitted) ● When drivers comply, they move to destination by the next time step Methodology ● Historically accurate data importance-sampled over a quarter over top-10 cities ● “Fractional drivers” rounded down to the nearest integer to compute “actual value” Results (varies by city) ● 1—4% incremental rides ● 0.2—1% incremental bookings Numerical experiments
  • 16. Methodology ● Time-split experiments infeasible due to product experience ● User-split testing is the least bad option ● Impact estimates derived from causal inference methods Results (varies by city) ● ~0.3% incremental bookings ● Overall, drivers prefer PPZ over PT ● PPZ rolled out to virtually everywhere User-split experiments
  • 17. Work in-progress in collaboration with many teams at Lyft — join us!