Scaling Data Science at Airbnb

Work-Bench
Work-BenchComms Manager at Work-Bench
Scaling Data Science
Structure + tooling at Airbnb
Elena Grewal / April 9, 2016 / @elenatej
I started at Airbnb ~4 years ago
● Ph.D. in Education
● Team grown from 5 to 70
○ Fun fact for this conference:
■ 54% mostly use R, 29% mostly use Python
■ 80% very comfortable with R, 50% with Python
● Company grown from 200 to 2,500
Scaling Data Science at Airbnb
Scaling
● Team growth
● Interview process
● Why diversity
● Using data
○ Top of funnel changes
○ Conversion changes
● Scaling diversity data science
Rapid Data Team Growth
Diversity was important to us, but it wasn’t happening
Women :(
Team
Size
Interview process focused on practical data skills
‘Data challenges’ - Airbnb data + real question
Multi-stage
- Recruiter screen
- Take home data challenge
- Onsite challenge
- 1:1s with hiring manager, business partner, CV
We felt good about the data challenges and process
● Popular Quora
post
● Process starts
being used by
other
companies (!)
Why act now
● Harder to hire women as ratio declines
● Women could feel excluded on team
● Homogeneity -> narrower range of ideas
We believe in a world where
people belong, anywhere.
We started by looking at the data.
-
Scaling Data Science at Airbnb
● Manual audit of past apps
● EEOC data on inbound
applicants
FUNNEL
IMAGE
30% women
No drop off
Drop off
Drop off
We then thought about everything we
could possibly do to make a difference
And we did those things.
FUNNEL
IMAGE
Lightning talks
Support community
Diversity on multiple
dimensions
Encourage applicants
Blog Posts & Interviews
Highlight Women @
Airbnb
Inspire women in
data more broadly
Women in data dinners
Create
community of
senior women
in field
Circulates to
multiple
companies
(not just
Airbnb)
Scaling Data Science at Airbnb
● Create standard rubric
● Binary scoring system
● Removed names for a bit
● Trained graders
● Two graders for each test
to ensure consistency
● “Buddy” coffee chat &
support
● 50% women at presentation
● Clearer success criteria
Increase in Female Hires
High employee satisfaction scores + 100% women belong
Scaling Data Science at Airbnb
Our work is not complete.
Next steps
● Focus on multiple aspects of diversity
○ Apply similar process to thinking about racial diversity
○ Other dimensions as well
○ Continue to improve interview process for all - stay vigilant
● Continue to monitor team culture and belonging of current
employees
● Help the rest of the company and scale the efforts
Scaling our efforts
What about the rest of Airbnb?
● Full time data scientist + data engineer to work with our
“People and culture team”
● AWS account held separate from main Airbnb data
● Built tool to request and collect diversity data from referrals
and passively sourced candidates
● Dashboards with diversity data for every team
Thank you!
1 of 28

Recommended

Alan's deck by
Alan's deck Alan's deck
Alan's deck Alan_assurance
470.9K views42 slides
Pitch deck we are using to raise $6m for Veeqo from VCs by
Pitch deck we are using to raise $6m for Veeqo from VCsPitch deck we are using to raise $6m for Veeqo from VCs
Pitch deck we are using to raise $6m for Veeqo from VCsMatt Warren
1.6K views23 slides
TPAS2020 How to sell more rooms with Booking.com: Search Extension by
TPAS2020 How to sell more rooms with Booking.com: Search ExtensionTPAS2020 How to sell more rooms with Booking.com: Search Extension
TPAS2020 How to sell more rooms with Booking.com: Search ExtensionTravelpayouts
304 views29 slides
Harvard International Consulting Competition by
Harvard International Consulting Competition Harvard International Consulting Competition
Harvard International Consulting Competition Jordan van Wezel
1.4K views24 slides
Pitch Deck Teardown: Mint House's $35M Series B deck by
Pitch Deck Teardown: Mint House's $35M Series B deckPitch Deck Teardown: Mint House's $35M Series B deck
Pitch Deck Teardown: Mint House's $35M Series B deckHajeJanKamps
997 views12 slides
Yoroomie App Deck by
Yoroomie App DeckYoroomie App Deck
Yoroomie App DeckMichael Williams
34.5K views17 slides

More Related Content

What's hot

Pitch Deck Teardown: GoodBuy Gear's $5M Series A Extension deck by
Pitch Deck Teardown: GoodBuy Gear's $5M Series A Extension deckPitch Deck Teardown: GoodBuy Gear's $5M Series A Extension deck
Pitch Deck Teardown: GoodBuy Gear's $5M Series A Extension deckHajeJanKamps
1.3K views14 slides
Pitch Deck Teardown: DeckMatch's $1M Seed deck by
Pitch Deck Teardown: DeckMatch's $1M Seed deckPitch Deck Teardown: DeckMatch's $1M Seed deck
Pitch Deck Teardown: DeckMatch's $1M Seed deckHajeJanKamps
1.6K views14 slides
Facebook Pitch Deck by
Facebook Pitch DeckFacebook Pitch Deck
Facebook Pitch Deckstartuphome
3.7M views26 slides
Technology stack behind Airbnb by
Technology stack behind Airbnb Technology stack behind Airbnb
Technology stack behind Airbnb Rohan Khude
17.8K views65 slides
Introduction of Booking.com by
Introduction of Booking.comIntroduction of Booking.com
Introduction of Booking.comReflex Online B.V.
31.4K views25 slides
Pitch deck templates for seed capital by
Pitch deck templates for seed capital Pitch deck templates for seed capital
Pitch deck templates for seed capital Tech in Asia ID
43.9K views35 slides

What's hot(20)

Pitch Deck Teardown: GoodBuy Gear's $5M Series A Extension deck by HajeJanKamps
Pitch Deck Teardown: GoodBuy Gear's $5M Series A Extension deckPitch Deck Teardown: GoodBuy Gear's $5M Series A Extension deck
Pitch Deck Teardown: GoodBuy Gear's $5M Series A Extension deck
HajeJanKamps1.3K views
Pitch Deck Teardown: DeckMatch's $1M Seed deck by HajeJanKamps
Pitch Deck Teardown: DeckMatch's $1M Seed deckPitch Deck Teardown: DeckMatch's $1M Seed deck
Pitch Deck Teardown: DeckMatch's $1M Seed deck
HajeJanKamps1.6K views
Facebook Pitch Deck by startuphome
Facebook Pitch DeckFacebook Pitch Deck
Facebook Pitch Deck
startuphome3.7M views
Technology stack behind Airbnb by Rohan Khude
Technology stack behind Airbnb Technology stack behind Airbnb
Technology stack behind Airbnb
Rohan Khude17.8K views
Pitch deck templates for seed capital by Tech in Asia ID
Pitch deck templates for seed capital Pitch deck templates for seed capital
Pitch deck templates for seed capital
Tech in Asia ID43.9K views
Airbnb business model analysis by Gua Tabidze
Airbnb business model analysisAirbnb business model analysis
Airbnb business model analysis
Gua Tabidze22.7K views
The slide deck we used to raise half a million dollars by Buffer
The slide deck we used to raise half a million dollarsThe slide deck we used to raise half a million dollars
The slide deck we used to raise half a million dollars
Buffer 8.3M views
Pitch Deck Teardown: Gable's $12M Series A deck by HajeJanKamps
Pitch Deck Teardown: Gable's $12M Series A deckPitch Deck Teardown: Gable's $12M Series A deck
Pitch Deck Teardown: Gable's $12M Series A deck
HajeJanKamps3.3K views
The deck we used to raise $270k for our startup Castle by entercastle
The deck we used to raise $270k for our startup CastleThe deck we used to raise $270k for our startup Castle
The deck we used to raise $270k for our startup Castle
entercastle2.5M views
Sonder | Series D Deck by EmilyAnnHodges
Sonder | Series D DeckSonder | Series D Deck
Sonder | Series D Deck
EmilyAnnHodges139.3K views
Airbnb ppt - Strategic Management by PallaviMishra92
Airbnb ppt - Strategic ManagementAirbnb ppt - Strategic Management
Airbnb ppt - Strategic Management
PallaviMishra921.6K views
Bliss.ai Initial VC Raising Pitch Deck by AA BB
Bliss.ai Initial VC Raising Pitch Deck Bliss.ai Initial VC Raising Pitch Deck
Bliss.ai Initial VC Raising Pitch Deck
AA BB336.3K views
Airbnb presentation by Rui Wang
Airbnb presentationAirbnb presentation
Airbnb presentation
Rui Wang9.6K views
Front App 10Million Series-A Funding by Pranav Divakar
Front App 10Million Series-A FundingFront App 10Million Series-A Funding
Front App 10Million Series-A Funding
Pranav Divakar36K views
Guesty - NOAH19 Tel Aviv by NOAH Advisors
Guesty - NOAH19 Tel AvivGuesty - NOAH19 Tel Aviv
Guesty - NOAH19 Tel Aviv
NOAH Advisors376 views
Airbnb Original PowerPoint Pitch Presentation by Graphi Tales
Airbnb Original PowerPoint Pitch PresentationAirbnb Original PowerPoint Pitch Presentation
Airbnb Original PowerPoint Pitch Presentation
Graphi Tales1.5K views

Viewers also liked

Building Scalable Prediction Services in R by
Building Scalable Prediction Services in RBuilding Scalable Prediction Services in R
Building Scalable Prediction Services in RWork-Bench
10.4K views19 slides
Inside the R Consortium by
Inside the R ConsortiumInside the R Consortium
Inside the R ConsortiumWork-Bench
10.3K views25 slides
Scaling Analysis Responsibly by
Scaling Analysis ResponsiblyScaling Analysis Responsibly
Scaling Analysis ResponsiblyWork-Bench
10.5K views46 slides
R for Everything by
R for EverythingR for Everything
R for EverythingWork-Bench
10.5K views45 slides
High-Performance Python by
High-Performance PythonHigh-Performance Python
High-Performance PythonWork-Bench
11K views26 slides
Data Science Challenges in Personal Program Analysis by
Data Science Challenges in Personal Program AnalysisData Science Challenges in Personal Program Analysis
Data Science Challenges in Personal Program AnalysisWork-Bench
11.2K views19 slides

Viewers also liked(20)

Building Scalable Prediction Services in R by Work-Bench
Building Scalable Prediction Services in RBuilding Scalable Prediction Services in R
Building Scalable Prediction Services in R
Work-Bench10.4K views
Inside the R Consortium by Work-Bench
Inside the R ConsortiumInside the R Consortium
Inside the R Consortium
Work-Bench10.3K views
Scaling Analysis Responsibly by Work-Bench
Scaling Analysis ResponsiblyScaling Analysis Responsibly
Scaling Analysis Responsibly
Work-Bench10.5K views
R for Everything by Work-Bench
R for EverythingR for Everything
R for Everything
Work-Bench10.5K views
High-Performance Python by Work-Bench
High-Performance PythonHigh-Performance Python
High-Performance Python
Work-Bench11K views
Data Science Challenges in Personal Program Analysis by Work-Bench
Data Science Challenges in Personal Program AnalysisData Science Challenges in Personal Program Analysis
Data Science Challenges in Personal Program Analysis
Work-Bench11.2K views
R Packages for Time-Varying Networks and Extremal Dependence by Work-Bench
R Packages for Time-Varying Networks and Extremal DependenceR Packages for Time-Varying Networks and Extremal Dependence
R Packages for Time-Varying Networks and Extremal Dependence
Work-Bench10.6K views
Analyzing NYC Transit Data by Work-Bench
Analyzing NYC Transit DataAnalyzing NYC Transit Data
Analyzing NYC Transit Data
Work-Bench10.9K views
Broom: Converting Statistical Models to Tidy Data Frames by Work-Bench
Broom: Converting Statistical Models to Tidy Data FramesBroom: Converting Statistical Models to Tidy Data Frames
Broom: Converting Statistical Models to Tidy Data Frames
Work-Bench11.6K views
The Feels by Work-Bench
The FeelsThe Feels
The Feels
Work-Bench10.4K views
The Political Impact of Social Penumbras by Work-Bench
The Political Impact of Social PenumbrasThe Political Impact of Social Penumbras
The Political Impact of Social Penumbras
Work-Bench10.8K views
Reflection on the Data Science Profession in NYC by Work-Bench
Reflection on the Data Science Profession in NYCReflection on the Data Science Profession in NYC
Reflection on the Data Science Profession in NYC
Work-Bench10.7K views
One Algorithm to Rule Them All: How to Automate Statistical Computation by Work-Bench
One Algorithm to Rule Them All: How to Automate Statistical ComputationOne Algorithm to Rule Them All: How to Automate Statistical Computation
One Algorithm to Rule Them All: How to Automate Statistical Computation
Work-Bench10.6K views
I Don't Want to Be a Dummy! Encoding Predictors for Trees by Work-Bench
I Don't Want to Be a Dummy! Encoding Predictors for TreesI Don't Want to Be a Dummy! Encoding Predictors for Trees
I Don't Want to Be a Dummy! Encoding Predictors for Trees
Work-Bench11K views
Iterating over statistical models: NCAA tournament edition by Work-Bench
Iterating over statistical models: NCAA tournament editionIterating over statistical models: NCAA tournament edition
Iterating over statistical models: NCAA tournament edition
Work-Bench10.3K views
Julia + R for Data Science by Work-Bench
Julia + R for Data ScienceJulia + R for Data Science
Julia + R for Data Science
Work-Bench10.8K views
Improving Data Interoperability for Python and R by Work-Bench
Improving Data Interoperability for Python and RImproving Data Interoperability for Python and R
Improving Data Interoperability for Python and R
Work-Bench10.3K views
Using R at NYT Graphics by Work-Bench
Using R at NYT GraphicsUsing R at NYT Graphics
Using R at NYT Graphics
Work-Bench10.9K views
Dr. Datascience or: How I Learned to Stop Munging and Love Tests by Work-Bench
Dr. Datascience or: How I Learned to Stop Munging and Love TestsDr. Datascience or: How I Learned to Stop Munging and Love Tests
Dr. Datascience or: How I Learned to Stop Munging and Love Tests
Work-Bench10.5K views
What We Learned Building an R-Python Hybrid Predictive Analytics Pipeline by Work-Bench
What We Learned Building an R-Python Hybrid Predictive Analytics PipelineWhat We Learned Building an R-Python Hybrid Predictive Analytics Pipeline
What We Learned Building an R-Python Hybrid Predictive Analytics Pipeline
Work-Bench11K views

Similar to Scaling Data Science at Airbnb

DataEngConf SF16 - Beginning with Ourselves by
DataEngConf SF16 - Beginning with OurselvesDataEngConf SF16 - Beginning with Ourselves
DataEngConf SF16 - Beginning with OurselvesHakka Labs
562 views28 slides
Webinar: Converge 2015 Recap by
Webinar: Converge 2015 RecapWebinar: Converge 2015 Recap
Webinar: Converge 2015 RecapConverge Consulting
571 views99 slides
MomOps in DevOps by
MomOps in DevOpsMomOps in DevOps
MomOps in DevOpsMukta Aphale
3.2K views29 slides
DockerCon SF 2015: MomOps in DevOps w/ Mukta Aphale by
DockerCon SF 2015: MomOps in DevOps w/ Mukta AphaleDockerCon SF 2015: MomOps in DevOps w/ Mukta Aphale
DockerCon SF 2015: MomOps in DevOps w/ Mukta AphaleDocker, Inc.
2K views29 slides
Institutional team december 2012 by
Institutional team december 2012Institutional team december 2012
Institutional team december 2012tmeisenbach
398 views31 slides
The Future of Recruiting is Open Source by
The Future of Recruiting is Open SourceThe Future of Recruiting is Open Source
The Future of Recruiting is Open SourceRecruitDC
1.2K views51 slides

Similar to Scaling Data Science at Airbnb(20)

DataEngConf SF16 - Beginning with Ourselves by Hakka Labs
DataEngConf SF16 - Beginning with OurselvesDataEngConf SF16 - Beginning with Ourselves
DataEngConf SF16 - Beginning with Ourselves
Hakka Labs562 views
DockerCon SF 2015: MomOps in DevOps w/ Mukta Aphale by Docker, Inc.
DockerCon SF 2015: MomOps in DevOps w/ Mukta AphaleDockerCon SF 2015: MomOps in DevOps w/ Mukta Aphale
DockerCon SF 2015: MomOps in DevOps w/ Mukta Aphale
Docker, Inc.2K views
Institutional team december 2012 by tmeisenbach
Institutional team december 2012Institutional team december 2012
Institutional team december 2012
tmeisenbach398 views
The Future of Recruiting is Open Source by RecruitDC
The Future of Recruiting is Open SourceThe Future of Recruiting is Open Source
The Future of Recruiting is Open Source
RecruitDC1.2K views
Tribe of Five Presentation-Final by Yuan Chen
Tribe of Five Presentation-FinalTribe of Five Presentation-Final
Tribe of Five Presentation-Final
Yuan Chen80 views
I Am Data-driven and So Are You by Lever Inc.
I Am Data-driven and So Are YouI Am Data-driven and So Are You
I Am Data-driven and So Are You
Lever Inc.4.4K views
Educate 2017 (Learnosity Developer Conference) Opening Keynote by Learnosity
Educate 2017 (Learnosity Developer Conference) Opening KeynoteEducate 2017 (Learnosity Developer Conference) Opening Keynote
Educate 2017 (Learnosity Developer Conference) Opening Keynote
Learnosity387 views
Path Forward Fundraising Deck by PathFWD
Path Forward Fundraising DeckPath Forward Fundraising Deck
Path Forward Fundraising Deck
PathFWD466 views
DevPeers UX process Phase 1 by Shuyen Phoon
DevPeers UX process Phase 1DevPeers UX process Phase 1
DevPeers UX process Phase 1
Shuyen Phoon304 views
The Future of Data in Learning and Development by Namely
The Future of Data in Learning and DevelopmentThe Future of Data in Learning and Development
The Future of Data in Learning and Development
Namely239 views
Becoming a Salesforce / Data Driven Non-Profit by Sarah Parise
Becoming a Salesforce / Data Driven Non-ProfitBecoming a Salesforce / Data Driven Non-Profit
Becoming a Salesforce / Data Driven Non-Profit
Sarah Parise329 views
GovLoop Careers Presentation by Pat Fiorenza
GovLoop Careers PresentationGovLoop Careers Presentation
GovLoop Careers Presentation
Pat Fiorenza692 views
Troubleshooting Recruiting: How To Recruit More Women Into Your Workforce by Aggregage
Troubleshooting Recruiting: How To Recruit More Women Into Your WorkforceTroubleshooting Recruiting: How To Recruit More Women Into Your Workforce
Troubleshooting Recruiting: How To Recruit More Women Into Your Workforce
Aggregage207 views
A case for digital strategy at UALR by Jennifer Godwin
A case for digital strategy at UALRA case for digital strategy at UALR
A case for digital strategy at UALR
Jennifer Godwin364 views
Advanced techniques in crafting an effective social profile by Janet Johnson
Advanced techniques in crafting an effective social profile Advanced techniques in crafting an effective social profile
Advanced techniques in crafting an effective social profile
Janet Johnson411 views
Cloud Sherpas GDRoadshow Presentation by Glassdoor
Cloud Sherpas GDRoadshow PresentationCloud Sherpas GDRoadshow Presentation
Cloud Sherpas GDRoadshow Presentation
Glassdoor844 views

More from Work-Bench

2017 Enterprise Almanac by
2017 Enterprise Almanac2017 Enterprise Almanac
2017 Enterprise AlmanacWork-Bench
8.4K views148 slides
AI to Enable Next Generation of People Managers by
AI to Enable Next Generation of People ManagersAI to Enable Next Generation of People Managers
AI to Enable Next Generation of People ManagersWork-Bench
4.9K views23 slides
Startup Recruiting Workbook: Sourcing and Interview Process by
Startup Recruiting Workbook: Sourcing and Interview ProcessStartup Recruiting Workbook: Sourcing and Interview Process
Startup Recruiting Workbook: Sourcing and Interview ProcessWork-Bench
8.1K views13 slides
Cloud Native Infrastructure Management Solutions Compared by
Cloud Native Infrastructure Management Solutions ComparedCloud Native Infrastructure Management Solutions Compared
Cloud Native Infrastructure Management Solutions ComparedWork-Bench
639 views1 slide
Thinking Small About Big Data by
Thinking Small About Big DataThinking Small About Big Data
Thinking Small About Big DataWork-Bench
10.3K views27 slides
A Statistician Walks into a Tech Company: R at a Rapidly Scaling Healthcare S... by
A Statistician Walks into a Tech Company: R at a Rapidly Scaling Healthcare S...A Statistician Walks into a Tech Company: R at a Rapidly Scaling Healthcare S...
A Statistician Walks into a Tech Company: R at a Rapidly Scaling Healthcare S...Work-Bench
11.6K views21 slides

More from Work-Bench(10)

2017 Enterprise Almanac by Work-Bench
2017 Enterprise Almanac2017 Enterprise Almanac
2017 Enterprise Almanac
Work-Bench8.4K views
AI to Enable Next Generation of People Managers by Work-Bench
AI to Enable Next Generation of People ManagersAI to Enable Next Generation of People Managers
AI to Enable Next Generation of People Managers
Work-Bench4.9K views
Startup Recruiting Workbook: Sourcing and Interview Process by Work-Bench
Startup Recruiting Workbook: Sourcing and Interview ProcessStartup Recruiting Workbook: Sourcing and Interview Process
Startup Recruiting Workbook: Sourcing and Interview Process
Work-Bench8.1K views
Cloud Native Infrastructure Management Solutions Compared by Work-Bench
Cloud Native Infrastructure Management Solutions ComparedCloud Native Infrastructure Management Solutions Compared
Cloud Native Infrastructure Management Solutions Compared
Work-Bench639 views
Thinking Small About Big Data by Work-Bench
Thinking Small About Big DataThinking Small About Big Data
Thinking Small About Big Data
Work-Bench10.3K views
A Statistician Walks into a Tech Company: R at a Rapidly Scaling Healthcare S... by Work-Bench
A Statistician Walks into a Tech Company: R at a Rapidly Scaling Healthcare S...A Statistician Walks into a Tech Company: R at a Rapidly Scaling Healthcare S...
A Statistician Walks into a Tech Company: R at a Rapidly Scaling Healthcare S...
Work-Bench11.6K views
Building a Demand Generation Machine at MongoDB by Work-Bench
Building a Demand Generation Machine at MongoDBBuilding a Demand Generation Machine at MongoDB
Building a Demand Generation Machine at MongoDB
Work-Bench2K views
How to Market Your Startup to the Enterprise by Work-Bench
How to Market Your Startup to the EnterpriseHow to Market Your Startup to the Enterprise
How to Market Your Startup to the Enterprise
Work-Bench2.7K views
Marketing & Design for the Enterprise by Work-Bench
Marketing & Design for the EnterpriseMarketing & Design for the Enterprise
Marketing & Design for the Enterprise
Work-Bench2.1K views
Playing the Marketing Long Game by Work-Bench
Playing the Marketing Long GamePlaying the Marketing Long Game
Playing the Marketing Long Game
Work-Bench2.3K views

Recently uploaded

AIMS-EREA.pdf by
AIMS-EREA.pdfAIMS-EREA.pdf
AIMS-EREA.pdfSudarson Roy Pratihar
8 views18 slides
Product Research sample.pdf by
Product Research sample.pdfProduct Research sample.pdf
Product Research sample.pdfAllenSingson
35 views29 slides
Inawisdom Quick Sight by
Inawisdom Quick SightInawisdom Quick Sight
Inawisdom Quick SightPhilipBasford
8 views27 slides
Construction Accidents & Injuries by
Construction Accidents & InjuriesConstruction Accidents & Injuries
Construction Accidents & InjuriesBisnar Chase Personal Injury Attorneys
7 views5 slides
LIVE OAK MEMORIAL PARK.pptx by
LIVE OAK MEMORIAL PARK.pptxLIVE OAK MEMORIAL PARK.pptx
LIVE OAK MEMORIAL PARK.pptxms2332always
9 views6 slides
[DSC Europe 23] Irena Cerovic - AI in International Development.pdf by
[DSC Europe 23] Irena Cerovic - AI in International Development.pdf[DSC Europe 23] Irena Cerovic - AI in International Development.pdf
[DSC Europe 23] Irena Cerovic - AI in International Development.pdfDataScienceConferenc1
7 views9 slides

Recently uploaded(20)

Product Research sample.pdf by AllenSingson
Product Research sample.pdfProduct Research sample.pdf
Product Research sample.pdf
AllenSingson35 views
LIVE OAK MEMORIAL PARK.pptx by ms2332always
LIVE OAK MEMORIAL PARK.pptxLIVE OAK MEMORIAL PARK.pptx
LIVE OAK MEMORIAL PARK.pptx
ms2332always9 views
[DSC Europe 23] Irena Cerovic - AI in International Development.pdf by DataScienceConferenc1
[DSC Europe 23] Irena Cerovic - AI in International Development.pdf[DSC Europe 23] Irena Cerovic - AI in International Development.pdf
[DSC Europe 23] Irena Cerovic - AI in International Development.pdf
[DSC Europe 23] Branka Panic - Peace in the age of artificial intelligence.pptx by DataScienceConferenc1
[DSC Europe 23] Branka Panic - Peace in the age of artificial intelligence.pptx[DSC Europe 23] Branka Panic - Peace in the age of artificial intelligence.pptx
[DSC Europe 23] Branka Panic - Peace in the age of artificial intelligence.pptx
4_4_WP_4_06_ND_Model.pptx by d6fmc6kwd4
4_4_WP_4_06_ND_Model.pptx4_4_WP_4_06_ND_Model.pptx
4_4_WP_4_06_ND_Model.pptx
d6fmc6kwd47 views
K-Drama Recommendation Using Python by FridaPutriassa
K-Drama Recommendation Using PythonK-Drama Recommendation Using Python
K-Drama Recommendation Using Python
FridaPutriassa9 views
Customer Data Cleansing Project.pptx by Nat O
Customer Data Cleansing Project.pptxCustomer Data Cleansing Project.pptx
Customer Data Cleansing Project.pptx
Nat O7 views
Pydata Global 2023 - How can a learnt model unlearn something by SARADINDU SENGUPTA
Pydata Global 2023 - How can a learnt model unlearn somethingPydata Global 2023 - How can a learnt model unlearn something
Pydata Global 2023 - How can a learnt model unlearn something
[DSC Europe 23] Ilija Duni - How Foursquare Builds Meaningful Bridges Between... by DataScienceConferenc1
[DSC Europe 23] Ilija Duni - How Foursquare Builds Meaningful Bridges Between...[DSC Europe 23] Ilija Duni - How Foursquare Builds Meaningful Bridges Between...
[DSC Europe 23] Ilija Duni - How Foursquare Builds Meaningful Bridges Between...
Analytics Center of Excellence | Data CoE |Analytics CoE| WNS Triange by RNayak3
Analytics Center of Excellence | Data CoE |Analytics CoE| WNS TriangeAnalytics Center of Excellence | Data CoE |Analytics CoE| WNS Triange
Analytics Center of Excellence | Data CoE |Analytics CoE| WNS Triange
RNayak35 views
Games, Queries, and Argumentation Frameworks: Time for a Family Reunion by Bertram Ludäscher
Games, Queries, and Argumentation Frameworks: Time for a Family ReunionGames, Queries, and Argumentation Frameworks: Time for a Family Reunion
Games, Queries, and Argumentation Frameworks: Time for a Family Reunion

Scaling Data Science at Airbnb

  • 1. Scaling Data Science Structure + tooling at Airbnb Elena Grewal / April 9, 2016 / @elenatej
  • 2. I started at Airbnb ~4 years ago ● Ph.D. in Education ● Team grown from 5 to 70 ○ Fun fact for this conference: ■ 54% mostly use R, 29% mostly use Python ■ 80% very comfortable with R, 50% with Python ● Company grown from 200 to 2,500
  • 4. Scaling ● Team growth ● Interview process ● Why diversity ● Using data ○ Top of funnel changes ○ Conversion changes ● Scaling diversity data science
  • 6. Diversity was important to us, but it wasn’t happening Women :( Team Size
  • 7. Interview process focused on practical data skills ‘Data challenges’ - Airbnb data + real question Multi-stage - Recruiter screen - Take home data challenge - Onsite challenge - 1:1s with hiring manager, business partner, CV
  • 8. We felt good about the data challenges and process ● Popular Quora post ● Process starts being used by other companies (!)
  • 9. Why act now ● Harder to hire women as ratio declines ● Women could feel excluded on team ● Homogeneity -> narrower range of ideas
  • 10. We believe in a world where people belong, anywhere.
  • 11. We started by looking at the data. -
  • 13. ● Manual audit of past apps ● EEOC data on inbound applicants
  • 14. FUNNEL IMAGE 30% women No drop off Drop off Drop off
  • 15. We then thought about everything we could possibly do to make a difference And we did those things.
  • 17. Lightning talks Support community Diversity on multiple dimensions Encourage applicants
  • 18. Blog Posts & Interviews Highlight Women @ Airbnb Inspire women in data more broadly
  • 19. Women in data dinners Create community of senior women in field Circulates to multiple companies (not just Airbnb)
  • 21. ● Create standard rubric ● Binary scoring system ● Removed names for a bit ● Trained graders ● Two graders for each test to ensure consistency
  • 22. ● “Buddy” coffee chat & support ● 50% women at presentation ● Clearer success criteria
  • 23. Increase in Female Hires High employee satisfaction scores + 100% women belong
  • 25. Our work is not complete.
  • 26. Next steps ● Focus on multiple aspects of diversity ○ Apply similar process to thinking about racial diversity ○ Other dimensions as well ○ Continue to improve interview process for all - stay vigilant ● Continue to monitor team culture and belonging of current employees ● Help the rest of the company and scale the efforts
  • 27. Scaling our efforts What about the rest of Airbnb? ● Full time data scientist + data engineer to work with our “People and culture team” ● AWS account held separate from main Airbnb data ● Built tool to request and collect diversity data from referrals and passively sourced candidates ● Dashboards with diversity data for every team