SlideShare a Scribd company logo
1 of 19
Download to read offline
WHAT WE LEARNED BUILDING A LOVED
DATA ENGINEERING TEAM
NitishMathew
Headof Global Data Engineering& Platforms
AGENDA
OUR JOURNEY SO FAR
OUR MISSION AHEAD
PRESENTATION | 2018 | CONFIDENTIAL 4
OUR HISTORY BEAPART OF OUR
AFTERPAY JOURNEY!
It’s short
“HERE ARE YOUR AWS CREDENTIALS
and 2 ENGINEERS
I NEED A DWH IN 3 MONTHS.”
WHAT WE SET OUT TO BUILD
Courtesy: SVDS
WHAT WE BUILT IN 12 MONTHS
WHAT DID WE DO DIFFERENT?
- Delivery every week.
- Kept things really simple.
- Gave users the tools they want.
- Gave as much as control as possible to users
- Sandbox Schemas – Huge Hit.
- E & L – T mostly by customers.
- Made decisions very fast.
- Tried things fast and moved on, ruthlessly, if they didn’t work.
- Didn’t take any shortcuts on security.
- Knowingly took on tech debt and cleared it as we went along.
“HOW DID WE DO?”
WHY?
“WHAT DID WE LEARN?”
1. DO THE RIGHT THINGS
14
1. Listento what your clients want.
2. Work hard on giving your team
clarity
3. Instill passion for Technology and
TCO responsibility
15
2. DO THEM FAST
1. Incorporate and empower small, self-
contained “youbuild it, you run it”
teams.
2. Infuse radical courage by providingair
cover to make mistakes,learn and
innovate.
3. Invest in DevOpsthinking,tooling and
processes.
16
3. ENSURE THEY ARE DONE
1. Reward Shipping stuff.
2. Reward solving actual customer
needs(not cool tech).
3. Rewardcollaborative success to
eliminate the “who gets the credit”
problem.
“ENSURE THAT THE
RIGHT THINGS ARE
DONE, FAST”
OUR MISSION AHEAD
19
WE ARE HIRING!

More Related Content

Similar to Building a Loved Data Engineering Team

APM PMC SIG conference 2021, Project controls: but not as we know it, Close o...
APM PMC SIG conference 2021, Project controls: but not as we know it, Close o...APM PMC SIG conference 2021, Project controls: but not as we know it, Close o...
APM PMC SIG conference 2021, Project controls: but not as we know it, Close o...Association for Project Management
 
[AIIM17] It’s Harvest Time in the Information Garden - Dan Antion
[AIIM17] It’s Harvest Time in the Information Garden - Dan Antion[AIIM17] It’s Harvest Time in the Information Garden - Dan Antion
[AIIM17] It’s Harvest Time in the Information Garden - Dan AntionAIIM International
 
Cloudera Cares + DataKind | 7 May 2015 | London, UK
Cloudera Cares + DataKind | 7 May 2015 | London, UKCloudera Cares + DataKind | 7 May 2015 | London, UK
Cloudera Cares + DataKind | 7 May 2015 | London, UKCloudera, Inc.
 
Infrastructure Migration
Infrastructure MigrationInfrastructure Migration
Infrastructure MigrationMatt Simmons
 
UX STRAT USA 2019: Richard Baker, GE Transportation
UX STRAT USA 2019: Richard Baker, GE TransportationUX STRAT USA 2019: Richard Baker, GE Transportation
UX STRAT USA 2019: Richard Baker, GE TransportationUX STRAT
 
Data Stack Considerations: Build vs. Buy at Tout
Data Stack Considerations: Build vs. Buy at ToutData Stack Considerations: Build vs. Buy at Tout
Data Stack Considerations: Build vs. Buy at ToutLooker
 
3wks Introduction Pack
3wks Introduction Pack3wks Introduction Pack
3wks Introduction PackAlex Freeman
 
Business Agility - Pivot or Perish v1.5
Business Agility - Pivot or Perish v1.5Business Agility - Pivot or Perish v1.5
Business Agility - Pivot or Perish v1.5Richard Cheng
 
A Journey Through Agile in the Government
A Journey Through Agile in the GovernmentA Journey Through Agile in the Government
A Journey Through Agile in the GovernmentRichard Cheng
 
Brightpod Overview
Brightpod OverviewBrightpod Overview
Brightpod OverviewBrightpod
 
Retrospective and different ways to run it
Retrospective and different ways to run itRetrospective and different ways to run it
Retrospective and different ways to run itLiandra Bassiane
 
2014.09.10 Are Agile Teams More Effective? Findings from the Teamwork Literat...
2014.09.10 Are Agile Teams More Effective? Findings from the Teamwork Literat...2014.09.10 Are Agile Teams More Effective? Findings from the Teamwork Literat...
2014.09.10 Are Agile Teams More Effective? Findings from the Teamwork Literat...NUI Galway
 
Webinar on Big Data Challenges : Presented by Raj Kasturi
Webinar on Big Data Challenges : Presented by Raj KasturiWebinar on Big Data Challenges : Presented by Raj Kasturi
Webinar on Big Data Challenges : Presented by Raj KasturioGuild .
 
Publishing Strategic Technology for Association of Catholic Publishers
Publishing Strategic Technology for Association of Catholic PublishersPublishing Strategic Technology for Association of Catholic Publishers
Publishing Strategic Technology for Association of Catholic PublishersCraig Miller
 

Similar to Building a Loved Data Engineering Team (20)

APM PMC SIG conference 2021, Project controls: but not as we know it, Close o...
APM PMC SIG conference 2021, Project controls: but not as we know it, Close o...APM PMC SIG conference 2021, Project controls: but not as we know it, Close o...
APM PMC SIG conference 2021, Project controls: but not as we know it, Close o...
 
[AIIM17] It’s Harvest Time in the Information Garden - Dan Antion
[AIIM17] It’s Harvest Time in the Information Garden - Dan Antion[AIIM17] It’s Harvest Time in the Information Garden - Dan Antion
[AIIM17] It’s Harvest Time in the Information Garden - Dan Antion
 
Cloudera Cares + DataKind | 7 May 2015 | London, UK
Cloudera Cares + DataKind | 7 May 2015 | London, UKCloudera Cares + DataKind | 7 May 2015 | London, UK
Cloudera Cares + DataKind | 7 May 2015 | London, UK
 
Infrastructure Migration
Infrastructure MigrationInfrastructure Migration
Infrastructure Migration
 
Gutenberg H4D Stanford 2019
Gutenberg H4D Stanford 2019Gutenberg H4D Stanford 2019
Gutenberg H4D Stanford 2019
 
UX STRAT USA 2019: Richard Baker, GE Transportation
UX STRAT USA 2019: Richard Baker, GE TransportationUX STRAT USA 2019: Richard Baker, GE Transportation
UX STRAT USA 2019: Richard Baker, GE Transportation
 
Data Stack Considerations: Build vs. Buy at Tout
Data Stack Considerations: Build vs. Buy at ToutData Stack Considerations: Build vs. Buy at Tout
Data Stack Considerations: Build vs. Buy at Tout
 
Synapse NanoApps
Synapse NanoAppsSynapse NanoApps
Synapse NanoApps
 
3wks Introduction Pack
3wks Introduction Pack3wks Introduction Pack
3wks Introduction Pack
 
Business Agility - Pivot or Perish v1.5
Business Agility - Pivot or Perish v1.5Business Agility - Pivot or Perish v1.5
Business Agility - Pivot or Perish v1.5
 
A Journey Through Agile in the Government
A Journey Through Agile in the GovernmentA Journey Through Agile in the Government
A Journey Through Agile in the Government
 
The hothouse approach
The hothouse approachThe hothouse approach
The hothouse approach
 
The Agile BA
The Agile BAThe Agile BA
The Agile BA
 
Brightpod Overview
Brightpod OverviewBrightpod Overview
Brightpod Overview
 
Retrospective and different ways to run it
Retrospective and different ways to run itRetrospective and different ways to run it
Retrospective and different ways to run it
 
The Making of a Web Team (Notes)
The Making of a Web Team (Notes)The Making of a Web Team (Notes)
The Making of a Web Team (Notes)
 
2014.09.10 Are Agile Teams More Effective? Findings from the Teamwork Literat...
2014.09.10 Are Agile Teams More Effective? Findings from the Teamwork Literat...2014.09.10 Are Agile Teams More Effective? Findings from the Teamwork Literat...
2014.09.10 Are Agile Teams More Effective? Findings from the Teamwork Literat...
 
Webinar on Big Data Challenges : Presented by Raj Kasturi
Webinar on Big Data Challenges : Presented by Raj KasturiWebinar on Big Data Challenges : Presented by Raj Kasturi
Webinar on Big Data Challenges : Presented by Raj Kasturi
 
TrackTreasure
TrackTreasureTrackTreasure
TrackTreasure
 
Publishing Strategic Technology for Association of Catholic Publishers
Publishing Strategic Technology for Association of Catholic PublishersPublishing Strategic Technology for Association of Catholic Publishers
Publishing Strategic Technology for Association of Catholic Publishers
 

Recently uploaded

Smarteg dropshipping via API with DroFx.pptx
Smarteg dropshipping via API with DroFx.pptxSmarteg dropshipping via API with DroFx.pptx
Smarteg dropshipping via API with DroFx.pptxolyaivanovalion
 
B2 Creative Industry Response Evaluation.docx
B2 Creative Industry Response Evaluation.docxB2 Creative Industry Response Evaluation.docx
B2 Creative Industry Response Evaluation.docxStephen266013
 
Generative AI on Enterprise Cloud with NiFi and Milvus
Generative AI on Enterprise Cloud with NiFi and MilvusGenerative AI on Enterprise Cloud with NiFi and Milvus
Generative AI on Enterprise Cloud with NiFi and MilvusTimothy Spann
 
VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130
VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130
VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130Suhani Kapoor
 
代办国外大学文凭《原版美国UCLA文凭证书》加州大学洛杉矶分校毕业证制作成绩单修改
代办国外大学文凭《原版美国UCLA文凭证书》加州大学洛杉矶分校毕业证制作成绩单修改代办国外大学文凭《原版美国UCLA文凭证书》加州大学洛杉矶分校毕业证制作成绩单修改
代办国外大学文凭《原版美国UCLA文凭证书》加州大学洛杉矶分校毕业证制作成绩单修改atducpo
 
Brighton SEO | April 2024 | Data Storytelling
Brighton SEO | April 2024 | Data StorytellingBrighton SEO | April 2024 | Data Storytelling
Brighton SEO | April 2024 | Data StorytellingNeil Barnes
 
Invezz.com - Grow your wealth with trading signals
Invezz.com - Grow your wealth with trading signalsInvezz.com - Grow your wealth with trading signals
Invezz.com - Grow your wealth with trading signalsInvezz1
 
BigBuy dropshipping via API with DroFx.pptx
BigBuy dropshipping via API with DroFx.pptxBigBuy dropshipping via API with DroFx.pptx
BigBuy dropshipping via API with DroFx.pptxolyaivanovalion
 
FESE Capital Markets Fact Sheet 2024 Q1.pdf
FESE Capital Markets Fact Sheet 2024 Q1.pdfFESE Capital Markets Fact Sheet 2024 Q1.pdf
FESE Capital Markets Fact Sheet 2024 Q1.pdfMarinCaroMartnezBerg
 
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...Delhi Call girls
 
Edukaciniai dropshipping via API with DroFx
Edukaciniai dropshipping via API with DroFxEdukaciniai dropshipping via API with DroFx
Edukaciniai dropshipping via API with DroFxolyaivanovalion
 
Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip CallDelhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Callshivangimorya083
 
Week-01-2.ppt BBB human Computer interaction
Week-01-2.ppt BBB human Computer interactionWeek-01-2.ppt BBB human Computer interaction
Week-01-2.ppt BBB human Computer interactionfulawalesam
 
Industrialised data - the key to AI success.pdf
Industrialised data - the key to AI success.pdfIndustrialised data - the key to AI success.pdf
Industrialised data - the key to AI success.pdfLars Albertsson
 
VIP Call Girls in Amravati Aarohi 8250192130 Independent Escort Service Amravati
VIP Call Girls in Amravati Aarohi 8250192130 Independent Escort Service AmravatiVIP Call Girls in Amravati Aarohi 8250192130 Independent Escort Service Amravati
VIP Call Girls in Amravati Aarohi 8250192130 Independent Escort Service AmravatiSuhani Kapoor
 
Unveiling Insights: The Role of a Data Analyst
Unveiling Insights: The Role of a Data AnalystUnveiling Insights: The Role of a Data Analyst
Unveiling Insights: The Role of a Data AnalystSamantha Rae Coolbeth
 
Call me @ 9892124323 Cheap Rate Call Girls in Vashi with Real Photo 100% Secure
Call me @ 9892124323  Cheap Rate Call Girls in Vashi with Real Photo 100% SecureCall me @ 9892124323  Cheap Rate Call Girls in Vashi with Real Photo 100% Secure
Call me @ 9892124323 Cheap Rate Call Girls in Vashi with Real Photo 100% SecurePooja Nehwal
 
Ukraine War presentation: KNOW THE BASICS
Ukraine War presentation: KNOW THE BASICSUkraine War presentation: KNOW THE BASICS
Ukraine War presentation: KNOW THE BASICSAishani27
 

Recently uploaded (20)

Smarteg dropshipping via API with DroFx.pptx
Smarteg dropshipping via API with DroFx.pptxSmarteg dropshipping via API with DroFx.pptx
Smarteg dropshipping via API with DroFx.pptx
 
B2 Creative Industry Response Evaluation.docx
B2 Creative Industry Response Evaluation.docxB2 Creative Industry Response Evaluation.docx
B2 Creative Industry Response Evaluation.docx
 
Generative AI on Enterprise Cloud with NiFi and Milvus
Generative AI on Enterprise Cloud with NiFi and MilvusGenerative AI on Enterprise Cloud with NiFi and Milvus
Generative AI on Enterprise Cloud with NiFi and Milvus
 
VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130
VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130
VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130
 
代办国外大学文凭《原版美国UCLA文凭证书》加州大学洛杉矶分校毕业证制作成绩单修改
代办国外大学文凭《原版美国UCLA文凭证书》加州大学洛杉矶分校毕业证制作成绩单修改代办国外大学文凭《原版美国UCLA文凭证书》加州大学洛杉矶分校毕业证制作成绩单修改
代办国外大学文凭《原版美国UCLA文凭证书》加州大学洛杉矶分校毕业证制作成绩单修改
 
Brighton SEO | April 2024 | Data Storytelling
Brighton SEO | April 2024 | Data StorytellingBrighton SEO | April 2024 | Data Storytelling
Brighton SEO | April 2024 | Data Storytelling
 
Invezz.com - Grow your wealth with trading signals
Invezz.com - Grow your wealth with trading signalsInvezz.com - Grow your wealth with trading signals
Invezz.com - Grow your wealth with trading signals
 
VIP Call Girls Service Charbagh { Lucknow Call Girls Service 9548273370 } Boo...
VIP Call Girls Service Charbagh { Lucknow Call Girls Service 9548273370 } Boo...VIP Call Girls Service Charbagh { Lucknow Call Girls Service 9548273370 } Boo...
VIP Call Girls Service Charbagh { Lucknow Call Girls Service 9548273370 } Boo...
 
BigBuy dropshipping via API with DroFx.pptx
BigBuy dropshipping via API with DroFx.pptxBigBuy dropshipping via API with DroFx.pptx
BigBuy dropshipping via API with DroFx.pptx
 
FESE Capital Markets Fact Sheet 2024 Q1.pdf
FESE Capital Markets Fact Sheet 2024 Q1.pdfFESE Capital Markets Fact Sheet 2024 Q1.pdf
FESE Capital Markets Fact Sheet 2024 Q1.pdf
 
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...
 
Edukaciniai dropshipping via API with DroFx
Edukaciniai dropshipping via API with DroFxEdukaciniai dropshipping via API with DroFx
Edukaciniai dropshipping via API with DroFx
 
Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip CallDelhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
 
Week-01-2.ppt BBB human Computer interaction
Week-01-2.ppt BBB human Computer interactionWeek-01-2.ppt BBB human Computer interaction
Week-01-2.ppt BBB human Computer interaction
 
Industrialised data - the key to AI success.pdf
Industrialised data - the key to AI success.pdfIndustrialised data - the key to AI success.pdf
Industrialised data - the key to AI success.pdf
 
VIP Call Girls in Amravati Aarohi 8250192130 Independent Escort Service Amravati
VIP Call Girls in Amravati Aarohi 8250192130 Independent Escort Service AmravatiVIP Call Girls in Amravati Aarohi 8250192130 Independent Escort Service Amravati
VIP Call Girls in Amravati Aarohi 8250192130 Independent Escort Service Amravati
 
꧁❤ Aerocity Call Girls Service Aerocity Delhi ❤꧂ 9999965857 ☎️ Hard And Sexy ...
꧁❤ Aerocity Call Girls Service Aerocity Delhi ❤꧂ 9999965857 ☎️ Hard And Sexy ...꧁❤ Aerocity Call Girls Service Aerocity Delhi ❤꧂ 9999965857 ☎️ Hard And Sexy ...
꧁❤ Aerocity Call Girls Service Aerocity Delhi ❤꧂ 9999965857 ☎️ Hard And Sexy ...
 
Unveiling Insights: The Role of a Data Analyst
Unveiling Insights: The Role of a Data AnalystUnveiling Insights: The Role of a Data Analyst
Unveiling Insights: The Role of a Data Analyst
 
Call me @ 9892124323 Cheap Rate Call Girls in Vashi with Real Photo 100% Secure
Call me @ 9892124323  Cheap Rate Call Girls in Vashi with Real Photo 100% SecureCall me @ 9892124323  Cheap Rate Call Girls in Vashi with Real Photo 100% Secure
Call me @ 9892124323 Cheap Rate Call Girls in Vashi with Real Photo 100% Secure
 
Ukraine War presentation: KNOW THE BASICS
Ukraine War presentation: KNOW THE BASICSUkraine War presentation: KNOW THE BASICS
Ukraine War presentation: KNOW THE BASICS
 

Building a Loved Data Engineering Team

  • 1. WHAT WE LEARNED BUILDING A LOVED DATA ENGINEERING TEAM NitishMathew Headof Global Data Engineering& Platforms
  • 2. AGENDA OUR JOURNEY SO FAR OUR MISSION AHEAD
  • 3.
  • 4. PRESENTATION | 2018 | CONFIDENTIAL 4 OUR HISTORY BEAPART OF OUR AFTERPAY JOURNEY! It’s short
  • 5. “HERE ARE YOUR AWS CREDENTIALS and 2 ENGINEERS I NEED A DWH IN 3 MONTHS.”
  • 6. WHAT WE SET OUT TO BUILD Courtesy: SVDS
  • 7. WHAT WE BUILT IN 12 MONTHS
  • 8. WHAT DID WE DO DIFFERENT? - Delivery every week. - Kept things really simple. - Gave users the tools they want. - Gave as much as control as possible to users - Sandbox Schemas – Huge Hit. - E & L – T mostly by customers. - Made decisions very fast. - Tried things fast and moved on, ruthlessly, if they didn’t work. - Didn’t take any shortcuts on security. - Knowingly took on tech debt and cleared it as we went along.
  • 9. “HOW DID WE DO?”
  • 10.
  • 11. WHY?
  • 12.
  • 13. “WHAT DID WE LEARN?”
  • 14. 1. DO THE RIGHT THINGS 14 1. Listento what your clients want. 2. Work hard on giving your team clarity 3. Instill passion for Technology and TCO responsibility
  • 15. 15 2. DO THEM FAST 1. Incorporate and empower small, self- contained “youbuild it, you run it” teams. 2. Infuse radical courage by providingair cover to make mistakes,learn and innovate. 3. Invest in DevOpsthinking,tooling and processes.
  • 16. 16 3. ENSURE THEY ARE DONE 1. Reward Shipping stuff. 2. Reward solving actual customer needs(not cool tech). 3. Rewardcollaborative success to eliminate the “who gets the credit” problem.
  • 17. “ENSURE THAT THE RIGHT THINGS ARE DONE, FAST”