SlideShare a Scribd company logo
WHAT WE LEARNED BUILDING A LOVED
DATA ENGINEERING TEAM
NitishMathew
Headof Global Data Engineering& Platforms
AGENDA
OUR JOURNEY SO FAR
OUR MISSION AHEAD
PRESENTATION | 2018 | CONFIDENTIAL 4
OUR HISTORY BEAPART OF OUR
AFTERPAY JOURNEY!
It’s short
“HERE ARE YOUR AWS CREDENTIALS
and 2 ENGINEERS
I NEED A DWH IN 3 MONTHS.”
WHAT WE SET OUT TO BUILD
Courtesy: SVDS
WHAT WE BUILT IN 12 MONTHS
WHAT DID WE DO DIFFERENT?
- Delivery every week.
- Kept things really simple.
- Gave users the tools they want.
- Gave as much as control as possible to users
- Sandbox Schemas – Huge Hit.
- E & L – T mostly by customers.
- Made decisions very fast.
- Tried things fast and moved on, ruthlessly, if they didn’t work.
- Didn’t take any shortcuts on security.
- Knowingly took on tech debt and cleared it as we went along.
“HOW DID WE DO?”
WHY?
“WHAT DID WE LEARN?”
1. DO THE RIGHT THINGS
14
1. Listento what your clients want.
2. Work hard on giving your team
clarity
3. Instill passion for Technology and
TCO responsibility
15
2. DO THEM FAST
1. Incorporate and empower small, self-
contained “youbuild it, you run it”
teams.
2. Infuse radical courage by providingair
cover to make mistakes,learn and
innovate.
3. Invest in DevOpsthinking,tooling and
processes.
16
3. ENSURE THEY ARE DONE
1. Reward Shipping stuff.
2. Reward solving actual customer
needs(not cool tech).
3. Rewardcollaborative success to
eliminate the “who gets the credit”
problem.
“ENSURE THAT THE
RIGHT THINGS ARE
DONE, FAST”
OUR MISSION AHEAD
19
WE ARE HIRING!

More Related Content

Similar to Building a Loved Data Engineering Team at Afterpay

APM PMC SIG conference 2021, Project controls: but not as we know it, Close o...
APM PMC SIG conference 2021, Project controls: but not as we know it, Close o...APM PMC SIG conference 2021, Project controls: but not as we know it, Close o...
APM PMC SIG conference 2021, Project controls: but not as we know it, Close o...
Association for Project Management
 
[AIIM17] It’s Harvest Time in the Information Garden - Dan Antion
[AIIM17] It’s Harvest Time in the Information Garden - Dan Antion[AIIM17] It’s Harvest Time in the Information Garden - Dan Antion
[AIIM17] It’s Harvest Time in the Information Garden - Dan Antion
AIIM International
 
Cloudera Cares + DataKind | 7 May 2015 | London, UK
Cloudera Cares + DataKind | 7 May 2015 | London, UKCloudera Cares + DataKind | 7 May 2015 | London, UK
Cloudera Cares + DataKind | 7 May 2015 | London, UK
Cloudera, Inc.
 
Infrastructure Migration
Infrastructure MigrationInfrastructure Migration
Infrastructure Migration
Matt Simmons
 
Gutenberg H4D Stanford 2019
Gutenberg H4D Stanford 2019Gutenberg H4D Stanford 2019
Gutenberg H4D Stanford 2019
Stanford University
 
BSides Seattle 2024 - Stopping Ethan Hunt From Taking Your Data.pptx
BSides Seattle 2024 - Stopping Ethan Hunt From Taking Your Data.pptxBSides Seattle 2024 - Stopping Ethan Hunt From Taking Your Data.pptx
BSides Seattle 2024 - Stopping Ethan Hunt From Taking Your Data.pptx
fenichawla
 
UX STRAT USA 2019: Richard Baker, GE Transportation
UX STRAT USA 2019: Richard Baker, GE TransportationUX STRAT USA 2019: Richard Baker, GE Transportation
UX STRAT USA 2019: Richard Baker, GE Transportation
UX STRAT
 
Data Stack Considerations: Build vs. Buy at Tout
Data Stack Considerations: Build vs. Buy at ToutData Stack Considerations: Build vs. Buy at Tout
Data Stack Considerations: Build vs. Buy at Tout
Looker
 
Synapse NanoApps
Synapse NanoAppsSynapse NanoApps
Synapse NanoApps
Synapse Information Ltd
 
3wks Introduction Pack
3wks Introduction Pack3wks Introduction Pack
3wks Introduction Pack
Alex Freeman
 
Business Agility - Pivot or Perish v1.5
Business Agility - Pivot or Perish v1.5Business Agility - Pivot or Perish v1.5
Business Agility - Pivot or Perish v1.5
Richard Cheng
 
A Journey Through Agile in the Government
A Journey Through Agile in the GovernmentA Journey Through Agile in the Government
A Journey Through Agile in the Government
Richard Cheng
 
The hothouse approach
The hothouse approachThe hothouse approach
The hothouse approach
Richard Powell
 
The Agile BA
The Agile BAThe Agile BA
The Agile BA
IIBA UK Chapter
 
Brightpod Overview
Brightpod OverviewBrightpod Overview
Brightpod Overview
Brightpod
 
Retrospective and different ways to run it
Retrospective and different ways to run itRetrospective and different ways to run it
Retrospective and different ways to run it
Liandra Bassiane
 
The Making of a Web Team (Notes)
The Making of a Web Team (Notes)The Making of a Web Team (Notes)
The Making of a Web Team (Notes)
Jennifer Riehle McFarland
 
2014.09.10 Are Agile Teams More Effective? Findings from the Teamwork Literat...
2014.09.10 Are Agile Teams More Effective? Findings from the Teamwork Literat...2014.09.10 Are Agile Teams More Effective? Findings from the Teamwork Literat...
2014.09.10 Are Agile Teams More Effective? Findings from the Teamwork Literat...
NUI Galway
 
Webinar on Big Data Challenges : Presented by Raj Kasturi
Webinar on Big Data Challenges : Presented by Raj KasturiWebinar on Big Data Challenges : Presented by Raj Kasturi
Webinar on Big Data Challenges : Presented by Raj Kasturi
oGuild .
 
TrackTreasure
TrackTreasureTrackTreasure
TrackTreasure
YogeeshRSYogeeshRS
 

Similar to Building a Loved Data Engineering Team at Afterpay (20)

APM PMC SIG conference 2021, Project controls: but not as we know it, Close o...
APM PMC SIG conference 2021, Project controls: but not as we know it, Close o...APM PMC SIG conference 2021, Project controls: but not as we know it, Close o...
APM PMC SIG conference 2021, Project controls: but not as we know it, Close o...
 
[AIIM17] It’s Harvest Time in the Information Garden - Dan Antion
[AIIM17] It’s Harvest Time in the Information Garden - Dan Antion[AIIM17] It’s Harvest Time in the Information Garden - Dan Antion
[AIIM17] It’s Harvest Time in the Information Garden - Dan Antion
 
Cloudera Cares + DataKind | 7 May 2015 | London, UK
Cloudera Cares + DataKind | 7 May 2015 | London, UKCloudera Cares + DataKind | 7 May 2015 | London, UK
Cloudera Cares + DataKind | 7 May 2015 | London, UK
 
Infrastructure Migration
Infrastructure MigrationInfrastructure Migration
Infrastructure Migration
 
Gutenberg H4D Stanford 2019
Gutenberg H4D Stanford 2019Gutenberg H4D Stanford 2019
Gutenberg H4D Stanford 2019
 
BSides Seattle 2024 - Stopping Ethan Hunt From Taking Your Data.pptx
BSides Seattle 2024 - Stopping Ethan Hunt From Taking Your Data.pptxBSides Seattle 2024 - Stopping Ethan Hunt From Taking Your Data.pptx
BSides Seattle 2024 - Stopping Ethan Hunt From Taking Your Data.pptx
 
UX STRAT USA 2019: Richard Baker, GE Transportation
UX STRAT USA 2019: Richard Baker, GE TransportationUX STRAT USA 2019: Richard Baker, GE Transportation
UX STRAT USA 2019: Richard Baker, GE Transportation
 
Data Stack Considerations: Build vs. Buy at Tout
Data Stack Considerations: Build vs. Buy at ToutData Stack Considerations: Build vs. Buy at Tout
Data Stack Considerations: Build vs. Buy at Tout
 
Synapse NanoApps
Synapse NanoAppsSynapse NanoApps
Synapse NanoApps
 
3wks Introduction Pack
3wks Introduction Pack3wks Introduction Pack
3wks Introduction Pack
 
Business Agility - Pivot or Perish v1.5
Business Agility - Pivot or Perish v1.5Business Agility - Pivot or Perish v1.5
Business Agility - Pivot or Perish v1.5
 
A Journey Through Agile in the Government
A Journey Through Agile in the GovernmentA Journey Through Agile in the Government
A Journey Through Agile in the Government
 
The hothouse approach
The hothouse approachThe hothouse approach
The hothouse approach
 
The Agile BA
The Agile BAThe Agile BA
The Agile BA
 
Brightpod Overview
Brightpod OverviewBrightpod Overview
Brightpod Overview
 
Retrospective and different ways to run it
Retrospective and different ways to run itRetrospective and different ways to run it
Retrospective and different ways to run it
 
The Making of a Web Team (Notes)
The Making of a Web Team (Notes)The Making of a Web Team (Notes)
The Making of a Web Team (Notes)
 
2014.09.10 Are Agile Teams More Effective? Findings from the Teamwork Literat...
2014.09.10 Are Agile Teams More Effective? Findings from the Teamwork Literat...2014.09.10 Are Agile Teams More Effective? Findings from the Teamwork Literat...
2014.09.10 Are Agile Teams More Effective? Findings from the Teamwork Literat...
 
Webinar on Big Data Challenges : Presented by Raj Kasturi
Webinar on Big Data Challenges : Presented by Raj KasturiWebinar on Big Data Challenges : Presented by Raj Kasturi
Webinar on Big Data Challenges : Presented by Raj Kasturi
 
TrackTreasure
TrackTreasureTrackTreasure
TrackTreasure
 

Recently uploaded

4th Modern Marketing Reckoner by MMA Global India & Group M: 60+ experts on W...
4th Modern Marketing Reckoner by MMA Global India & Group M: 60+ experts on W...4th Modern Marketing Reckoner by MMA Global India & Group M: 60+ experts on W...
4th Modern Marketing Reckoner by MMA Global India & Group M: 60+ experts on W...
Social Samosa
 
一比一原版(UO毕业证)渥太华大学毕业证如何办理
一比一原版(UO毕业证)渥太华大学毕业证如何办理一比一原版(UO毕业证)渥太华大学毕业证如何办理
一比一原版(UO毕业证)渥太华大学毕业证如何办理
bmucuha
 
Experts live - Improving user adoption with AI
Experts live - Improving user adoption with AIExperts live - Improving user adoption with AI
Experts live - Improving user adoption with AI
jitskeb
 
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
apvysm8
 
UofT毕业证如何办理
UofT毕业证如何办理UofT毕业证如何办理
UofT毕业证如何办理
exukyp
 
Palo Alto Cortex XDR presentation .......
Palo Alto Cortex XDR presentation .......Palo Alto Cortex XDR presentation .......
Palo Alto Cortex XDR presentation .......
Sachin Paul
 
原版一比一弗林德斯大学毕业证(Flinders毕业证书)如何办理
原版一比一弗林德斯大学毕业证(Flinders毕业证书)如何办理原版一比一弗林德斯大学毕业证(Flinders毕业证书)如何办理
原版一比一弗林德斯大学毕业证(Flinders毕业证书)如何办理
a9qfiubqu
 
一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理
一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理
一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理
nyfuhyz
 
A presentation that explain the Power BI Licensing
A presentation that explain the Power BI LicensingA presentation that explain the Power BI Licensing
A presentation that explain the Power BI Licensing
AlessioFois2
 
DSSML24_tspann_CodelessGenerativeAIPipelines
DSSML24_tspann_CodelessGenerativeAIPipelinesDSSML24_tspann_CodelessGenerativeAIPipelines
DSSML24_tspann_CodelessGenerativeAIPipelines
Timothy Spann
 
Intelligence supported media monitoring in veterinary medicine
Intelligence supported media monitoring in veterinary medicineIntelligence supported media monitoring in veterinary medicine
Intelligence supported media monitoring in veterinary medicine
AndrzejJarynowski
 
06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM
06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM
06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM
Timothy Spann
 
STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...
STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...
STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...
sameer shah
 
Build applications with generative AI on Google Cloud
Build applications with generative AI on Google CloudBuild applications with generative AI on Google Cloud
Build applications with generative AI on Google Cloud
Márton Kodok
 
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
nuttdpt
 
DATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docx
DATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docxDATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docx
DATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docx
SaffaIbrahim1
 
原版一比一利兹贝克特大学毕业证(LeedsBeckett毕业证书)如何办理
原版一比一利兹贝克特大学毕业证(LeedsBeckett毕业证书)如何办理原版一比一利兹贝克特大学毕业证(LeedsBeckett毕业证书)如何办理
原版一比一利兹贝克特大学毕业证(LeedsBeckett毕业证书)如何办理
wyddcwye1
 
一比一原版(CU毕业证)卡尔顿大学毕业证如何办理
一比一原版(CU毕业证)卡尔顿大学毕业证如何办理一比一原版(CU毕业证)卡尔顿大学毕业证如何办理
一比一原版(CU毕业证)卡尔顿大学毕业证如何办理
bmucuha
 
一比一原版(Unimelb毕业证书)墨尔本大学毕业证如何办理
一比一原版(Unimelb毕业证书)墨尔本大学毕业证如何办理一比一原版(Unimelb毕业证书)墨尔本大学毕业证如何办理
一比一原版(Unimelb毕业证书)墨尔本大学毕业证如何办理
xclpvhuk
 
一比一原版(harvard毕业证书)哈佛大学毕业证如何办理
一比一原版(harvard毕业证书)哈佛大学毕业证如何办理一比一原版(harvard毕业证书)哈佛大学毕业证如何办理
一比一原版(harvard毕业证书)哈佛大学毕业证如何办理
taqyea
 

Recently uploaded (20)

4th Modern Marketing Reckoner by MMA Global India & Group M: 60+ experts on W...
4th Modern Marketing Reckoner by MMA Global India & Group M: 60+ experts on W...4th Modern Marketing Reckoner by MMA Global India & Group M: 60+ experts on W...
4th Modern Marketing Reckoner by MMA Global India & Group M: 60+ experts on W...
 
一比一原版(UO毕业证)渥太华大学毕业证如何办理
一比一原版(UO毕业证)渥太华大学毕业证如何办理一比一原版(UO毕业证)渥太华大学毕业证如何办理
一比一原版(UO毕业证)渥太华大学毕业证如何办理
 
Experts live - Improving user adoption with AI
Experts live - Improving user adoption with AIExperts live - Improving user adoption with AI
Experts live - Improving user adoption with AI
 
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
 
UofT毕业证如何办理
UofT毕业证如何办理UofT毕业证如何办理
UofT毕业证如何办理
 
Palo Alto Cortex XDR presentation .......
Palo Alto Cortex XDR presentation .......Palo Alto Cortex XDR presentation .......
Palo Alto Cortex XDR presentation .......
 
原版一比一弗林德斯大学毕业证(Flinders毕业证书)如何办理
原版一比一弗林德斯大学毕业证(Flinders毕业证书)如何办理原版一比一弗林德斯大学毕业证(Flinders毕业证书)如何办理
原版一比一弗林德斯大学毕业证(Flinders毕业证书)如何办理
 
一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理
一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理
一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理
 
A presentation that explain the Power BI Licensing
A presentation that explain the Power BI LicensingA presentation that explain the Power BI Licensing
A presentation that explain the Power BI Licensing
 
DSSML24_tspann_CodelessGenerativeAIPipelines
DSSML24_tspann_CodelessGenerativeAIPipelinesDSSML24_tspann_CodelessGenerativeAIPipelines
DSSML24_tspann_CodelessGenerativeAIPipelines
 
Intelligence supported media monitoring in veterinary medicine
Intelligence supported media monitoring in veterinary medicineIntelligence supported media monitoring in veterinary medicine
Intelligence supported media monitoring in veterinary medicine
 
06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM
06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM
06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM
 
STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...
STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...
STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...
 
Build applications with generative AI on Google Cloud
Build applications with generative AI on Google CloudBuild applications with generative AI on Google Cloud
Build applications with generative AI on Google Cloud
 
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
 
DATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docx
DATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docxDATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docx
DATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docx
 
原版一比一利兹贝克特大学毕业证(LeedsBeckett毕业证书)如何办理
原版一比一利兹贝克特大学毕业证(LeedsBeckett毕业证书)如何办理原版一比一利兹贝克特大学毕业证(LeedsBeckett毕业证书)如何办理
原版一比一利兹贝克特大学毕业证(LeedsBeckett毕业证书)如何办理
 
一比一原版(CU毕业证)卡尔顿大学毕业证如何办理
一比一原版(CU毕业证)卡尔顿大学毕业证如何办理一比一原版(CU毕业证)卡尔顿大学毕业证如何办理
一比一原版(CU毕业证)卡尔顿大学毕业证如何办理
 
一比一原版(Unimelb毕业证书)墨尔本大学毕业证如何办理
一比一原版(Unimelb毕业证书)墨尔本大学毕业证如何办理一比一原版(Unimelb毕业证书)墨尔本大学毕业证如何办理
一比一原版(Unimelb毕业证书)墨尔本大学毕业证如何办理
 
一比一原版(harvard毕业证书)哈佛大学毕业证如何办理
一比一原版(harvard毕业证书)哈佛大学毕业证如何办理一比一原版(harvard毕业证书)哈佛大学毕业证如何办理
一比一原版(harvard毕业证书)哈佛大学毕业证如何办理
 

Building a Loved Data Engineering Team at Afterpay

  • 1. WHAT WE LEARNED BUILDING A LOVED DATA ENGINEERING TEAM NitishMathew Headof Global Data Engineering& Platforms
  • 2. AGENDA OUR JOURNEY SO FAR OUR MISSION AHEAD
  • 3.
  • 4. PRESENTATION | 2018 | CONFIDENTIAL 4 OUR HISTORY BEAPART OF OUR AFTERPAY JOURNEY! It’s short
  • 5. “HERE ARE YOUR AWS CREDENTIALS and 2 ENGINEERS I NEED A DWH IN 3 MONTHS.”
  • 6. WHAT WE SET OUT TO BUILD Courtesy: SVDS
  • 7. WHAT WE BUILT IN 12 MONTHS
  • 8. WHAT DID WE DO DIFFERENT? - Delivery every week. - Kept things really simple. - Gave users the tools they want. - Gave as much as control as possible to users - Sandbox Schemas – Huge Hit. - E & L – T mostly by customers. - Made decisions very fast. - Tried things fast and moved on, ruthlessly, if they didn’t work. - Didn’t take any shortcuts on security. - Knowingly took on tech debt and cleared it as we went along.
  • 9. “HOW DID WE DO?”
  • 10.
  • 11. WHY?
  • 12.
  • 13. “WHAT DID WE LEARN?”
  • 14. 1. DO THE RIGHT THINGS 14 1. Listento what your clients want. 2. Work hard on giving your team clarity 3. Instill passion for Technology and TCO responsibility
  • 15. 15 2. DO THEM FAST 1. Incorporate and empower small, self- contained “youbuild it, you run it” teams. 2. Infuse radical courage by providingair cover to make mistakes,learn and innovate. 3. Invest in DevOpsthinking,tooling and processes.
  • 16. 16 3. ENSURE THEY ARE DONE 1. Reward Shipping stuff. 2. Reward solving actual customer needs(not cool tech). 3. Rewardcollaborative success to eliminate the “who gets the credit” problem.
  • 17. “ENSURE THAT THE RIGHT THINGS ARE DONE, FAST”