SlideShare a Scribd company logo
1 of 22
Download to read offline
Foundations of Data
Teams
1 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
Houses
Disclosure
Data Teams
Implications
Foundations of Data Teams
2 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
Sometimes its implicit about what
we want versus how we get it.
We focus the on
exterior and
cosmetic.
Houses = Value Created
Construction = Data Teams
Credit: Rum BucolicApe
3 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
Our Focus Is On The Facade
We're so focused on models we're missing the rest of the structure.
Credit: BisonArchives
4 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
Do Data Teams Need Foundations?
Houses don't need a foundation if you don’t need it to stand for long.
Credit: Yurt-Jean-PierreDalbéra
5 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
An Easy Renovation?
Adding advanced analytics isn't a simple renovation.
Credit: AapoHaapanen
6 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
Houses
Disclosure
Data Teams
Implications
Foundations of Data Teams
7 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
Sellers may not disclose
everything
When selling a
house the seller
has to disclose
any problems
Non-disclosure has legal and
monetary implications
8 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
Whose Job?
Whose job is it to disclose
issues your team? Vendors,
Management, Individual
Contributors, Books?
9 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
Is It Easy?
Some vendors are
misleading with their
disclosures. They say it's
easy and you don'tneed a
solid foundation.
10 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
Houses
Disclosure
Data Teams
Implications
Foundations of Data Teams
11 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
Data Teams
Each team is equally important and necessary to create value
Data Science
Data Engineering Operations
12 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
Without Data Science
There's a foundation, but no value is created because no one lives there.
Credit: kerttu
13 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
Without Data Engineers
House is there but crumbles due to lack of sound engineering
Credit: SamanthaForsberg
14 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
Without Operations
The business won't use neglected, messy, and unkempt data products.
Credit: LarryNeuberger
15 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
Houses
Disclosure
Data Teams
Implication
s
Foundations of Data Teams
16 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
Put the Effort Into a SolidFoundation
It's much easier to initially build on top of a solid foundation
Credit: HydrogenIodide
17 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
...Or Else
It will cost far more to go back and fix it later
Credit: HydrogenIodide
18 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
Velocity Increases With Solid Foundations
Continuous improvements built on solid foundation versus failing and
constantly dropping.
Velocity
Time Lacking Foundation
Solid Foundation
19 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
An Ounce of Prevention Is Worth a Ton of Cure
It's always possible to fix a foundation but will be costly, don't wait.
Credit: ICMAPhotos
20 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
Data Teams Book
https://www.datateams.io
21 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
Thank You
bigdatainstitute.io
22 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80

More Related Content

What's hot

Lets Talk Google BigQuery
Lets Talk Google BigQueryLets Talk Google BigQuery
Lets Talk Google BigQueryMatillion
 
Predictive Analytics: Why (I)IoT Is Different
Predictive Analytics: Why (I)IoT Is DifferentPredictive Analytics: Why (I)IoT Is Different
Predictive Analytics: Why (I)IoT Is DifferentAltoros
 
Crypto Finance meets investors
Crypto Finance meets investorsCrypto Finance meets investors
Crypto Finance meets investorsRichard Zbinden
 
ELT vs. ETL - How they’re different and why it matters
ELT vs. ETL - How they’re different and why it mattersELT vs. ETL - How they’re different and why it matters
ELT vs. ETL - How they’re different and why it mattersMatillion
 
FIWARE Global Summit - International Data Spaces - A New Idea for Data Sharing
FIWARE Global Summit - International Data Spaces - A New Idea for Data SharingFIWARE Global Summit - International Data Spaces - A New Idea for Data Sharing
FIWARE Global Summit - International Data Spaces - A New Idea for Data SharingFIWARE
 
Gianluigi Vigano, Senior Architect and Fouad Teban, Regional Presales Manager...
Gianluigi Vigano, Senior Architect and Fouad Teban, Regional Presales Manager...Gianluigi Vigano, Senior Architect and Fouad Teban, Regional Presales Manager...
Gianluigi Vigano, Senior Architect and Fouad Teban, Regional Presales Manager...Dataconomy Media
 
Knowledge and Scalability Through Graph Composition
Knowledge and Scalability Through Graph CompositionKnowledge and Scalability Through Graph Composition
Knowledge and Scalability Through Graph CompositionNeo4j
 
GraphTour 2020 - Practical Applications of Neo4j 4.0
GraphTour 2020 - Practical Applications of Neo4j 4.0GraphTour 2020 - Practical Applications of Neo4j 4.0
GraphTour 2020 - Practical Applications of Neo4j 4.0Neo4j
 
SecureCloud Final results
SecureCloud Final resultsSecureCloud Final results
SecureCloud Final resultsATMOSPHERE .
 
Data Warehouse Modernization Webinar Series- Critical Trends, Implementation ...
Data Warehouse Modernization Webinar Series- Critical Trends, Implementation ...Data Warehouse Modernization Webinar Series- Critical Trends, Implementation ...
Data Warehouse Modernization Webinar Series- Critical Trends, Implementation ...Impetus Technologies
 
WEBINAR: Emerging Technologies in Supply Chain
WEBINAR: Emerging Technologies in Supply ChainWEBINAR: Emerging Technologies in Supply Chain
WEBINAR: Emerging Technologies in Supply ChainFlytBase
 
Gdpr CCPA Why Benchmarks of Billions of rows are as meaningful as compliance ...
Gdpr CCPA Why Benchmarks of Billions of rows are as meaningful as compliance ...Gdpr CCPA Why Benchmarks of Billions of rows are as meaningful as compliance ...
Gdpr CCPA Why Benchmarks of Billions of rows are as meaningful as compliance ...Steven Meister
 
Improving Response Times at Optum with Elastic APM
Improving Response Times at Optum with Elastic APMImproving Response Times at Optum with Elastic APM
Improving Response Times at Optum with Elastic APMElasticsearch
 
Operational Intelligence-as-a-Service to fuel SWIFT’s Digital Transformation
Operational Intelligence-as-a-Service to fuel SWIFT’s Digital TransformationOperational Intelligence-as-a-Service to fuel SWIFT’s Digital Transformation
Operational Intelligence-as-a-Service to fuel SWIFT’s Digital TransformationElasticsearch
 
Infochimps CxO Seminar @ PARC
Infochimps CxO Seminar @ PARCInfochimps CxO Seminar @ PARC
Infochimps CxO Seminar @ PARCJim Kaskade
 
II-SDV 2017: How Visualisation of Open Patent Data can help with Strategic De...
II-SDV 2017: How Visualisation of Open Patent Data can help with Strategic De...II-SDV 2017: How Visualisation of Open Patent Data can help with Strategic De...
II-SDV 2017: How Visualisation of Open Patent Data can help with Strategic De...Dr. Haxel Consult
 
CDE Catapult by Maurizio Pilu - Cambridge Wireless Event - 28 Nov 2013
CDE Catapult by Maurizio Pilu - Cambridge Wireless Event - 28 Nov 2013CDE Catapult by Maurizio Pilu - Cambridge Wireless Event - 28 Nov 2013
CDE Catapult by Maurizio Pilu - Cambridge Wireless Event - 28 Nov 2013Maurizio Pilu
 
Mapping the road to better data storage strategies
Mapping the road to better data storage strategiesMapping the road to better data storage strategies
Mapping the road to better data storage strategiesClearSky Data
 

What's hot (20)

Lets Talk Google BigQuery
Lets Talk Google BigQueryLets Talk Google BigQuery
Lets Talk Google BigQuery
 
Predictive Analytics: Why (I)IoT Is Different
Predictive Analytics: Why (I)IoT Is DifferentPredictive Analytics: Why (I)IoT Is Different
Predictive Analytics: Why (I)IoT Is Different
 
Crypto Finance meets investors
Crypto Finance meets investorsCrypto Finance meets investors
Crypto Finance meets investors
 
ELT vs. ETL - How they’re different and why it matters
ELT vs. ETL - How they’re different and why it mattersELT vs. ETL - How they’re different and why it matters
ELT vs. ETL - How they’re different and why it matters
 
FIWARE Global Summit - International Data Spaces - A New Idea for Data Sharing
FIWARE Global Summit - International Data Spaces - A New Idea for Data SharingFIWARE Global Summit - International Data Spaces - A New Idea for Data Sharing
FIWARE Global Summit - International Data Spaces - A New Idea for Data Sharing
 
Gianluigi Vigano, Senior Architect and Fouad Teban, Regional Presales Manager...
Gianluigi Vigano, Senior Architect and Fouad Teban, Regional Presales Manager...Gianluigi Vigano, Senior Architect and Fouad Teban, Regional Presales Manager...
Gianluigi Vigano, Senior Architect and Fouad Teban, Regional Presales Manager...
 
AI-SDV 2021 - Deep SEARCH 9
AI-SDV 2021 - Deep SEARCH 9AI-SDV 2021 - Deep SEARCH 9
AI-SDV 2021 - Deep SEARCH 9
 
catfx Datasheet_v1
catfx Datasheet_v1catfx Datasheet_v1
catfx Datasheet_v1
 
Knowledge and Scalability Through Graph Composition
Knowledge and Scalability Through Graph CompositionKnowledge and Scalability Through Graph Composition
Knowledge and Scalability Through Graph Composition
 
GraphTour 2020 - Practical Applications of Neo4j 4.0
GraphTour 2020 - Practical Applications of Neo4j 4.0GraphTour 2020 - Practical Applications of Neo4j 4.0
GraphTour 2020 - Practical Applications of Neo4j 4.0
 
SecureCloud Final results
SecureCloud Final resultsSecureCloud Final results
SecureCloud Final results
 
Data Warehouse Modernization Webinar Series- Critical Trends, Implementation ...
Data Warehouse Modernization Webinar Series- Critical Trends, Implementation ...Data Warehouse Modernization Webinar Series- Critical Trends, Implementation ...
Data Warehouse Modernization Webinar Series- Critical Trends, Implementation ...
 
WEBINAR: Emerging Technologies in Supply Chain
WEBINAR: Emerging Technologies in Supply ChainWEBINAR: Emerging Technologies in Supply Chain
WEBINAR: Emerging Technologies in Supply Chain
 
Gdpr CCPA Why Benchmarks of Billions of rows are as meaningful as compliance ...
Gdpr CCPA Why Benchmarks of Billions of rows are as meaningful as compliance ...Gdpr CCPA Why Benchmarks of Billions of rows are as meaningful as compliance ...
Gdpr CCPA Why Benchmarks of Billions of rows are as meaningful as compliance ...
 
Improving Response Times at Optum with Elastic APM
Improving Response Times at Optum with Elastic APMImproving Response Times at Optum with Elastic APM
Improving Response Times at Optum with Elastic APM
 
Operational Intelligence-as-a-Service to fuel SWIFT’s Digital Transformation
Operational Intelligence-as-a-Service to fuel SWIFT’s Digital TransformationOperational Intelligence-as-a-Service to fuel SWIFT’s Digital Transformation
Operational Intelligence-as-a-Service to fuel SWIFT’s Digital Transformation
 
Infochimps CxO Seminar @ PARC
Infochimps CxO Seminar @ PARCInfochimps CxO Seminar @ PARC
Infochimps CxO Seminar @ PARC
 
II-SDV 2017: How Visualisation of Open Patent Data can help with Strategic De...
II-SDV 2017: How Visualisation of Open Patent Data can help with Strategic De...II-SDV 2017: How Visualisation of Open Patent Data can help with Strategic De...
II-SDV 2017: How Visualisation of Open Patent Data can help with Strategic De...
 
CDE Catapult by Maurizio Pilu - Cambridge Wireless Event - 28 Nov 2013
CDE Catapult by Maurizio Pilu - Cambridge Wireless Event - 28 Nov 2013CDE Catapult by Maurizio Pilu - Cambridge Wireless Event - 28 Nov 2013
CDE Catapult by Maurizio Pilu - Cambridge Wireless Event - 28 Nov 2013
 
Mapping the road to better data storage strategies
Mapping the road to better data storage strategiesMapping the road to better data storage strategies
Mapping the road to better data storage strategies
 

Similar to Foundations of Data Teams

Big Data and Analytics in the COVID-19 Era
Big Data and Analytics in the COVID-19 EraBig Data and Analytics in the COVID-19 Era
Big Data and Analytics in the COVID-19 EraJesse Anderson
 
Managing Real-Time Data Teams
Managing Real-Time Data TeamsManaging Real-Time Data Teams
Managing Real-Time Data TeamsJesse Anderson
 
13_LAGU_Comp_Configuration.pptx
13_LAGU_Comp_Configuration.pptx13_LAGU_Comp_Configuration.pptx
13_LAGU_Comp_Configuration.pptxnitin_009
 
THE INDUSTRY'S FIRST VIRTUAL EVENT IN ROMANIA - Why Data Virtualization is a ...
THE INDUSTRY'S FIRST VIRTUAL EVENT IN ROMANIA - Why Data Virtualization is a ...THE INDUSTRY'S FIRST VIRTUAL EVENT IN ROMANIA - Why Data Virtualization is a ...
THE INDUSTRY'S FIRST VIRTUAL EVENT IN ROMANIA - Why Data Virtualization is a ...Denodo
 
AI Blockchain IoT Convergence System Technology & Business Development
AI Blockchain IoT Convergence System Technology & Business DevelopmentAI Blockchain IoT Convergence System Technology & Business Development
AI Blockchain IoT Convergence System Technology & Business DevelopmentAlex G. Lee, Ph.D. Esq. CLP
 
SMEs innovation through future technologies
SMEs innovation through future technologiesSMEs innovation through future technologies
SMEs innovation through future technologiesIBTECAR
 
ADV Slides: Modern Analytic Data Architecture Maturity Modeling
ADV Slides: Modern Analytic Data Architecture Maturity ModelingADV Slides: Modern Analytic Data Architecture Maturity Modeling
ADV Slides: Modern Analytic Data Architecture Maturity ModelingDATAVERSITY
 
SailPoint Intern Presentation
SailPoint Intern PresentationSailPoint Intern Presentation
SailPoint Intern PresentationBraydonSimms
 
Bottlenecks for IoT Startups and How To Overcome Them
Bottlenecks for IoT Startups and How To Overcome ThemBottlenecks for IoT Startups and How To Overcome Them
Bottlenecks for IoT Startups and How To Overcome ThemYasuo Kawabata
 
AI Blockchain IoT Convergence for ESG Digital Transformation Webinar
AI Blockchain IoT Convergence for ESG Digital Transformation WebinarAI Blockchain IoT Convergence for ESG Digital Transformation Webinar
AI Blockchain IoT Convergence for ESG Digital Transformation WebinarAlex G. Lee, Ph.D. Esq. CLP
 
15_C5_DATA_CREATION.pptx
15_C5_DATA_CREATION.pptx15_C5_DATA_CREATION.pptx
15_C5_DATA_CREATION.pptxnitin_009
 
Creating InfoSec Dashboards that Don't Suck - RSA Conference 2020
Creating InfoSec Dashboards that Don't Suck - RSA Conference 2020Creating InfoSec Dashboards that Don't Suck - RSA Conference 2020
Creating InfoSec Dashboards that Don't Suck - RSA Conference 2020Dan Cole
 
Перехват функций (хуки) под Windows в приложениях с помощью C/C++
Перехват функций (хуки) под Windows в приложениях с помощью C/C++Перехват функций (хуки) под Windows в приложениях с помощью C/C++
Перехват функций (хуки) под Windows в приложениях с помощью C/C++corehard_by
 
Working Together As Data Teams V1
Working Together As Data Teams V1Working Together As Data Teams V1
Working Together As Data Teams V1Jesse Anderson
 
APT ATT&CK - Threat-based Purple Teaming with ATT&CK - x33fcon 2019
APT ATT&CK - Threat-based Purple Teaming with ATT&CK - x33fcon 2019APT ATT&CK - Threat-based Purple Teaming with ATT&CK - x33fcon 2019
APT ATT&CK - Threat-based Purple Teaming with ATT&CK - x33fcon 2019Daniel Weiss
 
The Internet Report: Episode 7 Week of May 4 - May 10
The Internet Report: Episode 7 Week of May 4 - May 10The Internet Report: Episode 7 Week of May 4 - May 10
The Internet Report: Episode 7 Week of May 4 - May 10ThousandEyes
 
Connecting & Sensing | Software AG
Connecting & Sensing | Software AGConnecting & Sensing | Software AG
Connecting & Sensing | Software AGXylos
 
Ivanti for msp
Ivanti for mspIvanti for msp
Ivanti for mspIvanti
 
NTT DATA FinTech meetup - AI and Experience design
NTT DATA FinTech meetup - AI and Experience designNTT DATA FinTech meetup - AI and Experience design
NTT DATA FinTech meetup - AI and Experience designTom Winstanley
 

Similar to Foundations of Data Teams (20)

Big Data and Analytics in the COVID-19 Era
Big Data and Analytics in the COVID-19 EraBig Data and Analytics in the COVID-19 Era
Big Data and Analytics in the COVID-19 Era
 
Managing Real-Time Data Teams
Managing Real-Time Data TeamsManaging Real-Time Data Teams
Managing Real-Time Data Teams
 
13_LAGU_Comp_Configuration.pptx
13_LAGU_Comp_Configuration.pptx13_LAGU_Comp_Configuration.pptx
13_LAGU_Comp_Configuration.pptx
 
THE INDUSTRY'S FIRST VIRTUAL EVENT IN ROMANIA - Why Data Virtualization is a ...
THE INDUSTRY'S FIRST VIRTUAL EVENT IN ROMANIA - Why Data Virtualization is a ...THE INDUSTRY'S FIRST VIRTUAL EVENT IN ROMANIA - Why Data Virtualization is a ...
THE INDUSTRY'S FIRST VIRTUAL EVENT IN ROMANIA - Why Data Virtualization is a ...
 
AI Blockchain IoT Convergence System Technology & Business Development
AI Blockchain IoT Convergence System Technology & Business DevelopmentAI Blockchain IoT Convergence System Technology & Business Development
AI Blockchain IoT Convergence System Technology & Business Development
 
SMEs innovation through future technologies
SMEs innovation through future technologiesSMEs innovation through future technologies
SMEs innovation through future technologies
 
ADV Slides: Modern Analytic Data Architecture Maturity Modeling
ADV Slides: Modern Analytic Data Architecture Maturity ModelingADV Slides: Modern Analytic Data Architecture Maturity Modeling
ADV Slides: Modern Analytic Data Architecture Maturity Modeling
 
SailPoint Intern Presentation
SailPoint Intern PresentationSailPoint Intern Presentation
SailPoint Intern Presentation
 
Bottlenecks for IoT Startups and How To Overcome Them
Bottlenecks for IoT Startups and How To Overcome ThemBottlenecks for IoT Startups and How To Overcome Them
Bottlenecks for IoT Startups and How To Overcome Them
 
AI Blockchain IoT Convergence for ESG Digital Transformation Webinar
AI Blockchain IoT Convergence for ESG Digital Transformation WebinarAI Blockchain IoT Convergence for ESG Digital Transformation Webinar
AI Blockchain IoT Convergence for ESG Digital Transformation Webinar
 
15_C5_DATA_CREATION.pptx
15_C5_DATA_CREATION.pptx15_C5_DATA_CREATION.pptx
15_C5_DATA_CREATION.pptx
 
Creating InfoSec Dashboards that Don't Suck - RSA Conference 2020
Creating InfoSec Dashboards that Don't Suck - RSA Conference 2020Creating InfoSec Dashboards that Don't Suck - RSA Conference 2020
Creating InfoSec Dashboards that Don't Suck - RSA Conference 2020
 
Перехват функций (хуки) под Windows в приложениях с помощью C/C++
Перехват функций (хуки) под Windows в приложениях с помощью C/C++Перехват функций (хуки) под Windows в приложениях с помощью C/C++
Перехват функций (хуки) под Windows в приложениях с помощью C/C++
 
Working Together As Data Teams V1
Working Together As Data Teams V1Working Together As Data Teams V1
Working Together As Data Teams V1
 
APT ATT&CK - Threat-based Purple Teaming with ATT&CK - x33fcon 2019
APT ATT&CK - Threat-based Purple Teaming with ATT&CK - x33fcon 2019APT ATT&CK - Threat-based Purple Teaming with ATT&CK - x33fcon 2019
APT ATT&CK - Threat-based Purple Teaming with ATT&CK - x33fcon 2019
 
The Internet Report: Episode 7 Week of May 4 - May 10
The Internet Report: Episode 7 Week of May 4 - May 10The Internet Report: Episode 7 Week of May 4 - May 10
The Internet Report: Episode 7 Week of May 4 - May 10
 
Connecting & Sensing | Software AG
Connecting & Sensing | Software AGConnecting & Sensing | Software AG
Connecting & Sensing | Software AG
 
Ivanti for msp
Ivanti for mspIvanti for msp
Ivanti for msp
 
The computing age
The computing ageThe computing age
The computing age
 
NTT DATA FinTech meetup - AI and Experience design
NTT DATA FinTech meetup - AI and Experience designNTT DATA FinTech meetup - AI and Experience design
NTT DATA FinTech meetup - AI and Experience design
 

More from Databricks

DW Migration Webinar-March 2022.pptx
DW Migration Webinar-March 2022.pptxDW Migration Webinar-March 2022.pptx
DW Migration Webinar-March 2022.pptxDatabricks
 
Data Lakehouse Symposium | Day 1 | Part 1
Data Lakehouse Symposium | Day 1 | Part 1Data Lakehouse Symposium | Day 1 | Part 1
Data Lakehouse Symposium | Day 1 | Part 1Databricks
 
Data Lakehouse Symposium | Day 1 | Part 2
Data Lakehouse Symposium | Day 1 | Part 2Data Lakehouse Symposium | Day 1 | Part 2
Data Lakehouse Symposium | Day 1 | Part 2Databricks
 
Data Lakehouse Symposium | Day 2
Data Lakehouse Symposium | Day 2Data Lakehouse Symposium | Day 2
Data Lakehouse Symposium | Day 2Databricks
 
Data Lakehouse Symposium | Day 4
Data Lakehouse Symposium | Day 4Data Lakehouse Symposium | Day 4
Data Lakehouse Symposium | Day 4Databricks
 
5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop
5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop
5 Critical Steps to Clean Your Data Swamp When Migrating Off of HadoopDatabricks
 
Democratizing Data Quality Through a Centralized Platform
Democratizing Data Quality Through a Centralized PlatformDemocratizing Data Quality Through a Centralized Platform
Democratizing Data Quality Through a Centralized PlatformDatabricks
 
Learn to Use Databricks for Data Science
Learn to Use Databricks for Data ScienceLearn to Use Databricks for Data Science
Learn to Use Databricks for Data ScienceDatabricks
 
Why APM Is Not the Same As ML Monitoring
Why APM Is Not the Same As ML MonitoringWhy APM Is Not the Same As ML Monitoring
Why APM Is Not the Same As ML MonitoringDatabricks
 
The Function, the Context, and the Data—Enabling ML Ops at Stitch Fix
The Function, the Context, and the Data—Enabling ML Ops at Stitch FixThe Function, the Context, and the Data—Enabling ML Ops at Stitch Fix
The Function, the Context, and the Data—Enabling ML Ops at Stitch FixDatabricks
 
Stage Level Scheduling Improving Big Data and AI Integration
Stage Level Scheduling Improving Big Data and AI IntegrationStage Level Scheduling Improving Big Data and AI Integration
Stage Level Scheduling Improving Big Data and AI IntegrationDatabricks
 
Simplify Data Conversion from Spark to TensorFlow and PyTorch
Simplify Data Conversion from Spark to TensorFlow and PyTorchSimplify Data Conversion from Spark to TensorFlow and PyTorch
Simplify Data Conversion from Spark to TensorFlow and PyTorchDatabricks
 
Scaling your Data Pipelines with Apache Spark on Kubernetes
Scaling your Data Pipelines with Apache Spark on KubernetesScaling your Data Pipelines with Apache Spark on Kubernetes
Scaling your Data Pipelines with Apache Spark on KubernetesDatabricks
 
Scaling and Unifying SciKit Learn and Apache Spark Pipelines
Scaling and Unifying SciKit Learn and Apache Spark PipelinesScaling and Unifying SciKit Learn and Apache Spark Pipelines
Scaling and Unifying SciKit Learn and Apache Spark PipelinesDatabricks
 
Sawtooth Windows for Feature Aggregations
Sawtooth Windows for Feature AggregationsSawtooth Windows for Feature Aggregations
Sawtooth Windows for Feature AggregationsDatabricks
 
Redis + Apache Spark = Swiss Army Knife Meets Kitchen Sink
Redis + Apache Spark = Swiss Army Knife Meets Kitchen SinkRedis + Apache Spark = Swiss Army Knife Meets Kitchen Sink
Redis + Apache Spark = Swiss Army Knife Meets Kitchen SinkDatabricks
 
Re-imagine Data Monitoring with whylogs and Spark
Re-imagine Data Monitoring with whylogs and SparkRe-imagine Data Monitoring with whylogs and Spark
Re-imagine Data Monitoring with whylogs and SparkDatabricks
 
Raven: End-to-end Optimization of ML Prediction Queries
Raven: End-to-end Optimization of ML Prediction QueriesRaven: End-to-end Optimization of ML Prediction Queries
Raven: End-to-end Optimization of ML Prediction QueriesDatabricks
 
Processing Large Datasets for ADAS Applications using Apache Spark
Processing Large Datasets for ADAS Applications using Apache SparkProcessing Large Datasets for ADAS Applications using Apache Spark
Processing Large Datasets for ADAS Applications using Apache SparkDatabricks
 
Massive Data Processing in Adobe Using Delta Lake
Massive Data Processing in Adobe Using Delta LakeMassive Data Processing in Adobe Using Delta Lake
Massive Data Processing in Adobe Using Delta LakeDatabricks
 

More from Databricks (20)

DW Migration Webinar-March 2022.pptx
DW Migration Webinar-March 2022.pptxDW Migration Webinar-March 2022.pptx
DW Migration Webinar-March 2022.pptx
 
Data Lakehouse Symposium | Day 1 | Part 1
Data Lakehouse Symposium | Day 1 | Part 1Data Lakehouse Symposium | Day 1 | Part 1
Data Lakehouse Symposium | Day 1 | Part 1
 
Data Lakehouse Symposium | Day 1 | Part 2
Data Lakehouse Symposium | Day 1 | Part 2Data Lakehouse Symposium | Day 1 | Part 2
Data Lakehouse Symposium | Day 1 | Part 2
 
Data Lakehouse Symposium | Day 2
Data Lakehouse Symposium | Day 2Data Lakehouse Symposium | Day 2
Data Lakehouse Symposium | Day 2
 
Data Lakehouse Symposium | Day 4
Data Lakehouse Symposium | Day 4Data Lakehouse Symposium | Day 4
Data Lakehouse Symposium | Day 4
 
5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop
5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop
5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop
 
Democratizing Data Quality Through a Centralized Platform
Democratizing Data Quality Through a Centralized PlatformDemocratizing Data Quality Through a Centralized Platform
Democratizing Data Quality Through a Centralized Platform
 
Learn to Use Databricks for Data Science
Learn to Use Databricks for Data ScienceLearn to Use Databricks for Data Science
Learn to Use Databricks for Data Science
 
Why APM Is Not the Same As ML Monitoring
Why APM Is Not the Same As ML MonitoringWhy APM Is Not the Same As ML Monitoring
Why APM Is Not the Same As ML Monitoring
 
The Function, the Context, and the Data—Enabling ML Ops at Stitch Fix
The Function, the Context, and the Data—Enabling ML Ops at Stitch FixThe Function, the Context, and the Data—Enabling ML Ops at Stitch Fix
The Function, the Context, and the Data—Enabling ML Ops at Stitch Fix
 
Stage Level Scheduling Improving Big Data and AI Integration
Stage Level Scheduling Improving Big Data and AI IntegrationStage Level Scheduling Improving Big Data and AI Integration
Stage Level Scheduling Improving Big Data and AI Integration
 
Simplify Data Conversion from Spark to TensorFlow and PyTorch
Simplify Data Conversion from Spark to TensorFlow and PyTorchSimplify Data Conversion from Spark to TensorFlow and PyTorch
Simplify Data Conversion from Spark to TensorFlow and PyTorch
 
Scaling your Data Pipelines with Apache Spark on Kubernetes
Scaling your Data Pipelines with Apache Spark on KubernetesScaling your Data Pipelines with Apache Spark on Kubernetes
Scaling your Data Pipelines with Apache Spark on Kubernetes
 
Scaling and Unifying SciKit Learn and Apache Spark Pipelines
Scaling and Unifying SciKit Learn and Apache Spark PipelinesScaling and Unifying SciKit Learn and Apache Spark Pipelines
Scaling and Unifying SciKit Learn and Apache Spark Pipelines
 
Sawtooth Windows for Feature Aggregations
Sawtooth Windows for Feature AggregationsSawtooth Windows for Feature Aggregations
Sawtooth Windows for Feature Aggregations
 
Redis + Apache Spark = Swiss Army Knife Meets Kitchen Sink
Redis + Apache Spark = Swiss Army Knife Meets Kitchen SinkRedis + Apache Spark = Swiss Army Knife Meets Kitchen Sink
Redis + Apache Spark = Swiss Army Knife Meets Kitchen Sink
 
Re-imagine Data Monitoring with whylogs and Spark
Re-imagine Data Monitoring with whylogs and SparkRe-imagine Data Monitoring with whylogs and Spark
Re-imagine Data Monitoring with whylogs and Spark
 
Raven: End-to-end Optimization of ML Prediction Queries
Raven: End-to-end Optimization of ML Prediction QueriesRaven: End-to-end Optimization of ML Prediction Queries
Raven: End-to-end Optimization of ML Prediction Queries
 
Processing Large Datasets for ADAS Applications using Apache Spark
Processing Large Datasets for ADAS Applications using Apache SparkProcessing Large Datasets for ADAS Applications using Apache Spark
Processing Large Datasets for ADAS Applications using Apache Spark
 
Massive Data Processing in Adobe Using Delta Lake
Massive Data Processing in Adobe Using Delta LakeMassive Data Processing in Adobe Using Delta Lake
Massive Data Processing in Adobe Using Delta Lake
 

Recently uploaded

dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.ppt
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.pptdokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.ppt
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.pptSonatrach
 
04242024_CCC TUG_Joins and Relationships
04242024_CCC TUG_Joins and Relationships04242024_CCC TUG_Joins and Relationships
04242024_CCC TUG_Joins and Relationshipsccctableauusergroup
 
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM TRACKING WITH GOOGLE ANALYTICS.pptx
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM  TRACKING WITH GOOGLE ANALYTICS.pptxEMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM  TRACKING WITH GOOGLE ANALYTICS.pptx
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM TRACKING WITH GOOGLE ANALYTICS.pptxthyngster
 
办理(Vancouver毕业证书)加拿大温哥华岛大学毕业证成绩单原版一比一
办理(Vancouver毕业证书)加拿大温哥华岛大学毕业证成绩单原版一比一办理(Vancouver毕业证书)加拿大温哥华岛大学毕业证成绩单原版一比一
办理(Vancouver毕业证书)加拿大温哥华岛大学毕业证成绩单原版一比一F La
 
PKS-TGC-1084-630 - Stage 1 Proposal.pptx
PKS-TGC-1084-630 - Stage 1 Proposal.pptxPKS-TGC-1084-630 - Stage 1 Proposal.pptx
PKS-TGC-1084-630 - Stage 1 Proposal.pptxPramod Kumar Srivastava
 
INTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTDINTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTDRafezzaman
 
9654467111 Call Girls In Munirka Hotel And Home Service
9654467111 Call Girls In Munirka Hotel And Home Service9654467111 Call Girls In Munirka Hotel And Home Service
9654467111 Call Girls In Munirka Hotel And Home ServiceSapana Sha
 
Generative AI for Social Good at Open Data Science East 2024
Generative AI for Social Good at Open Data Science East 2024Generative AI for Social Good at Open Data Science East 2024
Generative AI for Social Good at Open Data Science East 2024Colleen Farrelly
 
ASML's Taxonomy Adventure by Daniel Canter
ASML's Taxonomy Adventure by Daniel CanterASML's Taxonomy Adventure by Daniel Canter
ASML's Taxonomy Adventure by Daniel Cantervoginip
 
Customer Service Analytics - Make Sense of All Your Data.pptx
Customer Service Analytics - Make Sense of All Your Data.pptxCustomer Service Analytics - Make Sense of All Your Data.pptx
Customer Service Analytics - Make Sense of All Your Data.pptxEmmanuel Dauda
 
DBA Basics: Getting Started with Performance Tuning.pdf
DBA Basics: Getting Started with Performance Tuning.pdfDBA Basics: Getting Started with Performance Tuning.pdf
DBA Basics: Getting Started with Performance Tuning.pdfJohn Sterrett
 
RABBIT: A CLI tool for identifying bots based on their GitHub events.
RABBIT: A CLI tool for identifying bots based on their GitHub events.RABBIT: A CLI tool for identifying bots based on their GitHub events.
RABBIT: A CLI tool for identifying bots based on their GitHub events.natarajan8993
 
High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...
High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...
High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...soniya singh
 
20240419 - Measurecamp Amsterdam - SAM.pdf
20240419 - Measurecamp Amsterdam - SAM.pdf20240419 - Measurecamp Amsterdam - SAM.pdf
20240419 - Measurecamp Amsterdam - SAM.pdfHuman37
 
Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...
Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...
Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...limedy534
 
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样vhwb25kk
 
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...Jack DiGiovanna
 

Recently uploaded (20)

dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.ppt
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.pptdokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.ppt
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.ppt
 
04242024_CCC TUG_Joins and Relationships
04242024_CCC TUG_Joins and Relationships04242024_CCC TUG_Joins and Relationships
04242024_CCC TUG_Joins and Relationships
 
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM TRACKING WITH GOOGLE ANALYTICS.pptx
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM  TRACKING WITH GOOGLE ANALYTICS.pptxEMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM  TRACKING WITH GOOGLE ANALYTICS.pptx
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM TRACKING WITH GOOGLE ANALYTICS.pptx
 
办理(Vancouver毕业证书)加拿大温哥华岛大学毕业证成绩单原版一比一
办理(Vancouver毕业证书)加拿大温哥华岛大学毕业证成绩单原版一比一办理(Vancouver毕业证书)加拿大温哥华岛大学毕业证成绩单原版一比一
办理(Vancouver毕业证书)加拿大温哥华岛大学毕业证成绩单原版一比一
 
PKS-TGC-1084-630 - Stage 1 Proposal.pptx
PKS-TGC-1084-630 - Stage 1 Proposal.pptxPKS-TGC-1084-630 - Stage 1 Proposal.pptx
PKS-TGC-1084-630 - Stage 1 Proposal.pptx
 
INTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTDINTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTD
 
Call Girls in Saket 99530🔝 56974 Escort Service
Call Girls in Saket 99530🔝 56974 Escort ServiceCall Girls in Saket 99530🔝 56974 Escort Service
Call Girls in Saket 99530🔝 56974 Escort Service
 
9654467111 Call Girls In Munirka Hotel And Home Service
9654467111 Call Girls In Munirka Hotel And Home Service9654467111 Call Girls In Munirka Hotel And Home Service
9654467111 Call Girls In Munirka Hotel And Home Service
 
Generative AI for Social Good at Open Data Science East 2024
Generative AI for Social Good at Open Data Science East 2024Generative AI for Social Good at Open Data Science East 2024
Generative AI for Social Good at Open Data Science East 2024
 
ASML's Taxonomy Adventure by Daniel Canter
ASML's Taxonomy Adventure by Daniel CanterASML's Taxonomy Adventure by Daniel Canter
ASML's Taxonomy Adventure by Daniel Canter
 
Customer Service Analytics - Make Sense of All Your Data.pptx
Customer Service Analytics - Make Sense of All Your Data.pptxCustomer Service Analytics - Make Sense of All Your Data.pptx
Customer Service Analytics - Make Sense of All Your Data.pptx
 
DBA Basics: Getting Started with Performance Tuning.pdf
DBA Basics: Getting Started with Performance Tuning.pdfDBA Basics: Getting Started with Performance Tuning.pdf
DBA Basics: Getting Started with Performance Tuning.pdf
 
RABBIT: A CLI tool for identifying bots based on their GitHub events.
RABBIT: A CLI tool for identifying bots based on their GitHub events.RABBIT: A CLI tool for identifying bots based on their GitHub events.
RABBIT: A CLI tool for identifying bots based on their GitHub events.
 
High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...
High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...
High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...
 
20240419 - Measurecamp Amsterdam - SAM.pdf
20240419 - Measurecamp Amsterdam - SAM.pdf20240419 - Measurecamp Amsterdam - SAM.pdf
20240419 - Measurecamp Amsterdam - SAM.pdf
 
Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...
Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...
Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...
 
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
 
Deep Generative Learning for All - The Gen AI Hype (Spring 2024)
Deep Generative Learning for All - The Gen AI Hype (Spring 2024)Deep Generative Learning for All - The Gen AI Hype (Spring 2024)
Deep Generative Learning for All - The Gen AI Hype (Spring 2024)
 
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
 
E-Commerce Order PredictionShraddha Kamble.pptx
E-Commerce Order PredictionShraddha Kamble.pptxE-Commerce Order PredictionShraddha Kamble.pptx
E-Commerce Order PredictionShraddha Kamble.pptx
 

Foundations of Data Teams

  • 1. Foundations of Data Teams 1 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
  • 2. Houses Disclosure Data Teams Implications Foundations of Data Teams 2 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
  • 3. Sometimes its implicit about what we want versus how we get it. We focus the on exterior and cosmetic. Houses = Value Created Construction = Data Teams Credit: Rum BucolicApe 3 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
  • 4. Our Focus Is On The Facade We're so focused on models we're missing the rest of the structure. Credit: BisonArchives 4 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
  • 5. Do Data Teams Need Foundations? Houses don't need a foundation if you don’t need it to stand for long. Credit: Yurt-Jean-PierreDalbéra 5 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
  • 6. An Easy Renovation? Adding advanced analytics isn't a simple renovation. Credit: AapoHaapanen 6 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
  • 7. Houses Disclosure Data Teams Implications Foundations of Data Teams 7 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
  • 8. Sellers may not disclose everything When selling a house the seller has to disclose any problems Non-disclosure has legal and monetary implications 8 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
  • 9. Whose Job? Whose job is it to disclose issues your team? Vendors, Management, Individual Contributors, Books? 9 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
  • 10. Is It Easy? Some vendors are misleading with their disclosures. They say it's easy and you don'tneed a solid foundation. 10 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
  • 11. Houses Disclosure Data Teams Implications Foundations of Data Teams 11 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
  • 12. Data Teams Each team is equally important and necessary to create value Data Science Data Engineering Operations 12 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
  • 13. Without Data Science There's a foundation, but no value is created because no one lives there. Credit: kerttu 13 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
  • 14. Without Data Engineers House is there but crumbles due to lack of sound engineering Credit: SamanthaForsberg 14 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
  • 15. Without Operations The business won't use neglected, messy, and unkempt data products. Credit: LarryNeuberger 15 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
  • 16. Houses Disclosure Data Teams Implication s Foundations of Data Teams 16 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
  • 17. Put the Effort Into a SolidFoundation It's much easier to initially build on top of a solid foundation Credit: HydrogenIodide 17 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
  • 18. ...Or Else It will cost far more to go back and fix it later Credit: HydrogenIodide 18 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
  • 19. Velocity Increases With Solid Foundations Continuous improvements built on solid foundation versus failing and constantly dropping. Velocity Time Lacking Foundation Solid Foundation 19 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
  • 20. An Ounce of Prevention Is Worth a Ton of Cure It's always possible to fix a foundation but will be costly, don't wait. Credit: ICMAPhotos 20 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
  • 21. Data Teams Book https://www.datateams.io 21 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80
  • 22. Thank You bigdatainstitute.io 22 / 22Copyright © 2020 Smoking Hand LLC. All rights Reserved. Version: c58f0a80