SlideShare a Scribd company logo
Data-driven culture & infrastructure
from the ground up
January 2017
Data-driven culture and infrastructure from the ground up
Agenda
● R&D and IT consultancy firm
● Clients - Silicon Valley Startups from Round A to Round D
● Hardcore Big Data Analytics team in Kazan
Data-driven culture and infrastructure from the ground up
January 2017
People driven
Data-driven culture and infrastructure from the ground up
Excel driven
January 2017
Data-driven culture and infrastructure from the ground up
BI driven
January 2017
Data-driven culture and infrastructure from the ground up
Data Driven Team
January 2017
Product Manager
Owners
Engineer UI Data Scientist
Sales/Marketing DevOps Customer
Data-driven culture and infrastructure from the ground up
Data Driven Team
January 2017
Product
Metrics
Ad-hoc reports
Reports
Data-driven culture and infrastructure from the ground up
Data Driven Team
January 2017
Product
Metrics
Ad-hoc reports
Reports
Engineer
Alerts, Errors
Metrics
Data-driven culture and infrastructure from the ground up
Data Driven Team
January 2017
Product
Metrics
Ad-hoc reports
Reports
Engineer
Alerts, Errors
Metrics
UX
Usage Patterns
A/B tests
Data-driven culture and infrastructure from the ground up
Data Driven Team
January 2017
Product
Metrics
Ad-hoc reports
Reports
Engineer
Alerts, Errors
Metrics
Data Scientist
Scripts
Models
UX
Usage Patterns
A/B tests
Data-driven culture and infrastructure from the ground up
Data Driven Team
January 2017
Product
Metrics
Ad-hoc reports
Reports
Owners
Revenue trends
Prescriptions
Insights
Engineer
Alerts, Errors
Metrics
Data Scientist
Scripts
Models
UX
Usage Patterns
A/B tests
Data-driven culture and infrastructure from the ground up
Data Driven Team
January 2017
Product
Metrics
Ad-hoc reports
Reports
Owners
Revenue trends
Prescriptions
Insights
Engineer
Alerts, Errors
Metrics
Data Scientist
Scripts
Models
Marketing
BI tools
A/B test
UX
Usage Patterns
A/B tests
Data-driven culture and infrastructure from the ground up
Data Driven Team
January 2017
Product
Metrics
Ad-hoc reports
Reports
Owners
Revenue trends
Prescriptions
Insights
Engineer
Alerts, Errors
Metrics
DevOps
Alerts, Errors
Metrics
Monitoring
Data Scientist
Scripts
Models
Marketing
BI tools
A/B test
UX
Usage Patterns
A/B tests
Data-driven culture and infrastructure from the ground up
Data Driven Team
January 2017
Product
Metrics
Ad-hoc reports
Reports
Customer
Dashboards
Personalization
Insights
Reports
Owners
Revenue trends
Prescriptions
Insights
Engineer
Alerts, Errors
Metrics
DevOps
Alerts, Errors
Metrics
Monitoring
Data Scientist
Scripts
Models
Marketing
BI tools
A/B test
UX
Usage Patterns
A/B tests
Data-driven culture and infrastructure from the ground up
Data Driven Team
January 2017
Product
Metrics
Ad-hoc reports
Reports
Customer
Dashboards
Personalization
Insights
Reports
Owners
Revenue trends
Prescriptions
Insights
Engineer
Alerts, Errors
Metrics
DevOps
Alerts, Errors
Metrics
Monitoring
Data Scientist
Scripts
Models
Marketing
BI tools
A/B test
UX
Usage Patterns
A/B tests
Data-driven culture and infrastructure from the ground up
● Product Managers - SQL
● Engineers - Production, Product, Metrics, SOFT SKILLS
● UX - Marketing, Analytics
● Sales Engineer
● Business - BI, Reports, Metrics
January 2017
New Cross Skills - Evangelism
Data-driven culture and infrastructure from the ground up
Infrastructure
Data-driven culture and infrastructure from the ground up
● You could not just BUY it
● It’s not a Data Warehouse
● It’s not easy at all
January 2017
Myths
Data-driven culture and infrastructure from the ground up
High Level
January 2017
App Servers
Production
database
Logs
Storage
BI
Prescriptions
Application Data Infrastructure Visualisation
Data-driven culture and infrastructure from the ground up
Micro
January 2017
App Servers
Production
database Logs agg/
Papertrail
Keen.io
Clicdata
Datadog
Prometheus
Application Data Infrastructure Visualisation
GA
Data-driven culture and infrastructure from the ground up
Small
January 2017
App Servers
Production
database
Log agg/
Papertrail
S3
Clicdata
Interana
Looker
Datadog
Prometheus
Application Data Infrastructure Visualisation
Slave replica
Data-driven culture and infrastructure from the ground up
Medium
January 2017
App Servers
Prod
Log stream S3
Clicdata
Interana
Looker
Datadog
Prometheus
Application Data Infrastructure Visualisation
Slave
replica
ETL RedShift
Ad-hoc SQL
Data-driven culture and infrastructure from the ground up
Medium
January 2017
App Servers
Prod
AWS Kinesis S3
Clicdata
Interana
Looker
Datadog
Application Data Infrastructure Visualisation
Slave
replica
AWS
Lambda RedShift
Ad-hoc SQL
Data-driven culture and infrastructure from the ground up
Medium
January 2017
App Servers
Prod
Kafka S3
Clicdata
Interana
Looker
Datadog
Prometheus
Application Data Infrastructure Visualisation
Slave
replica
Spark
Streaming RedShift
Ad-hoc SQL
Data-driven culture and infrastructure from the ground up
Big
January 2017
App Servers
Prod
Tableau
Clicdata
Interana
Looker
Application Data Infrastructure Visualisation
Slave
replica
ETL/Spark/Streaming
RedShift
Ad-hoc SQL
Hadoop/Parquet Impala
Spark SQL
Data Science
www.squadex.com
125 University Avenue,
Suite 290, Palo Alto,
California, 94301
Questions, details?
We would be happy to answer!

More Related Content

What's hot

Streaming analytics @ ING by David Vaquero at Big Data Spain 2017
Streaming analytics @ ING by David Vaquero at Big Data Spain 2017Streaming analytics @ ING by David Vaquero at Big Data Spain 2017
Streaming analytics @ ING by David Vaquero at Big Data Spain 2017
Big Data Spain
 
Tableau Conference 2018: Binging on Data - Enabling Analytics at Netflix
Tableau Conference 2018: Binging on Data - Enabling Analytics at NetflixTableau Conference 2018: Binging on Data - Enabling Analytics at Netflix
Tableau Conference 2018: Binging on Data - Enabling Analytics at Netflix
Blake Irvine
 
Hub16: ”Flexible” supply chain planning technology and its impact on B2B and ...
Hub16: ”Flexible” supply chain planning technology and its impact on B2B and ...Hub16: ”Flexible” supply chain planning technology and its impact on B2B and ...
Hub16: ”Flexible” supply chain planning technology and its impact on B2B and ...
Anaplan
 
The impact of Big Data and applied analytics along the value chain by Guy Per...
The impact of Big Data and applied analytics along the value chain by Guy Per...The impact of Big Data and applied analytics along the value chain by Guy Per...
The impact of Big Data and applied analytics along the value chain by Guy Per...
Big Data Spain
 
Notebooks @ Netflix: From analytics to engineering with Jupyter notebooks
Notebooks @ Netflix: From analytics to engineering with Jupyter notebooksNotebooks @ Netflix: From analytics to engineering with Jupyter notebooks
Notebooks @ Netflix: From analytics to engineering with Jupyter notebooks
Michelle Ufford
 
Brian Lee Resume (1)
Brian Lee Resume (1)Brian Lee Resume (1)
Brian Lee Resume (1)Brian Lee
 
Riding the big data wave with Excel and Power BI - SMBNation 2015
Riding the big data wave with Excel and Power BI - SMBNation 2015Riding the big data wave with Excel and Power BI - SMBNation 2015
Riding the big data wave with Excel and Power BI - SMBNation 2015
Robert Crane
 
Hub16: Workforce planning at Tableau: Finding time compression and process ag...
Hub16: Workforce planning at Tableau: Finding time compression and process ag...Hub16: Workforce planning at Tableau: Finding time compression and process ag...
Hub16: Workforce planning at Tableau: Finding time compression and process ag...
Anaplan
 
The culture trip snowplow implementation
The culture trip snowplow implementationThe culture trip snowplow implementation
The culture trip snowplow implementation
idan_by
 
eBiz 2017: The Future of Warehouse Technology
eBiz 2017: The Future of Warehouse Technology eBiz 2017: The Future of Warehouse Technology
eBiz 2017: The Future of Warehouse Technology
IDEA (Industry Data Exchange Assc., Inc.)
 

What's hot (10)

Streaming analytics @ ING by David Vaquero at Big Data Spain 2017
Streaming analytics @ ING by David Vaquero at Big Data Spain 2017Streaming analytics @ ING by David Vaquero at Big Data Spain 2017
Streaming analytics @ ING by David Vaquero at Big Data Spain 2017
 
Tableau Conference 2018: Binging on Data - Enabling Analytics at Netflix
Tableau Conference 2018: Binging on Data - Enabling Analytics at NetflixTableau Conference 2018: Binging on Data - Enabling Analytics at Netflix
Tableau Conference 2018: Binging on Data - Enabling Analytics at Netflix
 
Hub16: ”Flexible” supply chain planning technology and its impact on B2B and ...
Hub16: ”Flexible” supply chain planning technology and its impact on B2B and ...Hub16: ”Flexible” supply chain planning technology and its impact on B2B and ...
Hub16: ”Flexible” supply chain planning technology and its impact on B2B and ...
 
The impact of Big Data and applied analytics along the value chain by Guy Per...
The impact of Big Data and applied analytics along the value chain by Guy Per...The impact of Big Data and applied analytics along the value chain by Guy Per...
The impact of Big Data and applied analytics along the value chain by Guy Per...
 
Notebooks @ Netflix: From analytics to engineering with Jupyter notebooks
Notebooks @ Netflix: From analytics to engineering with Jupyter notebooksNotebooks @ Netflix: From analytics to engineering with Jupyter notebooks
Notebooks @ Netflix: From analytics to engineering with Jupyter notebooks
 
Brian Lee Resume (1)
Brian Lee Resume (1)Brian Lee Resume (1)
Brian Lee Resume (1)
 
Riding the big data wave with Excel and Power BI - SMBNation 2015
Riding the big data wave with Excel and Power BI - SMBNation 2015Riding the big data wave with Excel and Power BI - SMBNation 2015
Riding the big data wave with Excel and Power BI - SMBNation 2015
 
Hub16: Workforce planning at Tableau: Finding time compression and process ag...
Hub16: Workforce planning at Tableau: Finding time compression and process ag...Hub16: Workforce planning at Tableau: Finding time compression and process ag...
Hub16: Workforce planning at Tableau: Finding time compression and process ag...
 
The culture trip snowplow implementation
The culture trip snowplow implementationThe culture trip snowplow implementation
The culture trip snowplow implementation
 
eBiz 2017: The Future of Warehouse Technology
eBiz 2017: The Future of Warehouse Technology eBiz 2017: The Future of Warehouse Technology
eBiz 2017: The Future of Warehouse Technology
 

Viewers also liked

Insights to Action: Inform Your Engagement Marketing Strategy with Behavioral...
Insights to Action: Inform Your Engagement Marketing Strategy with Behavioral...Insights to Action: Inform Your Engagement Marketing Strategy with Behavioral...
Insights to Action: Inform Your Engagement Marketing Strategy with Behavioral...
Kahuna
 
Amplitude wave architecture - Test
Amplitude wave architecture - TestAmplitude wave architecture - Test
Amplitude wave architecture - Test
Kiran Naiga
 
Boi, Dell'Orto, Raffaldi & Trombetti - input2012
Boi, Dell'Orto, Raffaldi & Trombetti - input2012Boi, Dell'Orto, Raffaldi & Trombetti - input2012
Boi, Dell'Orto, Raffaldi & Trombetti - input2012
INPUT 2012
 
Finding your mobile growth
Finding your mobile growthFinding your mobile growth
Finding your mobile growth
Lean Startup Co.
 
Canary releases & Blue green deployment
Canary releases & Blue green deploymentCanary releases & Blue green deployment
Canary releases & Blue green deployment
SQUADEX
 
Big Data Day LA 2016/ Big Data Track - Puree through Trillion of Clicks in Se...
Big Data Day LA 2016/ Big Data Track - Puree through Trillion of Clicks in Se...Big Data Day LA 2016/ Big Data Track - Puree through Trillion of Clicks in Se...
Big Data Day LA 2016/ Big Data Track - Puree through Trillion of Clicks in Se...
Data Con LA
 
Bolivia seismic properties k. rainer massarsch
Bolivia seismic properties   k. rainer massarschBolivia seismic properties   k. rainer massarsch
Bolivia seismic properties k. rainer massarsch
cfpbolivia
 
A 7-step framework for measuring the impact of your next feature release
A 7-step framework for measuring the impact of your next feature releaseA 7-step framework for measuring the impact of your next feature release
A 7-step framework for measuring the impact of your next feature release
Amplitude
 
Joining the Club: Using Spark to Accelerate Big Data at Dollar Shave Club
Joining the Club: Using Spark to Accelerate Big Data at Dollar Shave ClubJoining the Club: Using Spark to Accelerate Big Data at Dollar Shave Club
Joining the Club: Using Spark to Accelerate Big Data at Dollar Shave Club
Data Con LA
 
UNDERGROUND HIGH POWER TRANSMISSION LINES
UNDERGROUND HIGH POWER TRANSMISSION LINESUNDERGROUND HIGH POWER TRANSMISSION LINES
UNDERGROUND HIGH POWER TRANSMISSION LINES
VISHNU ARAVIND
 
Strata Designing Delightful Data Products
Strata Designing Delightful Data ProductsStrata Designing Delightful Data Products
Strata Designing Delightful Data Products
Alonzo Canada
 
English project underground davidcarpintero
English project underground davidcarpinteroEnglish project underground davidcarpintero
English project underground davidcarpintero
David Carpintero Pleguezuelos
 

Viewers also liked (12)

Insights to Action: Inform Your Engagement Marketing Strategy with Behavioral...
Insights to Action: Inform Your Engagement Marketing Strategy with Behavioral...Insights to Action: Inform Your Engagement Marketing Strategy with Behavioral...
Insights to Action: Inform Your Engagement Marketing Strategy with Behavioral...
 
Amplitude wave architecture - Test
Amplitude wave architecture - TestAmplitude wave architecture - Test
Amplitude wave architecture - Test
 
Boi, Dell'Orto, Raffaldi & Trombetti - input2012
Boi, Dell'Orto, Raffaldi & Trombetti - input2012Boi, Dell'Orto, Raffaldi & Trombetti - input2012
Boi, Dell'Orto, Raffaldi & Trombetti - input2012
 
Finding your mobile growth
Finding your mobile growthFinding your mobile growth
Finding your mobile growth
 
Canary releases & Blue green deployment
Canary releases & Blue green deploymentCanary releases & Blue green deployment
Canary releases & Blue green deployment
 
Big Data Day LA 2016/ Big Data Track - Puree through Trillion of Clicks in Se...
Big Data Day LA 2016/ Big Data Track - Puree through Trillion of Clicks in Se...Big Data Day LA 2016/ Big Data Track - Puree through Trillion of Clicks in Se...
Big Data Day LA 2016/ Big Data Track - Puree through Trillion of Clicks in Se...
 
Bolivia seismic properties k. rainer massarsch
Bolivia seismic properties   k. rainer massarschBolivia seismic properties   k. rainer massarsch
Bolivia seismic properties k. rainer massarsch
 
A 7-step framework for measuring the impact of your next feature release
A 7-step framework for measuring the impact of your next feature releaseA 7-step framework for measuring the impact of your next feature release
A 7-step framework for measuring the impact of your next feature release
 
Joining the Club: Using Spark to Accelerate Big Data at Dollar Shave Club
Joining the Club: Using Spark to Accelerate Big Data at Dollar Shave ClubJoining the Club: Using Spark to Accelerate Big Data at Dollar Shave Club
Joining the Club: Using Spark to Accelerate Big Data at Dollar Shave Club
 
UNDERGROUND HIGH POWER TRANSMISSION LINES
UNDERGROUND HIGH POWER TRANSMISSION LINESUNDERGROUND HIGH POWER TRANSMISSION LINES
UNDERGROUND HIGH POWER TRANSMISSION LINES
 
Strata Designing Delightful Data Products
Strata Designing Delightful Data ProductsStrata Designing Delightful Data Products
Strata Designing Delightful Data Products
 
English project underground davidcarpintero
English project underground davidcarpinteroEnglish project underground davidcarpintero
English project underground davidcarpintero
 

Similar to Data driven culture & infrastructure from the ground up

Resume-Vivek Mohan (BI & Analytics Enterprise Architect) - Looking for an opp...
Resume-Vivek Mohan (BI & Analytics Enterprise Architect) - Looking for an opp...Resume-Vivek Mohan (BI & Analytics Enterprise Architect) - Looking for an opp...
Resume-Vivek Mohan (BI & Analytics Enterprise Architect) - Looking for an opp...
Vivek Mohan
 
Ilya_Tsarfin.pdf
Ilya_Tsarfin.pdfIlya_Tsarfin.pdf
Ilya_Tsarfin.pdf
Ilya Tsarfin
 
Business Analytics Training
Business Analytics TrainingBusiness Analytics Training
Business Analytics Training
Natalija Pavic
 
1000 track 1 groves_using our laptop
1000 track 1 groves_using our laptop1000 track 1 groves_using our laptop
1000 track 1 groves_using our laptop
Rising Media, Inc.
 
AI for Analysts June 2016
AI for Analysts June 2016AI for Analysts June 2016
AI for Analysts June 2016
Boulder Equity Analytics
 
Nadine Schöne, Dataiku. The Complete Data Value Chain in a Nutshell
Nadine Schöne, Dataiku. The Complete Data Value Chain in a NutshellNadine Schöne, Dataiku. The Complete Data Value Chain in a Nutshell
Nadine Schöne, Dataiku. The Complete Data Value Chain in a Nutshell
IT Arena
 
How CROSSMARK Rapidly Deployed BI Solutions Across the Value Chain
How CROSSMARK Rapidly Deployed BI Solutions Across the Value ChainHow CROSSMARK Rapidly Deployed BI Solutions Across the Value Chain
How CROSSMARK Rapidly Deployed BI Solutions Across the Value Chain
Rob Saker
 
KDD 2019 IADSS Workshop - Leveraging data and analytics for company results -...
KDD 2019 IADSS Workshop - Leveraging data and analytics for company results -...KDD 2019 IADSS Workshop - Leveraging data and analytics for company results -...
KDD 2019 IADSS Workshop - Leveraging data and analytics for company results -...
IADSS
 
Bdw driving commercial excellence with analytics-danny kosasih
Bdw driving commercial excellence with analytics-danny kosasihBdw driving commercial excellence with analytics-danny kosasih
Bdw driving commercial excellence with analytics-danny kosasih
Danny D. Kosasih
 
Resume
ResumeResume
Rick Hudson Resume August 2015
Rick Hudson Resume August 2015Rick Hudson Resume August 2015
Rick Hudson Resume August 2015Rick Hudson
 
Big Data Meetup: Analytical Systems Evolution
Big Data Meetup: Analytical Systems EvolutionBig Data Meetup: Analytical Systems Evolution
Big Data Meetup: Analytical Systems Evolution
Provectus
 
Webinar: Business Intelligence From The Inside Out
Webinar: Business Intelligence From The Inside OutWebinar: Business Intelligence From The Inside Out
Webinar: Business Intelligence From The Inside Out
CorSourceTechPDX
 
Get One Single View
Get One Single ViewGet One Single View
Get One Single View
Dhiren Gala
 
2015-6 James_L_Stevens resume US
2015-6 James_L_Stevens resume US2015-6 James_L_Stevens resume US
2015-6 James_L_Stevens resume USJames Stevens
 
Transition to a modern data platform
Transition to a modern data platform Transition to a modern data platform
Transition to a modern data platform
Michael Ghen
 
SquareOne Technologies-Business Analytics-Profile
SquareOne Technologies-Business Analytics-ProfileSquareOne Technologies-Business Analytics-Profile
SquareOne Technologies-Business Analytics-ProfileAditi Sharma
 
IBM's Business Analytics Portfolio for Training Purposes
IBM's Business Analytics Portfolio for Training PurposesIBM's Business Analytics Portfolio for Training Purposes
IBM's Business Analytics Portfolio for Training Purposes
Natalija Pavic
 
Data Discovery and BI - Is there Really a Difference?
Data Discovery and BI - Is there Really a Difference?Data Discovery and BI - Is there Really a Difference?
Data Discovery and BI - Is there Really a Difference?
Inside Analysis
 

Similar to Data driven culture & infrastructure from the ground up (20)

Resume-Vivek Mohan (BI & Analytics Enterprise Architect) - Looking for an opp...
Resume-Vivek Mohan (BI & Analytics Enterprise Architect) - Looking for an opp...Resume-Vivek Mohan (BI & Analytics Enterprise Architect) - Looking for an opp...
Resume-Vivek Mohan (BI & Analytics Enterprise Architect) - Looking for an opp...
 
Ilya_Tsarfin.pdf
Ilya_Tsarfin.pdfIlya_Tsarfin.pdf
Ilya_Tsarfin.pdf
 
Business Analytics Training
Business Analytics TrainingBusiness Analytics Training
Business Analytics Training
 
1000 track 1 groves_using our laptop
1000 track 1 groves_using our laptop1000 track 1 groves_using our laptop
1000 track 1 groves_using our laptop
 
AI for Analysts June 2016
AI for Analysts June 2016AI for Analysts June 2016
AI for Analysts June 2016
 
Nadine Schöne, Dataiku. The Complete Data Value Chain in a Nutshell
Nadine Schöne, Dataiku. The Complete Data Value Chain in a NutshellNadine Schöne, Dataiku. The Complete Data Value Chain in a Nutshell
Nadine Schöne, Dataiku. The Complete Data Value Chain in a Nutshell
 
How CROSSMARK Rapidly Deployed BI Solutions Across the Value Chain
How CROSSMARK Rapidly Deployed BI Solutions Across the Value ChainHow CROSSMARK Rapidly Deployed BI Solutions Across the Value Chain
How CROSSMARK Rapidly Deployed BI Solutions Across the Value Chain
 
KDD 2019 IADSS Workshop - Leveraging data and analytics for company results -...
KDD 2019 IADSS Workshop - Leveraging data and analytics for company results -...KDD 2019 IADSS Workshop - Leveraging data and analytics for company results -...
KDD 2019 IADSS Workshop - Leveraging data and analytics for company results -...
 
Bdw driving commercial excellence with analytics-danny kosasih
Bdw driving commercial excellence with analytics-danny kosasihBdw driving commercial excellence with analytics-danny kosasih
Bdw driving commercial excellence with analytics-danny kosasih
 
Sai Konijeti Resume
Sai Konijeti ResumeSai Konijeti Resume
Sai Konijeti Resume
 
Resume
ResumeResume
Resume
 
Rick Hudson Resume August 2015
Rick Hudson Resume August 2015Rick Hudson Resume August 2015
Rick Hudson Resume August 2015
 
Big Data Meetup: Analytical Systems Evolution
Big Data Meetup: Analytical Systems EvolutionBig Data Meetup: Analytical Systems Evolution
Big Data Meetup: Analytical Systems Evolution
 
Webinar: Business Intelligence From The Inside Out
Webinar: Business Intelligence From The Inside OutWebinar: Business Intelligence From The Inside Out
Webinar: Business Intelligence From The Inside Out
 
Get One Single View
Get One Single ViewGet One Single View
Get One Single View
 
2015-6 James_L_Stevens resume US
2015-6 James_L_Stevens resume US2015-6 James_L_Stevens resume US
2015-6 James_L_Stevens resume US
 
Transition to a modern data platform
Transition to a modern data platform Transition to a modern data platform
Transition to a modern data platform
 
SquareOne Technologies-Business Analytics-Profile
SquareOne Technologies-Business Analytics-ProfileSquareOne Technologies-Business Analytics-Profile
SquareOne Technologies-Business Analytics-Profile
 
IBM's Business Analytics Portfolio for Training Purposes
IBM's Business Analytics Portfolio for Training PurposesIBM's Business Analytics Portfolio for Training Purposes
IBM's Business Analytics Portfolio for Training Purposes
 
Data Discovery and BI - Is there Really a Difference?
Data Discovery and BI - Is there Really a Difference?Data Discovery and BI - Is there Really a Difference?
Data Discovery and BI - Is there Really a Difference?
 

More from SQUADEX

Tooling for Machine Learning: AWS Products, Open Source Tools, and DevOps Pra...
Tooling for Machine Learning: AWS Products, Open Source Tools, and DevOps Pra...Tooling for Machine Learning: AWS Products, Open Source Tools, and DevOps Pra...
Tooling for Machine Learning: AWS Products, Open Source Tools, and DevOps Pra...
SQUADEX
 
Osdn serverless technologies with kubernetes
Osdn serverless technologies with kubernetes Osdn serverless technologies with kubernetes
Osdn serverless technologies with kubernetes
SQUADEX
 
Spark as etl_squadex
Spark as etl_squadexSpark as etl_squadex
Spark as etl_squadex
SQUADEX
 
Squadex DevOps Trainings
Squadex DevOps TrainingsSquadex DevOps Trainings
Squadex DevOps Trainings
SQUADEX
 
Enterprise level cloud CI
Enterprise level cloud CIEnterprise level cloud CI
Enterprise level cloud CI
SQUADEX
 
Building DevOps culture from bottom up
Building DevOps culture from bottom upBuilding DevOps culture from bottom up
Building DevOps culture from bottom up
SQUADEX
 
Kubernetes as a cloud for CI
Kubernetes as a cloud for CIKubernetes as a cloud for CI
Kubernetes as a cloud for CI
SQUADEX
 

More from SQUADEX (7)

Tooling for Machine Learning: AWS Products, Open Source Tools, and DevOps Pra...
Tooling for Machine Learning: AWS Products, Open Source Tools, and DevOps Pra...Tooling for Machine Learning: AWS Products, Open Source Tools, and DevOps Pra...
Tooling for Machine Learning: AWS Products, Open Source Tools, and DevOps Pra...
 
Osdn serverless technologies with kubernetes
Osdn serverless technologies with kubernetes Osdn serverless technologies with kubernetes
Osdn serverless technologies with kubernetes
 
Spark as etl_squadex
Spark as etl_squadexSpark as etl_squadex
Spark as etl_squadex
 
Squadex DevOps Trainings
Squadex DevOps TrainingsSquadex DevOps Trainings
Squadex DevOps Trainings
 
Enterprise level cloud CI
Enterprise level cloud CIEnterprise level cloud CI
Enterprise level cloud CI
 
Building DevOps culture from bottom up
Building DevOps culture from bottom upBuilding DevOps culture from bottom up
Building DevOps culture from bottom up
 
Kubernetes as a cloud for CI
Kubernetes as a cloud for CIKubernetes as a cloud for CI
Kubernetes as a cloud for CI
 

Recently uploaded

Elevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object CalisthenicsElevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object Calisthenics
Dorra BARTAGUIZ
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
Kari Kakkonen
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
DianaGray10
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
OnBoard
 
Free Complete Python - A step towards Data Science
Free Complete Python - A step towards Data ScienceFree Complete Python - A step towards Data Science
Free Complete Python - A step towards Data Science
RinaMondal9
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
Cheryl Hung
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
Elena Simperl
 
Assure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyesAssure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyes
ThousandEyes
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
Alison B. Lowndes
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
Ana-Maria Mihalceanu
 
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptxSecstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
nkrafacyberclub
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Product School
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
Guy Korland
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
Jemma Hussein Allen
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
Product School
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
Safe Software
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
Alan Dix
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
mikeeftimakis1
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
Laura Byrne
 

Recently uploaded (20)

Elevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object CalisthenicsElevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object Calisthenics
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
 
Free Complete Python - A step towards Data Science
Free Complete Python - A step towards Data ScienceFree Complete Python - A step towards Data Science
Free Complete Python - A step towards Data Science
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
 
Assure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyesAssure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyes
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
 
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptxSecstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
 

Data driven culture & infrastructure from the ground up

  • 1. Data-driven culture & infrastructure from the ground up January 2017
  • 2. Data-driven culture and infrastructure from the ground up Agenda ● R&D and IT consultancy firm ● Clients - Silicon Valley Startups from Round A to Round D ● Hardcore Big Data Analytics team in Kazan
  • 3. Data-driven culture and infrastructure from the ground up January 2017 People driven
  • 4. Data-driven culture and infrastructure from the ground up Excel driven January 2017
  • 5. Data-driven culture and infrastructure from the ground up BI driven January 2017
  • 6. Data-driven culture and infrastructure from the ground up Data Driven Team January 2017 Product Manager Owners Engineer UI Data Scientist Sales/Marketing DevOps Customer
  • 7. Data-driven culture and infrastructure from the ground up Data Driven Team January 2017 Product Metrics Ad-hoc reports Reports
  • 8. Data-driven culture and infrastructure from the ground up Data Driven Team January 2017 Product Metrics Ad-hoc reports Reports Engineer Alerts, Errors Metrics
  • 9. Data-driven culture and infrastructure from the ground up Data Driven Team January 2017 Product Metrics Ad-hoc reports Reports Engineer Alerts, Errors Metrics UX Usage Patterns A/B tests
  • 10. Data-driven culture and infrastructure from the ground up Data Driven Team January 2017 Product Metrics Ad-hoc reports Reports Engineer Alerts, Errors Metrics Data Scientist Scripts Models UX Usage Patterns A/B tests
  • 11. Data-driven culture and infrastructure from the ground up Data Driven Team January 2017 Product Metrics Ad-hoc reports Reports Owners Revenue trends Prescriptions Insights Engineer Alerts, Errors Metrics Data Scientist Scripts Models UX Usage Patterns A/B tests
  • 12. Data-driven culture and infrastructure from the ground up Data Driven Team January 2017 Product Metrics Ad-hoc reports Reports Owners Revenue trends Prescriptions Insights Engineer Alerts, Errors Metrics Data Scientist Scripts Models Marketing BI tools A/B test UX Usage Patterns A/B tests
  • 13. Data-driven culture and infrastructure from the ground up Data Driven Team January 2017 Product Metrics Ad-hoc reports Reports Owners Revenue trends Prescriptions Insights Engineer Alerts, Errors Metrics DevOps Alerts, Errors Metrics Monitoring Data Scientist Scripts Models Marketing BI tools A/B test UX Usage Patterns A/B tests
  • 14. Data-driven culture and infrastructure from the ground up Data Driven Team January 2017 Product Metrics Ad-hoc reports Reports Customer Dashboards Personalization Insights Reports Owners Revenue trends Prescriptions Insights Engineer Alerts, Errors Metrics DevOps Alerts, Errors Metrics Monitoring Data Scientist Scripts Models Marketing BI tools A/B test UX Usage Patterns A/B tests
  • 15. Data-driven culture and infrastructure from the ground up Data Driven Team January 2017 Product Metrics Ad-hoc reports Reports Customer Dashboards Personalization Insights Reports Owners Revenue trends Prescriptions Insights Engineer Alerts, Errors Metrics DevOps Alerts, Errors Metrics Monitoring Data Scientist Scripts Models Marketing BI tools A/B test UX Usage Patterns A/B tests
  • 16. Data-driven culture and infrastructure from the ground up ● Product Managers - SQL ● Engineers - Production, Product, Metrics, SOFT SKILLS ● UX - Marketing, Analytics ● Sales Engineer ● Business - BI, Reports, Metrics January 2017 New Cross Skills - Evangelism
  • 17. Data-driven culture and infrastructure from the ground up Infrastructure
  • 18. Data-driven culture and infrastructure from the ground up ● You could not just BUY it ● It’s not a Data Warehouse ● It’s not easy at all January 2017 Myths
  • 19. Data-driven culture and infrastructure from the ground up High Level January 2017 App Servers Production database Logs Storage BI Prescriptions Application Data Infrastructure Visualisation
  • 20. Data-driven culture and infrastructure from the ground up Micro January 2017 App Servers Production database Logs agg/ Papertrail Keen.io Clicdata Datadog Prometheus Application Data Infrastructure Visualisation GA
  • 21. Data-driven culture and infrastructure from the ground up Small January 2017 App Servers Production database Log agg/ Papertrail S3 Clicdata Interana Looker Datadog Prometheus Application Data Infrastructure Visualisation Slave replica
  • 22. Data-driven culture and infrastructure from the ground up Medium January 2017 App Servers Prod Log stream S3 Clicdata Interana Looker Datadog Prometheus Application Data Infrastructure Visualisation Slave replica ETL RedShift Ad-hoc SQL
  • 23. Data-driven culture and infrastructure from the ground up Medium January 2017 App Servers Prod AWS Kinesis S3 Clicdata Interana Looker Datadog Application Data Infrastructure Visualisation Slave replica AWS Lambda RedShift Ad-hoc SQL
  • 24. Data-driven culture and infrastructure from the ground up Medium January 2017 App Servers Prod Kafka S3 Clicdata Interana Looker Datadog Prometheus Application Data Infrastructure Visualisation Slave replica Spark Streaming RedShift Ad-hoc SQL
  • 25. Data-driven culture and infrastructure from the ground up Big January 2017 App Servers Prod Tableau Clicdata Interana Looker Application Data Infrastructure Visualisation Slave replica ETL/Spark/Streaming RedShift Ad-hoc SQL Hadoop/Parquet Impala Spark SQL Data Science
  • 26. www.squadex.com 125 University Avenue, Suite 290, Palo Alto, California, 94301 Questions, details? We would be happy to answer!