SlideShare a Scribd company logo
1 of 54
Download to read offline
motorola confidential
Reporting at Motorola
Predictive Analytics &
Business Insights 2014
http://www.gatewayanalyticsnetwork.com/b122-home
Dr Patrick Deglon
Director of Engineering,
Analytics Area Tech Lead
Motorola Mobility
pdeglon@motorola.com
pdeglon
motorola confidential
...
Overview of Motorola Business
About Us
Motorola exists to invent, build and deliver
the best mobile devices on the planet,
improving the lives of millions of people.
motorola confidential
Motorola
1928
“Galvin
Manufacturing
Corporation”
created, producing
battery eliminators
1940
First walkie-
talkie which
was vital to
Allied
communication
“one small step for
man, one giant leap
for mankind” through a
Motorola transceiver
1969 1973 2011 20141986
Invented six
sigma quality
improvement
process
first private handheld
mobile phone call;
world's first
commercial cellular
device
1983
world's first
handset to
combine a Linux
operating system
and Java
technology
2003
Source: Wikipedia
Motorola splits into
Motorola Mobility &
Motorola Solutions
motorola confidential
•  Business overview
•  Demos
–  Daily Activations Report
–  Moto Insights
–  Drive Insights
Agenda
motorola confidential
Daily Activations Report
How to provide a global
source of truth and start
to provide insights from
data points?
Existing Situation
- Numerous (conflicting) sources of truth
- Too many variations of same data cube
- “Table in your face” approach
- No global business definition
- No curation of manually entered data
points
- Report accessible on an internal portal
(through VPN)
- No mobile form factor
motorola confidential
Key Performance Indicators
Motorola Factory
# Shipments
Distribution Channels
# Sales
First Usage
# Activations
Simplified Business Flow
motorola confidential
Data Flow
Motorola Factory
# Shipments
Distribution Channels
# Sales
First Usage
# Activations
Google BigQuery
Motorola
Cloud
Insights
...
motorola confidential
Demo Daily Report: Final Email
motorola confidential
Google: A galaxy of open APIs and Tools…
App EngineBig Query
Compute Engine
Users Cloud Messaging
Analytics
Maps
Visualization
Data Store
Cloud Storage
Cloud SQL
Drive
Docs
Translate
Predict
Mail
Data Store
Task Queue
Memcache
URL Fetch
Cloud End Point
Channel
Java
Python
Go
Mail and many more ...
BACKUP
motorola confidential
Demo Daily Report
●  Get data (pivot) from BigQuery
●  Spreadsheet magic
●  Insights: WoW trends with statistics test, Key driver for growth, Key
milestone, internal QA tests
●  Email
●  Embedded Chart
●  Scheduler
https://docs.google.com/a/motorola.com/spreadsheet/ccc?key=0AgldkCMfisBTdF83VVJqdFVEZFZiZjgyTWJNdzRNblE&usp=drive_web#gid=21
motorola confidential
•  Assume sales follow a diffusion S-shape, i.e.
Description of the illustrative simulation
Marketing Word of mouth
ΔN
Nmax
N
•  Add random noise to theoretical daily activations
(Poisson)
•  Simulated daily activations (sales) for United States,
Canada, Brazil, India, Russia, China, Germany and
United Kingdom with various launch date per region
ΔN = a (Nmax - N) + b N (Nmax - N)
motorola confidential
Step 1: Create a backbone table
SELECT
CAL_DT,
Country
FROM
ON A.Dummy=B.Dummy
WHERE
B.CAL_DT>=A.Launch_Date
motorola.com:sandbox:demo.backbone:
INNER JOIN
(
SELECT
Country,
CASE
WHEN Country IN ('United States','Canada') THEN '2013-08-01'
WHEN Country IN ('Brazil','Russia','India','China') THEN '2013-10-01'
ELSE '2013-12-01'
END AS Launch_Date,
GDP_USD/1e7 AS Scale,
1 AS Dummy
FROM
[motorola.com:sandbox:pdeglon.countries]
WHERE
Country IN ('United States','Canada','Brazil','Russia','India',
'China','Germany','United Kingdom')
) AS B
(
SELECT
CAL_DT,
1 AS Dummy
FROM
[motorola.com:sandbox:pdeglon.calendar]
) AS A
X
BACKUP
motorola confidential
Step 2: Calculate KPI value over time
SELECT
CAL_DT,
Country,
‘Phone 123’ AS Model,
INTEGER(Scale*
EXP(-POW( -150,2)/2/POW(75,2))
/(75*SQRT(2*PI()))
) AS Daily_Activations
FROM
[motorola.com:sandbox:demo.backbone]
motorola.com:sandbox:demo.baseline:
DATEDIFF(TIMESTAMP(CAL_DT),TIMESTAMP(Launch_Date))
...
Normal Distribution:
BACKUP
motorola confidential
Step 3: Add Random Noise
SELECT
CAL_DT,
Model,
Country,
INTEGER(
Daily_Activations + SQRT(Daily_Activations) *
SQRT(-2*LN(RAND()))*COS(2*PI()*RAND())
) AS Daily_Activations
FROM
[motorola.com:sandbox:demo.baseline]
motorola.com:sandbox:demo.simulation:
Normal (Gaussian) Random Number
(mu=0, sigma=1)
(pseudo) Poisson distribution for
N=Daily_activation
BACKUP
motorola confidential
Step 4: Final Pivot for report
SELECT
CAL_DT,
SUM(Daily_Activations) AS Total,
SUM(CASE WHEN Country IN ('United States','Canada') THEN Daily_Activations ELSE 0 END) AS NA,
SUM(CASE WHEN Country IN ('Brazil','Russia','India','China') THEN Daily_Activations ELSE 0 END) AS BRIC,
SUM(CASE WHEN Country IN ('Germany','United Kingdom') THEN Daily_Activations ELSE 0 END) AS EU,
SUM(CASE WHEN Country='United States' THEN Daily_Activations ELSE 0 END) AS UnitedStates,
SUM(CASE WHEN Country='Canada' THEN Daily_Activations ELSE 0 END) AS Canada,
SUM(CASE WHEN Country='Brazil' THEN Daily_Activations ELSE 0 END) AS Brazil,
SUM(CASE WHEN Country='Russia' THEN Daily_Activations ELSE 0 END) AS Russia,
SUM(CASE WHEN Country='India' THEN Daily_Activations ELSE 0 END) AS India,
SUM(CASE WHEN Country='China' THEN Daily_Activations ELSE 0 END) AS China,
SUM(CASE WHEN Country='Germany' THEN Daily_Activations ELSE 0 END) AS Germany,
SUM(CASE WHEN Country='United Kingdom' THEN Daily_Activations ELSE 0 END) AS UnitedKingdom
FROM
[motorola.com:sandbox:demo.simulation]
WHERE
CAL_DT<CURRENT_DATE()
GROUP BY 1
ORDER BY 1 DESC
BACKUP
motorola confidential
Demo Daily Report: New Menu Item
motorola confidential
Demo Daily Report: Edit Code (App Script)
motorola confidential
Demo Daily Report:
Example for adding a new menu item
motorola confidential
Demo Daily Report: Key Query (pivot)
motorola confidential
Demo Daily Report: Running the query
motorola confidential
Demo Daily Report: Parsing the results
motorola confidential
Demo Daily Report: Data Sheet
motorola confidential
Demo Daily Report: Summary sheet
motorola confidential
Demo Daily Report: Preparing email
motorola confidential
Demo Daily Report: Email template sheet
motorola confidential
Demo Daily Report: Preparing email
motorola confidential
Demo Daily Report: Sending email
motorola confidential
Demo Daily Report: Signal vs Noise and Main Drivers
motorola confidential
Demo Daily Report: Key Milestones
motorola confidential
Demo Daily Report: Final Email
motorola confidential
Demo Daily Report: Scheduling
motorola confidential
•  Business overview
•  Demos
–  Daily Activations Report
–  Moto Insights
–  Drive Insights
Agenda
motorola confidential
Moto Insights
How to provide insights to
executive-on-the-go with a
robust system where new report
take seconds to create?
Existing Situation
- Require VPN
- New Report take weeks
- New features take
months
- Issue Tickets come
weekly
motorola confidential
Demo Moto Insights
Moto Insights
App Engine
Data Source:
Big Query
Report
Meta Data:
Datastore
Tracking:
Datastore
Users Access:
Google Users
(email) +
Datastore (role)
Moto Insights
Web portal
Moto Insights
Android App
motorola confidential
Demo Moto Insights:
Main menu & Responsive Design
responsive
design
motorola confidential
Demo Moto Insights: Report Details
motorola confidential
Demo Moto Insights: 1st Chart Details
motorola confidential
Demo Moto Insights: Chart Types
motorola confidential
Demo Moto Insights: Dummy Example
motorola confidential
•  Business overview
•  Demos
–  Daily Activations Report
–  Moto Insights
–  Drive Insights
Agenda
motorola confidential
Drive Insights
How to democratize Analytics
within the company while
maintaining quality (data &
insights) as well as maintain Big
Data usage under control?
Existing Situation
- Reports are produce by a
centralized team
- Role management is becoming out
of control
- Product teams are complaining to
have to run SQL repeatedly on
BigQuery console
motorola confidential
Demo Drive Insights (v2)
Drive Insights
App Engine
Data Source:
Big Query
Data Source:
Google Analytics
iFrame Source:
Tableau Server
iFrame Source:
Google Documents
Data Source:
Spreadsheet & CSV
Report
Meta Data:
Google Drive
(Text file with
JSON)
Report
Meta Data:
Datastore
(Report copy &
usage tracking)
Users Access
Control:
Google Users +
Drive Sharing
Google Drive
Moto Insights
Android App
Drive Insights
Web portal
motorola confidential
Demo Drive Insights: New document
type
motorola confidential
Demo Drive Insights: Report creation
motorola confidential
Demo Drive Insights: 1st Chart Details
motorola confidential
Demo Drive Insights: 2nd Chart Details
motorola confidential
Demo Drive Insights: Chart Types
motorola confidential
Demo Drive Insights: SQL Editor (CodeMirror)
motorola confidential
Demo Drive Insights:
Report document in your Google Drive
motorola confidential
Demo Drive Insights: Dummy Example
motorola confidential
Demo Drive Insights: Drive Sharing
motorola confidential
Q&A
?
Dr Patrick Deglon
Director of Engineering,
Analytics Area Tech Lead
Motorola Mobility
pdeglon@motorola.com
pdeglon
motorola confidential
In this presentation, Patrick Deglon will share his learnings and provide best
practices when using open Google tools & API. He will present his daily email
report that hundreds of key Motorola stakeholders are receiving to drive the
business, as well as a mobile solution based on the latest web technologies,
including Google Visualization, Bootstrap CSS and many of the Google APIs
(Gmail, BigQuery, Analytics, Drive, App Engine, Users authentication, etc.).
Abstract
motorola confidential
Dr Patrick Deglon
Director of Engineering,
Analytics Area Tech Lead
Motorola Mobility
With a PhD in Particle Physics, Patrick Deglon spent the last decade driving business
insights at eBay and at Motorola Mobility, a Google company.
At eBay, he led significant improvements in marketing effectiveness by developing
methods to measure incremental sales, and by running large scale experiments on
Internet marketing channels.
He joined Motorola Mobility in 2013 to help raise the bar in Analytics and on-board open
Google tools and technologies. He is now the Area Tech Lead for Analytics within the
Cloud Services organization.
He is married with two kids and enjoys his town of Campbell, CA.
Bio

More Related Content

Similar to Reporting at Motorola - Predictive analytics & business insights 2014

Highway to heaven - Microservices Meetup Dublin
Highway to heaven - Microservices Meetup DublinHighway to heaven - Microservices Meetup Dublin
Highway to heaven - Microservices Meetup DublinChristian Deger
 
Maximize Big Data ROI via Best of Breed Patterns and Practices
Maximize Big Data ROI via Best of Breed Patterns and PracticesMaximize Big Data ROI via Best of Breed Patterns and Practices
Maximize Big Data ROI via Best of Breed Patterns and PracticesJeff Bertman
 
Building Microservices in the cloud at AutoScout24
Building Microservices in the cloud at AutoScout24Building Microservices in the cloud at AutoScout24
Building Microservices in the cloud at AutoScout24Christian Deger
 
Dataiku productive application to production - pap is may 2015
Dataiku    productive application to production - pap is may 2015 Dataiku    productive application to production - pap is may 2015
Dataiku productive application to production - pap is may 2015 Dataiku
 
Data Virtualization for Data Architects (New Zealand)
Data Virtualization for Data Architects (New Zealand)Data Virtualization for Data Architects (New Zealand)
Data Virtualization for Data Architects (New Zealand)Denodo
 
AzureML Welcome to the future of Predictive Analytics
AzureML Welcome to the future of Predictive Analytics AzureML Welcome to the future of Predictive Analytics
AzureML Welcome to the future of Predictive Analytics Ruben Pertusa Lopez
 
How to PM Hardware Products by Western Digital Sr. PM
How to PM Hardware Products by Western Digital Sr. PMHow to PM Hardware Products by Western Digital Sr. PM
How to PM Hardware Products by Western Digital Sr. PMProduct School
 
Container world 2019 Canary Release
Container world 2019 Canary ReleaseContainer world 2019 Canary Release
Container world 2019 Canary ReleaseBilly Yuen
 
Whats the Use!? (Real Customer Use-Cases)
Whats the Use!? (Real Customer Use-Cases)Whats the Use!? (Real Customer Use-Cases)
Whats the Use!? (Real Customer Use-Cases)ShapeBlue
 
Serverless Data Architecture at scale on Google Cloud Platform
Serverless Data Architecture at scale on Google Cloud PlatformServerless Data Architecture at scale on Google Cloud Platform
Serverless Data Architecture at scale on Google Cloud PlatformMeetupDataScienceRoma
 
Ai based analytics in the cloud
Ai based analytics in the cloudAi based analytics in the cloud
Ai based analytics in the cloudSvetlin Stanchev
 
Optimizely's Vision for Product Development Teams
Optimizely's Vision for Product Development TeamsOptimizely's Vision for Product Development Teams
Optimizely's Vision for Product Development TeamsOptimizely
 
Nilesh Patil PLM Teamcenter manufacturing
Nilesh Patil PLM Teamcenter manufacturingNilesh Patil PLM Teamcenter manufacturing
Nilesh Patil PLM Teamcenter manufacturingNilesh Patil
 
Highway to heaven - Voxxed Days Belgrade
Highway to heaven - Voxxed Days BelgradeHighway to heaven - Voxxed Days Belgrade
Highway to heaven - Voxxed Days BelgradeChristian Deger
 
Scaling Ride-Hailing with Machine Learning on MLflow
Scaling Ride-Hailing with Machine Learning on MLflowScaling Ride-Hailing with Machine Learning on MLflow
Scaling Ride-Hailing with Machine Learning on MLflowDatabricks
 
Big data oracle_introduccion
Big data oracle_introduccionBig data oracle_introduccion
Big data oracle_introduccionFran Navarro
 
New Opportunities for Connected Data - Emil Eifrem @ GraphConnect Boston + Ch...
New Opportunities for Connected Data - Emil Eifrem @ GraphConnect Boston + Ch...New Opportunities for Connected Data - Emil Eifrem @ GraphConnect Boston + Ch...
New Opportunities for Connected Data - Emil Eifrem @ GraphConnect Boston + Ch...Neo4j
 
Supercharge your data analytics with BigQuery
Supercharge your data analytics with BigQuerySupercharge your data analytics with BigQuery
Supercharge your data analytics with BigQueryMárton Kodok
 

Similar to Reporting at Motorola - Predictive analytics & business insights 2014 (20)

Highway to heaven - Microservices Meetup Dublin
Highway to heaven - Microservices Meetup DublinHighway to heaven - Microservices Meetup Dublin
Highway to heaven - Microservices Meetup Dublin
 
Maximize Big Data ROI via Best of Breed Patterns and Practices
Maximize Big Data ROI via Best of Breed Patterns and PracticesMaximize Big Data ROI via Best of Breed Patterns and Practices
Maximize Big Data ROI via Best of Breed Patterns and Practices
 
GAURAV_MISHRA_CV
GAURAV_MISHRA_CV GAURAV_MISHRA_CV
GAURAV_MISHRA_CV
 
Building Microservices in the cloud at AutoScout24
Building Microservices in the cloud at AutoScout24Building Microservices in the cloud at AutoScout24
Building Microservices in the cloud at AutoScout24
 
Dng de-12012012
Dng de-12012012Dng de-12012012
Dng de-12012012
 
Dataiku productive application to production - pap is may 2015
Dataiku    productive application to production - pap is may 2015 Dataiku    productive application to production - pap is may 2015
Dataiku productive application to production - pap is may 2015
 
Data Virtualization for Data Architects (New Zealand)
Data Virtualization for Data Architects (New Zealand)Data Virtualization for Data Architects (New Zealand)
Data Virtualization for Data Architects (New Zealand)
 
AzureML Welcome to the future of Predictive Analytics
AzureML Welcome to the future of Predictive Analytics AzureML Welcome to the future of Predictive Analytics
AzureML Welcome to the future of Predictive Analytics
 
How to PM Hardware Products by Western Digital Sr. PM
How to PM Hardware Products by Western Digital Sr. PMHow to PM Hardware Products by Western Digital Sr. PM
How to PM Hardware Products by Western Digital Sr. PM
 
Container world 2019 Canary Release
Container world 2019 Canary ReleaseContainer world 2019 Canary Release
Container world 2019 Canary Release
 
Whats the Use!? (Real Customer Use-Cases)
Whats the Use!? (Real Customer Use-Cases)Whats the Use!? (Real Customer Use-Cases)
Whats the Use!? (Real Customer Use-Cases)
 
Serverless Data Architecture at scale on Google Cloud Platform
Serverless Data Architecture at scale on Google Cloud PlatformServerless Data Architecture at scale on Google Cloud Platform
Serverless Data Architecture at scale on Google Cloud Platform
 
Ai based analytics in the cloud
Ai based analytics in the cloudAi based analytics in the cloud
Ai based analytics in the cloud
 
Optimizely's Vision for Product Development Teams
Optimizely's Vision for Product Development TeamsOptimizely's Vision for Product Development Teams
Optimizely's Vision for Product Development Teams
 
Nilesh Patil PLM Teamcenter manufacturing
Nilesh Patil PLM Teamcenter manufacturingNilesh Patil PLM Teamcenter manufacturing
Nilesh Patil PLM Teamcenter manufacturing
 
Highway to heaven - Voxxed Days Belgrade
Highway to heaven - Voxxed Days BelgradeHighway to heaven - Voxxed Days Belgrade
Highway to heaven - Voxxed Days Belgrade
 
Scaling Ride-Hailing with Machine Learning on MLflow
Scaling Ride-Hailing with Machine Learning on MLflowScaling Ride-Hailing with Machine Learning on MLflow
Scaling Ride-Hailing with Machine Learning on MLflow
 
Big data oracle_introduccion
Big data oracle_introduccionBig data oracle_introduccion
Big data oracle_introduccion
 
New Opportunities for Connected Data - Emil Eifrem @ GraphConnect Boston + Ch...
New Opportunities for Connected Data - Emil Eifrem @ GraphConnect Boston + Ch...New Opportunities for Connected Data - Emil Eifrem @ GraphConnect Boston + Ch...
New Opportunities for Connected Data - Emil Eifrem @ GraphConnect Boston + Ch...
 
Supercharge your data analytics with BigQuery
Supercharge your data analytics with BigQuerySupercharge your data analytics with BigQuery
Supercharge your data analytics with BigQuery
 

More from Patrick Deglon

A Journey towards Self-Service Analytics
A Journey towards Self-Service AnalyticsA Journey towards Self-Service Analytics
A Journey towards Self-Service AnalyticsPatrick Deglon
 
A Journey into bringing (Artificial) Intelligence to the Enterprise
A Journey into bringing (Artificial) Intelligence to the EnterpriseA Journey into bringing (Artificial) Intelligence to the Enterprise
A Journey into bringing (Artificial) Intelligence to the EnterprisePatrick Deglon
 
Intelligence Data Day 2020
Intelligence Data Day 2020Intelligence Data Day 2020
Intelligence Data Day 2020Patrick Deglon
 
a journey in making sense of big data (part 4: Partnership and Trust)
a journey in making sense of big data (part 4: Partnership and Trust)a journey in making sense of big data (part 4: Partnership and Trust)
a journey in making sense of big data (part 4: Partnership and Trust)Patrick Deglon
 
a journey in making sense of big data (part 3: Internet Marketing)
a journey in making sense of big data (part 3: Internet Marketing)a journey in making sense of big data (part 3: Internet Marketing)
a journey in making sense of big data (part 3: Internet Marketing)Patrick Deglon
 
a journey in making sense of big data (part 2: KPI)
a journey in making sense of big data (part 2: KPI)a journey in making sense of big data (part 2: KPI)
a journey in making sense of big data (part 2: KPI)Patrick Deglon
 
a journey in making sense of big data (part 1: Big Bang)
a journey in making sense of big data (part 1: Big Bang)a journey in making sense of big data (part 1: Big Bang)
a journey in making sense of big data (part 1: Big Bang)Patrick Deglon
 
From the Big Bang to the New Economy, a journey in making sense of Big Data
From the Big Bang to the New Economy, a journey in making sense of Big DataFrom the Big Bang to the New Economy, a journey in making sense of Big Data
From the Big Bang to the New Economy, a journey in making sense of Big DataPatrick Deglon
 
Patrick Deglon Master Diploma Work - Neural Network Identification of pions, ...
Patrick Deglon Master Diploma Work - Neural Network Identification of pions, ...Patrick Deglon Master Diploma Work - Neural Network Identification of pions, ...
Patrick Deglon Master Diploma Work - Neural Network Identification of pions, ...Patrick Deglon
 
Customer Anaytics at Swiss TUG 2009
Customer Anaytics at Swiss TUG 2009Customer Anaytics at Swiss TUG 2009
Customer Anaytics at Swiss TUG 2009Patrick Deglon
 
From the Big Bang to Ecommerce, a journey in making sense of Big Data
From the Big Bang to Ecommerce, a journey in making sense of Big DataFrom the Big Bang to Ecommerce, a journey in making sense of Big Data
From the Big Bang to Ecommerce, a journey in making sense of Big DataPatrick Deglon
 

More from Patrick Deglon (12)

A Journey towards Self-Service Analytics
A Journey towards Self-Service AnalyticsA Journey towards Self-Service Analytics
A Journey towards Self-Service Analytics
 
A Journey into bringing (Artificial) Intelligence to the Enterprise
A Journey into bringing (Artificial) Intelligence to the EnterpriseA Journey into bringing (Artificial) Intelligence to the Enterprise
A Journey into bringing (Artificial) Intelligence to the Enterprise
 
Intelligence Data Day 2020
Intelligence Data Day 2020Intelligence Data Day 2020
Intelligence Data Day 2020
 
Patrick Deglon Bio
Patrick Deglon BioPatrick Deglon Bio
Patrick Deglon Bio
 
a journey in making sense of big data (part 4: Partnership and Trust)
a journey in making sense of big data (part 4: Partnership and Trust)a journey in making sense of big data (part 4: Partnership and Trust)
a journey in making sense of big data (part 4: Partnership and Trust)
 
a journey in making sense of big data (part 3: Internet Marketing)
a journey in making sense of big data (part 3: Internet Marketing)a journey in making sense of big data (part 3: Internet Marketing)
a journey in making sense of big data (part 3: Internet Marketing)
 
a journey in making sense of big data (part 2: KPI)
a journey in making sense of big data (part 2: KPI)a journey in making sense of big data (part 2: KPI)
a journey in making sense of big data (part 2: KPI)
 
a journey in making sense of big data (part 1: Big Bang)
a journey in making sense of big data (part 1: Big Bang)a journey in making sense of big data (part 1: Big Bang)
a journey in making sense of big data (part 1: Big Bang)
 
From the Big Bang to the New Economy, a journey in making sense of Big Data
From the Big Bang to the New Economy, a journey in making sense of Big DataFrom the Big Bang to the New Economy, a journey in making sense of Big Data
From the Big Bang to the New Economy, a journey in making sense of Big Data
 
Patrick Deglon Master Diploma Work - Neural Network Identification of pions, ...
Patrick Deglon Master Diploma Work - Neural Network Identification of pions, ...Patrick Deglon Master Diploma Work - Neural Network Identification of pions, ...
Patrick Deglon Master Diploma Work - Neural Network Identification of pions, ...
 
Customer Anaytics at Swiss TUG 2009
Customer Anaytics at Swiss TUG 2009Customer Anaytics at Swiss TUG 2009
Customer Anaytics at Swiss TUG 2009
 
From the Big Bang to Ecommerce, a journey in making sense of Big Data
From the Big Bang to Ecommerce, a journey in making sense of Big DataFrom the Big Bang to Ecommerce, a journey in making sense of Big Data
From the Big Bang to Ecommerce, a journey in making sense of Big Data
 

Recently uploaded

costume and set research powerpoint presentation
costume and set research powerpoint presentationcostume and set research powerpoint presentation
costume and set research powerpoint presentationphoebematthew05
 
New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024BookNet Canada
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticscarlostorres15106
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersThousandEyes
 
APIForce Zurich 5 April Automation LPDG
APIForce Zurich 5 April  Automation LPDGAPIForce Zurich 5 April  Automation LPDG
APIForce Zurich 5 April Automation LPDGMarianaLemus7
 
Artificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning eraArtificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning eraDeakin University
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Alan Dix
 
Unlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power SystemsUnlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power SystemsPrecisely
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...Fwdays
 
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024BookNet Canada
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
Benefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksBenefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksSoftradix Technologies
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machinePadma Pradeep
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 

Recently uploaded (20)

costume and set research powerpoint presentation
costume and set research powerpoint presentationcostume and set research powerpoint presentation
costume and set research powerpoint presentation
 
New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
 
Vulnerability_Management_GRC_by Sohang Sengupta.pptx
Vulnerability_Management_GRC_by Sohang Sengupta.pptxVulnerability_Management_GRC_by Sohang Sengupta.pptx
Vulnerability_Management_GRC_by Sohang Sengupta.pptx
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
 
APIForce Zurich 5 April Automation LPDG
APIForce Zurich 5 April  Automation LPDGAPIForce Zurich 5 April  Automation LPDG
APIForce Zurich 5 April Automation LPDG
 
Artificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning eraArtificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning era
 
The transition to renewables in India.pdf
The transition to renewables in India.pdfThe transition to renewables in India.pdf
The transition to renewables in India.pdf
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
 
Unlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power SystemsUnlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power Systems
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
 
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
Benefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksBenefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other Frameworks
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machine
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 

Reporting at Motorola - Predictive analytics & business insights 2014

  • 1. motorola confidential Reporting at Motorola Predictive Analytics & Business Insights 2014 http://www.gatewayanalyticsnetwork.com/b122-home Dr Patrick Deglon Director of Engineering, Analytics Area Tech Lead Motorola Mobility pdeglon@motorola.com pdeglon
  • 2. motorola confidential ... Overview of Motorola Business About Us Motorola exists to invent, build and deliver the best mobile devices on the planet, improving the lives of millions of people.
  • 3. motorola confidential Motorola 1928 “Galvin Manufacturing Corporation” created, producing battery eliminators 1940 First walkie- talkie which was vital to Allied communication “one small step for man, one giant leap for mankind” through a Motorola transceiver 1969 1973 2011 20141986 Invented six sigma quality improvement process first private handheld mobile phone call; world's first commercial cellular device 1983 world's first handset to combine a Linux operating system and Java technology 2003 Source: Wikipedia Motorola splits into Motorola Mobility & Motorola Solutions
  • 4. motorola confidential •  Business overview •  Demos –  Daily Activations Report –  Moto Insights –  Drive Insights Agenda
  • 5. motorola confidential Daily Activations Report How to provide a global source of truth and start to provide insights from data points? Existing Situation - Numerous (conflicting) sources of truth - Too many variations of same data cube - “Table in your face” approach - No global business definition - No curation of manually entered data points - Report accessible on an internal portal (through VPN) - No mobile form factor
  • 6. motorola confidential Key Performance Indicators Motorola Factory # Shipments Distribution Channels # Sales First Usage # Activations Simplified Business Flow
  • 7. motorola confidential Data Flow Motorola Factory # Shipments Distribution Channels # Sales First Usage # Activations Google BigQuery Motorola Cloud Insights ...
  • 8. motorola confidential Demo Daily Report: Final Email
  • 9. motorola confidential Google: A galaxy of open APIs and Tools… App EngineBig Query Compute Engine Users Cloud Messaging Analytics Maps Visualization Data Store Cloud Storage Cloud SQL Drive Docs Translate Predict Mail Data Store Task Queue Memcache URL Fetch Cloud End Point Channel Java Python Go Mail and many more ... BACKUP
  • 10. motorola confidential Demo Daily Report ●  Get data (pivot) from BigQuery ●  Spreadsheet magic ●  Insights: WoW trends with statistics test, Key driver for growth, Key milestone, internal QA tests ●  Email ●  Embedded Chart ●  Scheduler https://docs.google.com/a/motorola.com/spreadsheet/ccc?key=0AgldkCMfisBTdF83VVJqdFVEZFZiZjgyTWJNdzRNblE&usp=drive_web#gid=21
  • 11. motorola confidential •  Assume sales follow a diffusion S-shape, i.e. Description of the illustrative simulation Marketing Word of mouth ΔN Nmax N •  Add random noise to theoretical daily activations (Poisson) •  Simulated daily activations (sales) for United States, Canada, Brazil, India, Russia, China, Germany and United Kingdom with various launch date per region ΔN = a (Nmax - N) + b N (Nmax - N)
  • 12. motorola confidential Step 1: Create a backbone table SELECT CAL_DT, Country FROM ON A.Dummy=B.Dummy WHERE B.CAL_DT>=A.Launch_Date motorola.com:sandbox:demo.backbone: INNER JOIN ( SELECT Country, CASE WHEN Country IN ('United States','Canada') THEN '2013-08-01' WHEN Country IN ('Brazil','Russia','India','China') THEN '2013-10-01' ELSE '2013-12-01' END AS Launch_Date, GDP_USD/1e7 AS Scale, 1 AS Dummy FROM [motorola.com:sandbox:pdeglon.countries] WHERE Country IN ('United States','Canada','Brazil','Russia','India', 'China','Germany','United Kingdom') ) AS B ( SELECT CAL_DT, 1 AS Dummy FROM [motorola.com:sandbox:pdeglon.calendar] ) AS A X BACKUP
  • 13. motorola confidential Step 2: Calculate KPI value over time SELECT CAL_DT, Country, ‘Phone 123’ AS Model, INTEGER(Scale* EXP(-POW( -150,2)/2/POW(75,2)) /(75*SQRT(2*PI())) ) AS Daily_Activations FROM [motorola.com:sandbox:demo.backbone] motorola.com:sandbox:demo.baseline: DATEDIFF(TIMESTAMP(CAL_DT),TIMESTAMP(Launch_Date)) ... Normal Distribution: BACKUP
  • 14. motorola confidential Step 3: Add Random Noise SELECT CAL_DT, Model, Country, INTEGER( Daily_Activations + SQRT(Daily_Activations) * SQRT(-2*LN(RAND()))*COS(2*PI()*RAND()) ) AS Daily_Activations FROM [motorola.com:sandbox:demo.baseline] motorola.com:sandbox:demo.simulation: Normal (Gaussian) Random Number (mu=0, sigma=1) (pseudo) Poisson distribution for N=Daily_activation BACKUP
  • 15. motorola confidential Step 4: Final Pivot for report SELECT CAL_DT, SUM(Daily_Activations) AS Total, SUM(CASE WHEN Country IN ('United States','Canada') THEN Daily_Activations ELSE 0 END) AS NA, SUM(CASE WHEN Country IN ('Brazil','Russia','India','China') THEN Daily_Activations ELSE 0 END) AS BRIC, SUM(CASE WHEN Country IN ('Germany','United Kingdom') THEN Daily_Activations ELSE 0 END) AS EU, SUM(CASE WHEN Country='United States' THEN Daily_Activations ELSE 0 END) AS UnitedStates, SUM(CASE WHEN Country='Canada' THEN Daily_Activations ELSE 0 END) AS Canada, SUM(CASE WHEN Country='Brazil' THEN Daily_Activations ELSE 0 END) AS Brazil, SUM(CASE WHEN Country='Russia' THEN Daily_Activations ELSE 0 END) AS Russia, SUM(CASE WHEN Country='India' THEN Daily_Activations ELSE 0 END) AS India, SUM(CASE WHEN Country='China' THEN Daily_Activations ELSE 0 END) AS China, SUM(CASE WHEN Country='Germany' THEN Daily_Activations ELSE 0 END) AS Germany, SUM(CASE WHEN Country='United Kingdom' THEN Daily_Activations ELSE 0 END) AS UnitedKingdom FROM [motorola.com:sandbox:demo.simulation] WHERE CAL_DT<CURRENT_DATE() GROUP BY 1 ORDER BY 1 DESC BACKUP
  • 16. motorola confidential Demo Daily Report: New Menu Item
  • 17. motorola confidential Demo Daily Report: Edit Code (App Script)
  • 18. motorola confidential Demo Daily Report: Example for adding a new menu item
  • 19. motorola confidential Demo Daily Report: Key Query (pivot)
  • 20. motorola confidential Demo Daily Report: Running the query
  • 21. motorola confidential Demo Daily Report: Parsing the results
  • 22. motorola confidential Demo Daily Report: Data Sheet
  • 23. motorola confidential Demo Daily Report: Summary sheet
  • 24. motorola confidential Demo Daily Report: Preparing email
  • 25. motorola confidential Demo Daily Report: Email template sheet
  • 26. motorola confidential Demo Daily Report: Preparing email
  • 27. motorola confidential Demo Daily Report: Sending email
  • 28. motorola confidential Demo Daily Report: Signal vs Noise and Main Drivers
  • 29. motorola confidential Demo Daily Report: Key Milestones
  • 30. motorola confidential Demo Daily Report: Final Email
  • 31. motorola confidential Demo Daily Report: Scheduling
  • 32. motorola confidential •  Business overview •  Demos –  Daily Activations Report –  Moto Insights –  Drive Insights Agenda
  • 33. motorola confidential Moto Insights How to provide insights to executive-on-the-go with a robust system where new report take seconds to create? Existing Situation - Require VPN - New Report take weeks - New features take months - Issue Tickets come weekly
  • 34. motorola confidential Demo Moto Insights Moto Insights App Engine Data Source: Big Query Report Meta Data: Datastore Tracking: Datastore Users Access: Google Users (email) + Datastore (role) Moto Insights Web portal Moto Insights Android App
  • 35. motorola confidential Demo Moto Insights: Main menu & Responsive Design responsive design
  • 36. motorola confidential Demo Moto Insights: Report Details
  • 37. motorola confidential Demo Moto Insights: 1st Chart Details
  • 38. motorola confidential Demo Moto Insights: Chart Types
  • 39. motorola confidential Demo Moto Insights: Dummy Example
  • 40. motorola confidential •  Business overview •  Demos –  Daily Activations Report –  Moto Insights –  Drive Insights Agenda
  • 41. motorola confidential Drive Insights How to democratize Analytics within the company while maintaining quality (data & insights) as well as maintain Big Data usage under control? Existing Situation - Reports are produce by a centralized team - Role management is becoming out of control - Product teams are complaining to have to run SQL repeatedly on BigQuery console
  • 42. motorola confidential Demo Drive Insights (v2) Drive Insights App Engine Data Source: Big Query Data Source: Google Analytics iFrame Source: Tableau Server iFrame Source: Google Documents Data Source: Spreadsheet & CSV Report Meta Data: Google Drive (Text file with JSON) Report Meta Data: Datastore (Report copy & usage tracking) Users Access Control: Google Users + Drive Sharing Google Drive Moto Insights Android App Drive Insights Web portal
  • 43. motorola confidential Demo Drive Insights: New document type
  • 44. motorola confidential Demo Drive Insights: Report creation
  • 45. motorola confidential Demo Drive Insights: 1st Chart Details
  • 46. motorola confidential Demo Drive Insights: 2nd Chart Details
  • 47. motorola confidential Demo Drive Insights: Chart Types
  • 48. motorola confidential Demo Drive Insights: SQL Editor (CodeMirror)
  • 49. motorola confidential Demo Drive Insights: Report document in your Google Drive
  • 50. motorola confidential Demo Drive Insights: Dummy Example
  • 51. motorola confidential Demo Drive Insights: Drive Sharing
  • 52. motorola confidential Q&A ? Dr Patrick Deglon Director of Engineering, Analytics Area Tech Lead Motorola Mobility pdeglon@motorola.com pdeglon
  • 53. motorola confidential In this presentation, Patrick Deglon will share his learnings and provide best practices when using open Google tools & API. He will present his daily email report that hundreds of key Motorola stakeholders are receiving to drive the business, as well as a mobile solution based on the latest web technologies, including Google Visualization, Bootstrap CSS and many of the Google APIs (Gmail, BigQuery, Analytics, Drive, App Engine, Users authentication, etc.). Abstract
  • 54. motorola confidential Dr Patrick Deglon Director of Engineering, Analytics Area Tech Lead Motorola Mobility With a PhD in Particle Physics, Patrick Deglon spent the last decade driving business insights at eBay and at Motorola Mobility, a Google company. At eBay, he led significant improvements in marketing effectiveness by developing methods to measure incremental sales, and by running large scale experiments on Internet marketing channels. He joined Motorola Mobility in 2013 to help raise the bar in Analytics and on-board open Google tools and technologies. He is now the Area Tech Lead for Analytics within the Cloud Services organization. He is married with two kids and enjoys his town of Campbell, CA. Bio