SlideShare a Scribd company logo
motorola confidential
Reporting at Motorola
Predictive Analytics &
Business Insights 2014
http://www.gatewayanalyticsnetwork.com/b122-home
Dr Patrick Deglon
Director of Engineering,
Analytics Area Tech Lead
Motorola Mobility
pdeglon@motorola.com
pdeglon
motorola confidential
...
Overview of Motorola Business
About Us
Motorola exists to invent, build and deliver
the best mobile devices on the planet,
improving the lives of millions of people.
motorola confidential
Motorola
1928
“Galvin
Manufacturing
Corporation”
created, producing
battery eliminators
1940
First walkie-
talkie which
was vital to
Allied
communication
“one small step for
man, one giant leap
for mankind” through a
Motorola transceiver
1969 1973 2011 20141986
Invented six
sigma quality
improvement
process
first private handheld
mobile phone call;
world's first
commercial cellular
device
1983
world's first
handset to
combine a Linux
operating system
and Java
technology
2003
Source: Wikipedia
Motorola splits into
Motorola Mobility &
Motorola Solutions
motorola confidential
•  Business overview
•  Demos
–  Daily Activations Report
–  Moto Insights
–  Drive Insights
Agenda
motorola confidential
Daily Activations Report
How to provide a global
source of truth and start
to provide insights from
data points?
Existing Situation
- Numerous (conflicting) sources of truth
- Too many variations of same data cube
- “Table in your face” approach
- No global business definition
- No curation of manually entered data
points
- Report accessible on an internal portal
(through VPN)
- No mobile form factor
motorola confidential
Key Performance Indicators
Motorola Factory
# Shipments
Distribution Channels
# Sales
First Usage
# Activations
Simplified Business Flow
motorola confidential
Data Flow
Motorola Factory
# Shipments
Distribution Channels
# Sales
First Usage
# Activations
Google BigQuery
Motorola
Cloud
Insights
...
motorola confidential
Demo Daily Report: Final Email
motorola confidential
Google: A galaxy of open APIs and Tools…
App EngineBig Query
Compute Engine
Users Cloud Messaging
Analytics
Maps
Visualization
Data Store
Cloud Storage
Cloud SQL
Drive
Docs
Translate
Predict
Mail
Data Store
Task Queue
Memcache
URL Fetch
Cloud End Point
Channel
Java
Python
Go
Mail and many more ...
BACKUP
motorola confidential
Demo Daily Report
●  Get data (pivot) from BigQuery
●  Spreadsheet magic
●  Insights: WoW trends with statistics test, Key driver for growth, Key
milestone, internal QA tests
●  Email
●  Embedded Chart
●  Scheduler
https://docs.google.com/a/motorola.com/spreadsheet/ccc?key=0AgldkCMfisBTdF83VVJqdFVEZFZiZjgyTWJNdzRNblE&usp=drive_web#gid=21
motorola confidential
•  Assume sales follow a diffusion S-shape, i.e.
Description of the illustrative simulation
Marketing Word of mouth
ΔN
Nmax
N
•  Add random noise to theoretical daily activations
(Poisson)
•  Simulated daily activations (sales) for United States,
Canada, Brazil, India, Russia, China, Germany and
United Kingdom with various launch date per region
ΔN = a (Nmax - N) + b N (Nmax - N)
motorola confidential
Step 1: Create a backbone table
SELECT
CAL_DT,
Country
FROM
ON A.Dummy=B.Dummy
WHERE
B.CAL_DT>=A.Launch_Date
motorola.com:sandbox:demo.backbone:
INNER JOIN
(
SELECT
Country,
CASE
WHEN Country IN ('United States','Canada') THEN '2013-08-01'
WHEN Country IN ('Brazil','Russia','India','China') THEN '2013-10-01'
ELSE '2013-12-01'
END AS Launch_Date,
GDP_USD/1e7 AS Scale,
1 AS Dummy
FROM
[motorola.com:sandbox:pdeglon.countries]
WHERE
Country IN ('United States','Canada','Brazil','Russia','India',
'China','Germany','United Kingdom')
) AS B
(
SELECT
CAL_DT,
1 AS Dummy
FROM
[motorola.com:sandbox:pdeglon.calendar]
) AS A
X
BACKUP
motorola confidential
Step 2: Calculate KPI value over time
SELECT
CAL_DT,
Country,
‘Phone 123’ AS Model,
INTEGER(Scale*
EXP(-POW( -150,2)/2/POW(75,2))
/(75*SQRT(2*PI()))
) AS Daily_Activations
FROM
[motorola.com:sandbox:demo.backbone]
motorola.com:sandbox:demo.baseline:
DATEDIFF(TIMESTAMP(CAL_DT),TIMESTAMP(Launch_Date))
...
Normal Distribution:
BACKUP
motorola confidential
Step 3: Add Random Noise
SELECT
CAL_DT,
Model,
Country,
INTEGER(
Daily_Activations + SQRT(Daily_Activations) *
SQRT(-2*LN(RAND()))*COS(2*PI()*RAND())
) AS Daily_Activations
FROM
[motorola.com:sandbox:demo.baseline]
motorola.com:sandbox:demo.simulation:
Normal (Gaussian) Random Number
(mu=0, sigma=1)
(pseudo) Poisson distribution for
N=Daily_activation
BACKUP
motorola confidential
Step 4: Final Pivot for report
SELECT
CAL_DT,
SUM(Daily_Activations) AS Total,
SUM(CASE WHEN Country IN ('United States','Canada') THEN Daily_Activations ELSE 0 END) AS NA,
SUM(CASE WHEN Country IN ('Brazil','Russia','India','China') THEN Daily_Activations ELSE 0 END) AS BRIC,
SUM(CASE WHEN Country IN ('Germany','United Kingdom') THEN Daily_Activations ELSE 0 END) AS EU,
SUM(CASE WHEN Country='United States' THEN Daily_Activations ELSE 0 END) AS UnitedStates,
SUM(CASE WHEN Country='Canada' THEN Daily_Activations ELSE 0 END) AS Canada,
SUM(CASE WHEN Country='Brazil' THEN Daily_Activations ELSE 0 END) AS Brazil,
SUM(CASE WHEN Country='Russia' THEN Daily_Activations ELSE 0 END) AS Russia,
SUM(CASE WHEN Country='India' THEN Daily_Activations ELSE 0 END) AS India,
SUM(CASE WHEN Country='China' THEN Daily_Activations ELSE 0 END) AS China,
SUM(CASE WHEN Country='Germany' THEN Daily_Activations ELSE 0 END) AS Germany,
SUM(CASE WHEN Country='United Kingdom' THEN Daily_Activations ELSE 0 END) AS UnitedKingdom
FROM
[motorola.com:sandbox:demo.simulation]
WHERE
CAL_DT<CURRENT_DATE()
GROUP BY 1
ORDER BY 1 DESC
BACKUP
motorola confidential
Demo Daily Report: New Menu Item
motorola confidential
Demo Daily Report: Edit Code (App Script)
motorola confidential
Demo Daily Report:
Example for adding a new menu item
motorola confidential
Demo Daily Report: Key Query (pivot)
motorola confidential
Demo Daily Report: Running the query
motorola confidential
Demo Daily Report: Parsing the results
motorola confidential
Demo Daily Report: Data Sheet
motorola confidential
Demo Daily Report: Summary sheet
motorola confidential
Demo Daily Report: Preparing email
motorola confidential
Demo Daily Report: Email template sheet
motorola confidential
Demo Daily Report: Preparing email
motorola confidential
Demo Daily Report: Sending email
motorola confidential
Demo Daily Report: Signal vs Noise and Main Drivers
motorola confidential
Demo Daily Report: Key Milestones
motorola confidential
Demo Daily Report: Final Email
motorola confidential
Demo Daily Report: Scheduling
motorola confidential
•  Business overview
•  Demos
–  Daily Activations Report
–  Moto Insights
–  Drive Insights
Agenda
motorola confidential
Moto Insights
How to provide insights to
executive-on-the-go with a
robust system where new report
take seconds to create?
Existing Situation
- Require VPN
- New Report take weeks
- New features take
months
- Issue Tickets come
weekly
motorola confidential
Demo Moto Insights
Moto Insights
App Engine
Data Source:
Big Query
Report
Meta Data:
Datastore
Tracking:
Datastore
Users Access:
Google Users
(email) +
Datastore (role)
Moto Insights
Web portal
Moto Insights
Android App
motorola confidential
Demo Moto Insights:
Main menu & Responsive Design
responsive
design
motorola confidential
Demo Moto Insights: Report Details
motorola confidential
Demo Moto Insights: 1st Chart Details
motorola confidential
Demo Moto Insights: Chart Types
motorola confidential
Demo Moto Insights: Dummy Example
motorola confidential
•  Business overview
•  Demos
–  Daily Activations Report
–  Moto Insights
–  Drive Insights
Agenda
motorola confidential
Drive Insights
How to democratize Analytics
within the company while
maintaining quality (data &
insights) as well as maintain Big
Data usage under control?
Existing Situation
- Reports are produce by a
centralized team
- Role management is becoming out
of control
- Product teams are complaining to
have to run SQL repeatedly on
BigQuery console
motorola confidential
Demo Drive Insights (v2)
Drive Insights
App Engine
Data Source:
Big Query
Data Source:
Google Analytics
iFrame Source:
Tableau Server
iFrame Source:
Google Documents
Data Source:
Spreadsheet & CSV
Report
Meta Data:
Google Drive
(Text file with
JSON)
Report
Meta Data:
Datastore
(Report copy &
usage tracking)
Users Access
Control:
Google Users +
Drive Sharing
Google Drive
Moto Insights
Android App
Drive Insights
Web portal
motorola confidential
Demo Drive Insights: New document
type
motorola confidential
Demo Drive Insights: Report creation
motorola confidential
Demo Drive Insights: 1st Chart Details
motorola confidential
Demo Drive Insights: 2nd Chart Details
motorola confidential
Demo Drive Insights: Chart Types
motorola confidential
Demo Drive Insights: SQL Editor (CodeMirror)
motorola confidential
Demo Drive Insights:
Report document in your Google Drive
motorola confidential
Demo Drive Insights: Dummy Example
motorola confidential
Demo Drive Insights: Drive Sharing
motorola confidential
Q&A
?
Dr Patrick Deglon
Director of Engineering,
Analytics Area Tech Lead
Motorola Mobility
pdeglon@motorola.com
pdeglon
motorola confidential
In this presentation, Patrick Deglon will share his learnings and provide best
practices when using open Google tools & API. He will present his daily email
report that hundreds of key Motorola stakeholders are receiving to drive the
business, as well as a mobile solution based on the latest web technologies,
including Google Visualization, Bootstrap CSS and many of the Google APIs
(Gmail, BigQuery, Analytics, Drive, App Engine, Users authentication, etc.).
Abstract
motorola confidential
Dr Patrick Deglon
Director of Engineering,
Analytics Area Tech Lead
Motorola Mobility
With a PhD in Particle Physics, Patrick Deglon spent the last decade driving business
insights at eBay and at Motorola Mobility, a Google company.
At eBay, he led significant improvements in marketing effectiveness by developing
methods to measure incremental sales, and by running large scale experiments on
Internet marketing channels.
He joined Motorola Mobility in 2013 to help raise the bar in Analytics and on-board open
Google tools and technologies. He is now the Area Tech Lead for Analytics within the
Cloud Services organization.
He is married with two kids and enjoys his town of Campbell, CA.
Bio

More Related Content

Similar to Reporting at Motorola - Predictive analytics & business insights 2014

Highway to heaven - Microservices Meetup Dublin
Highway to heaven - Microservices Meetup DublinHighway to heaven - Microservices Meetup Dublin
Highway to heaven - Microservices Meetup Dublin
Christian Deger
 
Maximize Big Data ROI via Best of Breed Patterns and Practices
Maximize Big Data ROI via Best of Breed Patterns and PracticesMaximize Big Data ROI via Best of Breed Patterns and Practices
Maximize Big Data ROI via Best of Breed Patterns and Practices
Jeff Bertman
 
Building Microservices in the cloud at AutoScout24
Building Microservices in the cloud at AutoScout24Building Microservices in the cloud at AutoScout24
Building Microservices in the cloud at AutoScout24
Christian Deger
 
Dng de-12012012
Dng de-12012012Dng de-12012012
Dng de-12012012
Joshua Amoako
 
Dataiku productive application to production - pap is may 2015
Dataiku    productive application to production - pap is may 2015 Dataiku    productive application to production - pap is may 2015
Dataiku productive application to production - pap is may 2015
Dataiku
 
Data Virtualization for Data Architects (New Zealand)
Data Virtualization for Data Architects (New Zealand)Data Virtualization for Data Architects (New Zealand)
Data Virtualization for Data Architects (New Zealand)
Denodo
 
AzureML Welcome to the future of Predictive Analytics
AzureML Welcome to the future of Predictive Analytics AzureML Welcome to the future of Predictive Analytics
AzureML Welcome to the future of Predictive Analytics
Ruben Pertusa Lopez
 
How to PM Hardware Products by Western Digital Sr. PM
How to PM Hardware Products by Western Digital Sr. PMHow to PM Hardware Products by Western Digital Sr. PM
How to PM Hardware Products by Western Digital Sr. PM
Product School
 
Container world 2019 Canary Release
Container world 2019 Canary ReleaseContainer world 2019 Canary Release
Container world 2019 Canary Release
Billy Yuen
 
Whats the Use!? (Real Customer Use-Cases)
Whats the Use!? (Real Customer Use-Cases)Whats the Use!? (Real Customer Use-Cases)
Whats the Use!? (Real Customer Use-Cases)
ShapeBlue
 
Serverless Data Architecture at scale on Google Cloud Platform
Serverless Data Architecture at scale on Google Cloud PlatformServerless Data Architecture at scale on Google Cloud Platform
Serverless Data Architecture at scale on Google Cloud Platform
MeetupDataScienceRoma
 
Ai based analytics in the cloud
Ai based analytics in the cloudAi based analytics in the cloud
Ai based analytics in the cloud
Svetlin Stanchev
 
Optimizely's Vision for Product Development Teams
Optimizely's Vision for Product Development TeamsOptimizely's Vision for Product Development Teams
Optimizely's Vision for Product Development Teams
Optimizely
 
Nilesh Patil PLM Teamcenter manufacturing
Nilesh Patil PLM Teamcenter manufacturingNilesh Patil PLM Teamcenter manufacturing
Nilesh Patil PLM Teamcenter manufacturing
Nilesh Patil
 
Highway to heaven - Voxxed Days Belgrade
Highway to heaven - Voxxed Days BelgradeHighway to heaven - Voxxed Days Belgrade
Highway to heaven - Voxxed Days Belgrade
Christian Deger
 
Scaling Ride-Hailing with Machine Learning on MLflow
Scaling Ride-Hailing with Machine Learning on MLflowScaling Ride-Hailing with Machine Learning on MLflow
Scaling Ride-Hailing with Machine Learning on MLflow
Databricks
 
Big data oracle_introduccion
Big data oracle_introduccionBig data oracle_introduccion
Big data oracle_introduccion
Fran Navarro
 
New Opportunities for Connected Data - Emil Eifrem @ GraphConnect Boston + Ch...
New Opportunities for Connected Data - Emil Eifrem @ GraphConnect Boston + Ch...New Opportunities for Connected Data - Emil Eifrem @ GraphConnect Boston + Ch...
New Opportunities for Connected Data - Emil Eifrem @ GraphConnect Boston + Ch...
Neo4j
 
Supercharge your data analytics with BigQuery
Supercharge your data analytics with BigQuerySupercharge your data analytics with BigQuery
Supercharge your data analytics with BigQuery
Márton Kodok
 

Similar to Reporting at Motorola - Predictive analytics & business insights 2014 (20)

Highway to heaven - Microservices Meetup Dublin
Highway to heaven - Microservices Meetup DublinHighway to heaven - Microservices Meetup Dublin
Highway to heaven - Microservices Meetup Dublin
 
Maximize Big Data ROI via Best of Breed Patterns and Practices
Maximize Big Data ROI via Best of Breed Patterns and PracticesMaximize Big Data ROI via Best of Breed Patterns and Practices
Maximize Big Data ROI via Best of Breed Patterns and Practices
 
GAURAV_MISHRA_CV
GAURAV_MISHRA_CV GAURAV_MISHRA_CV
GAURAV_MISHRA_CV
 
Building Microservices in the cloud at AutoScout24
Building Microservices in the cloud at AutoScout24Building Microservices in the cloud at AutoScout24
Building Microservices in the cloud at AutoScout24
 
Dng de-12012012
Dng de-12012012Dng de-12012012
Dng de-12012012
 
Dataiku productive application to production - pap is may 2015
Dataiku    productive application to production - pap is may 2015 Dataiku    productive application to production - pap is may 2015
Dataiku productive application to production - pap is may 2015
 
Data Virtualization for Data Architects (New Zealand)
Data Virtualization for Data Architects (New Zealand)Data Virtualization for Data Architects (New Zealand)
Data Virtualization for Data Architects (New Zealand)
 
AzureML Welcome to the future of Predictive Analytics
AzureML Welcome to the future of Predictive Analytics AzureML Welcome to the future of Predictive Analytics
AzureML Welcome to the future of Predictive Analytics
 
How to PM Hardware Products by Western Digital Sr. PM
How to PM Hardware Products by Western Digital Sr. PMHow to PM Hardware Products by Western Digital Sr. PM
How to PM Hardware Products by Western Digital Sr. PM
 
Container world 2019 Canary Release
Container world 2019 Canary ReleaseContainer world 2019 Canary Release
Container world 2019 Canary Release
 
Whats the Use!? (Real Customer Use-Cases)
Whats the Use!? (Real Customer Use-Cases)Whats the Use!? (Real Customer Use-Cases)
Whats the Use!? (Real Customer Use-Cases)
 
Serverless Data Architecture at scale on Google Cloud Platform
Serverless Data Architecture at scale on Google Cloud PlatformServerless Data Architecture at scale on Google Cloud Platform
Serverless Data Architecture at scale on Google Cloud Platform
 
Ai based analytics in the cloud
Ai based analytics in the cloudAi based analytics in the cloud
Ai based analytics in the cloud
 
Optimizely's Vision for Product Development Teams
Optimizely's Vision for Product Development TeamsOptimizely's Vision for Product Development Teams
Optimizely's Vision for Product Development Teams
 
Nilesh Patil PLM Teamcenter manufacturing
Nilesh Patil PLM Teamcenter manufacturingNilesh Patil PLM Teamcenter manufacturing
Nilesh Patil PLM Teamcenter manufacturing
 
Highway to heaven - Voxxed Days Belgrade
Highway to heaven - Voxxed Days BelgradeHighway to heaven - Voxxed Days Belgrade
Highway to heaven - Voxxed Days Belgrade
 
Scaling Ride-Hailing with Machine Learning on MLflow
Scaling Ride-Hailing with Machine Learning on MLflowScaling Ride-Hailing with Machine Learning on MLflow
Scaling Ride-Hailing with Machine Learning on MLflow
 
Big data oracle_introduccion
Big data oracle_introduccionBig data oracle_introduccion
Big data oracle_introduccion
 
New Opportunities for Connected Data - Emil Eifrem @ GraphConnect Boston + Ch...
New Opportunities for Connected Data - Emil Eifrem @ GraphConnect Boston + Ch...New Opportunities for Connected Data - Emil Eifrem @ GraphConnect Boston + Ch...
New Opportunities for Connected Data - Emil Eifrem @ GraphConnect Boston + Ch...
 
Supercharge your data analytics with BigQuery
Supercharge your data analytics with BigQuerySupercharge your data analytics with BigQuery
Supercharge your data analytics with BigQuery
 

More from Patrick Deglon

A Journey towards Self-Service Analytics
A Journey towards Self-Service AnalyticsA Journey towards Self-Service Analytics
A Journey towards Self-Service Analytics
Patrick Deglon
 
A Journey into bringing (Artificial) Intelligence to the Enterprise
A Journey into bringing (Artificial) Intelligence to the EnterpriseA Journey into bringing (Artificial) Intelligence to the Enterprise
A Journey into bringing (Artificial) Intelligence to the Enterprise
Patrick Deglon
 
Intelligence Data Day 2020
Intelligence Data Day 2020Intelligence Data Day 2020
Intelligence Data Day 2020
Patrick Deglon
 
a journey in making sense of big data (part 4: Partnership and Trust)
a journey in making sense of big data (part 4: Partnership and Trust)a journey in making sense of big data (part 4: Partnership and Trust)
a journey in making sense of big data (part 4: Partnership and Trust)
Patrick Deglon
 
a journey in making sense of big data (part 3: Internet Marketing)
a journey in making sense of big data (part 3: Internet Marketing)a journey in making sense of big data (part 3: Internet Marketing)
a journey in making sense of big data (part 3: Internet Marketing)
Patrick Deglon
 
a journey in making sense of big data (part 2: KPI)
a journey in making sense of big data (part 2: KPI)a journey in making sense of big data (part 2: KPI)
a journey in making sense of big data (part 2: KPI)
Patrick Deglon
 
a journey in making sense of big data (part 1: Big Bang)
a journey in making sense of big data (part 1: Big Bang)a journey in making sense of big data (part 1: Big Bang)
a journey in making sense of big data (part 1: Big Bang)
Patrick Deglon
 
From the Big Bang to the New Economy, a journey in making sense of Big Data
From the Big Bang to the New Economy, a journey in making sense of Big DataFrom the Big Bang to the New Economy, a journey in making sense of Big Data
From the Big Bang to the New Economy, a journey in making sense of Big DataPatrick Deglon
 
Patrick Deglon Master Diploma Work - Neural Network Identification of pions, ...
Patrick Deglon Master Diploma Work - Neural Network Identification of pions, ...Patrick Deglon Master Diploma Work - Neural Network Identification of pions, ...
Patrick Deglon Master Diploma Work - Neural Network Identification of pions, ...Patrick Deglon
 
Customer Anaytics at Swiss TUG 2009
Customer Anaytics at Swiss TUG 2009Customer Anaytics at Swiss TUG 2009
Customer Anaytics at Swiss TUG 2009Patrick Deglon
 
From the Big Bang to Ecommerce, a journey in making sense of Big Data
From the Big Bang to Ecommerce, a journey in making sense of Big DataFrom the Big Bang to Ecommerce, a journey in making sense of Big Data
From the Big Bang to Ecommerce, a journey in making sense of Big Data
Patrick Deglon
 

More from Patrick Deglon (12)

A Journey towards Self-Service Analytics
A Journey towards Self-Service AnalyticsA Journey towards Self-Service Analytics
A Journey towards Self-Service Analytics
 
A Journey into bringing (Artificial) Intelligence to the Enterprise
A Journey into bringing (Artificial) Intelligence to the EnterpriseA Journey into bringing (Artificial) Intelligence to the Enterprise
A Journey into bringing (Artificial) Intelligence to the Enterprise
 
Intelligence Data Day 2020
Intelligence Data Day 2020Intelligence Data Day 2020
Intelligence Data Day 2020
 
Patrick Deglon Bio
Patrick Deglon BioPatrick Deglon Bio
Patrick Deglon Bio
 
a journey in making sense of big data (part 4: Partnership and Trust)
a journey in making sense of big data (part 4: Partnership and Trust)a journey in making sense of big data (part 4: Partnership and Trust)
a journey in making sense of big data (part 4: Partnership and Trust)
 
a journey in making sense of big data (part 3: Internet Marketing)
a journey in making sense of big data (part 3: Internet Marketing)a journey in making sense of big data (part 3: Internet Marketing)
a journey in making sense of big data (part 3: Internet Marketing)
 
a journey in making sense of big data (part 2: KPI)
a journey in making sense of big data (part 2: KPI)a journey in making sense of big data (part 2: KPI)
a journey in making sense of big data (part 2: KPI)
 
a journey in making sense of big data (part 1: Big Bang)
a journey in making sense of big data (part 1: Big Bang)a journey in making sense of big data (part 1: Big Bang)
a journey in making sense of big data (part 1: Big Bang)
 
From the Big Bang to the New Economy, a journey in making sense of Big Data
From the Big Bang to the New Economy, a journey in making sense of Big DataFrom the Big Bang to the New Economy, a journey in making sense of Big Data
From the Big Bang to the New Economy, a journey in making sense of Big Data
 
Patrick Deglon Master Diploma Work - Neural Network Identification of pions, ...
Patrick Deglon Master Diploma Work - Neural Network Identification of pions, ...Patrick Deglon Master Diploma Work - Neural Network Identification of pions, ...
Patrick Deglon Master Diploma Work - Neural Network Identification of pions, ...
 
Customer Anaytics at Swiss TUG 2009
Customer Anaytics at Swiss TUG 2009Customer Anaytics at Swiss TUG 2009
Customer Anaytics at Swiss TUG 2009
 
From the Big Bang to Ecommerce, a journey in making sense of Big Data
From the Big Bang to Ecommerce, a journey in making sense of Big DataFrom the Big Bang to Ecommerce, a journey in making sense of Big Data
From the Big Bang to Ecommerce, a journey in making sense of Big Data
 

Recently uploaded

AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
Product School
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Inflectra
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
Elena Simperl
 
UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3
DianaGray10
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
OnBoard
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
Kari Kakkonen
 
ODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User GroupODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User Group
CatarinaPereira64715
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Product School
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
DianaGray10
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
91mobiles
 
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Ramesh Iyer
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
DanBrown980551
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
Product School
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
Prayukth K V
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
Alan Dix
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
Alison B. Lowndes
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
UiPathCommunity
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
Laura Byrne
 

Recently uploaded (20)

AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
 
UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
 
ODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User GroupODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User Group
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
 
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
 

Reporting at Motorola - Predictive analytics & business insights 2014

  • 1. motorola confidential Reporting at Motorola Predictive Analytics & Business Insights 2014 http://www.gatewayanalyticsnetwork.com/b122-home Dr Patrick Deglon Director of Engineering, Analytics Area Tech Lead Motorola Mobility pdeglon@motorola.com pdeglon
  • 2. motorola confidential ... Overview of Motorola Business About Us Motorola exists to invent, build and deliver the best mobile devices on the planet, improving the lives of millions of people.
  • 3. motorola confidential Motorola 1928 “Galvin Manufacturing Corporation” created, producing battery eliminators 1940 First walkie- talkie which was vital to Allied communication “one small step for man, one giant leap for mankind” through a Motorola transceiver 1969 1973 2011 20141986 Invented six sigma quality improvement process first private handheld mobile phone call; world's first commercial cellular device 1983 world's first handset to combine a Linux operating system and Java technology 2003 Source: Wikipedia Motorola splits into Motorola Mobility & Motorola Solutions
  • 4. motorola confidential •  Business overview •  Demos –  Daily Activations Report –  Moto Insights –  Drive Insights Agenda
  • 5. motorola confidential Daily Activations Report How to provide a global source of truth and start to provide insights from data points? Existing Situation - Numerous (conflicting) sources of truth - Too many variations of same data cube - “Table in your face” approach - No global business definition - No curation of manually entered data points - Report accessible on an internal portal (through VPN) - No mobile form factor
  • 6. motorola confidential Key Performance Indicators Motorola Factory # Shipments Distribution Channels # Sales First Usage # Activations Simplified Business Flow
  • 7. motorola confidential Data Flow Motorola Factory # Shipments Distribution Channels # Sales First Usage # Activations Google BigQuery Motorola Cloud Insights ...
  • 8. motorola confidential Demo Daily Report: Final Email
  • 9. motorola confidential Google: A galaxy of open APIs and Tools… App EngineBig Query Compute Engine Users Cloud Messaging Analytics Maps Visualization Data Store Cloud Storage Cloud SQL Drive Docs Translate Predict Mail Data Store Task Queue Memcache URL Fetch Cloud End Point Channel Java Python Go Mail and many more ... BACKUP
  • 10. motorola confidential Demo Daily Report ●  Get data (pivot) from BigQuery ●  Spreadsheet magic ●  Insights: WoW trends with statistics test, Key driver for growth, Key milestone, internal QA tests ●  Email ●  Embedded Chart ●  Scheduler https://docs.google.com/a/motorola.com/spreadsheet/ccc?key=0AgldkCMfisBTdF83VVJqdFVEZFZiZjgyTWJNdzRNblE&usp=drive_web#gid=21
  • 11. motorola confidential •  Assume sales follow a diffusion S-shape, i.e. Description of the illustrative simulation Marketing Word of mouth ΔN Nmax N •  Add random noise to theoretical daily activations (Poisson) •  Simulated daily activations (sales) for United States, Canada, Brazil, India, Russia, China, Germany and United Kingdom with various launch date per region ΔN = a (Nmax - N) + b N (Nmax - N)
  • 12. motorola confidential Step 1: Create a backbone table SELECT CAL_DT, Country FROM ON A.Dummy=B.Dummy WHERE B.CAL_DT>=A.Launch_Date motorola.com:sandbox:demo.backbone: INNER JOIN ( SELECT Country, CASE WHEN Country IN ('United States','Canada') THEN '2013-08-01' WHEN Country IN ('Brazil','Russia','India','China') THEN '2013-10-01' ELSE '2013-12-01' END AS Launch_Date, GDP_USD/1e7 AS Scale, 1 AS Dummy FROM [motorola.com:sandbox:pdeglon.countries] WHERE Country IN ('United States','Canada','Brazil','Russia','India', 'China','Germany','United Kingdom') ) AS B ( SELECT CAL_DT, 1 AS Dummy FROM [motorola.com:sandbox:pdeglon.calendar] ) AS A X BACKUP
  • 13. motorola confidential Step 2: Calculate KPI value over time SELECT CAL_DT, Country, ‘Phone 123’ AS Model, INTEGER(Scale* EXP(-POW( -150,2)/2/POW(75,2)) /(75*SQRT(2*PI())) ) AS Daily_Activations FROM [motorola.com:sandbox:demo.backbone] motorola.com:sandbox:demo.baseline: DATEDIFF(TIMESTAMP(CAL_DT),TIMESTAMP(Launch_Date)) ... Normal Distribution: BACKUP
  • 14. motorola confidential Step 3: Add Random Noise SELECT CAL_DT, Model, Country, INTEGER( Daily_Activations + SQRT(Daily_Activations) * SQRT(-2*LN(RAND()))*COS(2*PI()*RAND()) ) AS Daily_Activations FROM [motorola.com:sandbox:demo.baseline] motorola.com:sandbox:demo.simulation: Normal (Gaussian) Random Number (mu=0, sigma=1) (pseudo) Poisson distribution for N=Daily_activation BACKUP
  • 15. motorola confidential Step 4: Final Pivot for report SELECT CAL_DT, SUM(Daily_Activations) AS Total, SUM(CASE WHEN Country IN ('United States','Canada') THEN Daily_Activations ELSE 0 END) AS NA, SUM(CASE WHEN Country IN ('Brazil','Russia','India','China') THEN Daily_Activations ELSE 0 END) AS BRIC, SUM(CASE WHEN Country IN ('Germany','United Kingdom') THEN Daily_Activations ELSE 0 END) AS EU, SUM(CASE WHEN Country='United States' THEN Daily_Activations ELSE 0 END) AS UnitedStates, SUM(CASE WHEN Country='Canada' THEN Daily_Activations ELSE 0 END) AS Canada, SUM(CASE WHEN Country='Brazil' THEN Daily_Activations ELSE 0 END) AS Brazil, SUM(CASE WHEN Country='Russia' THEN Daily_Activations ELSE 0 END) AS Russia, SUM(CASE WHEN Country='India' THEN Daily_Activations ELSE 0 END) AS India, SUM(CASE WHEN Country='China' THEN Daily_Activations ELSE 0 END) AS China, SUM(CASE WHEN Country='Germany' THEN Daily_Activations ELSE 0 END) AS Germany, SUM(CASE WHEN Country='United Kingdom' THEN Daily_Activations ELSE 0 END) AS UnitedKingdom FROM [motorola.com:sandbox:demo.simulation] WHERE CAL_DT<CURRENT_DATE() GROUP BY 1 ORDER BY 1 DESC BACKUP
  • 16. motorola confidential Demo Daily Report: New Menu Item
  • 17. motorola confidential Demo Daily Report: Edit Code (App Script)
  • 18. motorola confidential Demo Daily Report: Example for adding a new menu item
  • 19. motorola confidential Demo Daily Report: Key Query (pivot)
  • 20. motorola confidential Demo Daily Report: Running the query
  • 21. motorola confidential Demo Daily Report: Parsing the results
  • 22. motorola confidential Demo Daily Report: Data Sheet
  • 23. motorola confidential Demo Daily Report: Summary sheet
  • 24. motorola confidential Demo Daily Report: Preparing email
  • 25. motorola confidential Demo Daily Report: Email template sheet
  • 26. motorola confidential Demo Daily Report: Preparing email
  • 27. motorola confidential Demo Daily Report: Sending email
  • 28. motorola confidential Demo Daily Report: Signal vs Noise and Main Drivers
  • 29. motorola confidential Demo Daily Report: Key Milestones
  • 30. motorola confidential Demo Daily Report: Final Email
  • 31. motorola confidential Demo Daily Report: Scheduling
  • 32. motorola confidential •  Business overview •  Demos –  Daily Activations Report –  Moto Insights –  Drive Insights Agenda
  • 33. motorola confidential Moto Insights How to provide insights to executive-on-the-go with a robust system where new report take seconds to create? Existing Situation - Require VPN - New Report take weeks - New features take months - Issue Tickets come weekly
  • 34. motorola confidential Demo Moto Insights Moto Insights App Engine Data Source: Big Query Report Meta Data: Datastore Tracking: Datastore Users Access: Google Users (email) + Datastore (role) Moto Insights Web portal Moto Insights Android App
  • 35. motorola confidential Demo Moto Insights: Main menu & Responsive Design responsive design
  • 36. motorola confidential Demo Moto Insights: Report Details
  • 37. motorola confidential Demo Moto Insights: 1st Chart Details
  • 38. motorola confidential Demo Moto Insights: Chart Types
  • 39. motorola confidential Demo Moto Insights: Dummy Example
  • 40. motorola confidential •  Business overview •  Demos –  Daily Activations Report –  Moto Insights –  Drive Insights Agenda
  • 41. motorola confidential Drive Insights How to democratize Analytics within the company while maintaining quality (data & insights) as well as maintain Big Data usage under control? Existing Situation - Reports are produce by a centralized team - Role management is becoming out of control - Product teams are complaining to have to run SQL repeatedly on BigQuery console
  • 42. motorola confidential Demo Drive Insights (v2) Drive Insights App Engine Data Source: Big Query Data Source: Google Analytics iFrame Source: Tableau Server iFrame Source: Google Documents Data Source: Spreadsheet & CSV Report Meta Data: Google Drive (Text file with JSON) Report Meta Data: Datastore (Report copy & usage tracking) Users Access Control: Google Users + Drive Sharing Google Drive Moto Insights Android App Drive Insights Web portal
  • 43. motorola confidential Demo Drive Insights: New document type
  • 44. motorola confidential Demo Drive Insights: Report creation
  • 45. motorola confidential Demo Drive Insights: 1st Chart Details
  • 46. motorola confidential Demo Drive Insights: 2nd Chart Details
  • 47. motorola confidential Demo Drive Insights: Chart Types
  • 48. motorola confidential Demo Drive Insights: SQL Editor (CodeMirror)
  • 49. motorola confidential Demo Drive Insights: Report document in your Google Drive
  • 50. motorola confidential Demo Drive Insights: Dummy Example
  • 51. motorola confidential Demo Drive Insights: Drive Sharing
  • 52. motorola confidential Q&A ? Dr Patrick Deglon Director of Engineering, Analytics Area Tech Lead Motorola Mobility pdeglon@motorola.com pdeglon
  • 53. motorola confidential In this presentation, Patrick Deglon will share his learnings and provide best practices when using open Google tools & API. He will present his daily email report that hundreds of key Motorola stakeholders are receiving to drive the business, as well as a mobile solution based on the latest web technologies, including Google Visualization, Bootstrap CSS and many of the Google APIs (Gmail, BigQuery, Analytics, Drive, App Engine, Users authentication, etc.). Abstract
  • 54. motorola confidential Dr Patrick Deglon Director of Engineering, Analytics Area Tech Lead Motorola Mobility With a PhD in Particle Physics, Patrick Deglon spent the last decade driving business insights at eBay and at Motorola Mobility, a Google company. At eBay, he led significant improvements in marketing effectiveness by developing methods to measure incremental sales, and by running large scale experiments on Internet marketing channels. He joined Motorola Mobility in 2013 to help raise the bar in Analytics and on-board open Google tools and technologies. He is now the Area Tech Lead for Analytics within the Cloud Services organization. He is married with two kids and enjoys his town of Campbell, CA. Bio