SlideShare a Scribd company logo
• Analysis
• Analysis
• Transportation
• Analysis
• Transportation
• Access Control
• Analysis
• Transportation
• Access Control
• Replication
• Analysis
• Transportation
• Access Control
• Replication
• Storage
Data at Rest Data in
Motion
Data in Many
Forms
Data in Doubt Data into
Money
map (in_key, in_value) -> list(out_key, intermediate_value)
reduce (out_key, list(intermediate_value)) -> list(out_value)
Read lines
from file
Convert line
to
Key-Value
Pair(s)
Filter
(by
key/value)
Combine
Values with
similar Keys
Shuffle data
across
nodes
for reduces
by Key
Sort by Key
Aggregate
(reduce)
Filter (based
on
aggregated
value)
Write
results
to file
Map Reduce
Deer Bear River
Car Car River
Deer Car Bear
Deer Bear River
Car Car River
Deer Car Bear
Deer, 1
Bear, 1
River, 1
Car, 1
Car, 1
River, 1
Deer, 1
Car, 1
Bear, 1
Bear, 1
Bear, 1
Car, 1
Car, 1
Car, 1
Deer, 1
Deer, 1
River, 1
River, 1
Bear, 2
Car, 3
Deer, 2
River, 2
Bear, 2
Car, 3
Deer, 2
River, 2
Windows Azure Blob Storage (WABS) Distributed File System
Applications (by cluster type)
Spark
 Spark
 Spark Streaming
 Spark MLlib
Storm
 Storm
 Kafka
HBase
 HBase
 Zookeeper
….
Hadoop
 HDFS APIs
 MapReduce
 Sqoop
 Pig
 Hive (Tez)
 Mahout
 Oozie
Yet Another Resource Negotiator (YARN)
Acquisition
 Azure Data Factory
Stream Processing
• Steam Analytics
• Event Hub
Machine Learning
 Azure Machine
Learning
NoSQL
 Table Storage
 DocumentDB
DATA
Business
apps
Custom
apps
Sensors
and devices
INTELLIGENCE ACTION
People
Automated
Systems
EXAMPLE SOLUTIONS
Process real-time data in Azure using a simple SQL language
Consumes millions of real-time events from Event Hub collected from
devices, sensors, infrastructure, and applications
Performs time-sensitive analysis using SQL-like language against
multiple real-time streams and reference data
Outputs to persistent stores, dashboards or back to devices
Point of
Service Devices
Self Checkout
Stations
Kiosks
Smart
Phones
Slates/
Tablets
PCs/
Laptops
Servers
Digital
Signs
Diagnostic
EquipmentRemote Medical
Monitors
Logic
Controllers
Specialized
DevicesThin
Clients
Handhelds
Security
POS
Terminals
Automation
Devices
Vending
Machines
Kinect
ATM
Fully managed service to support orchestration of data movement
and processing
Connect to relational or non-relational data that is on-premises or
in the cloud
Single pane of glass to monitor and manage data processing
pipelines.
Publish to Power BI
Compose and orchestrate data services at scale
C#
MapReduce
Trusted data
BI & analytics
Hive
Pig
Stored Procedures
Azure Machine Learning
ML Algorithms are best of breed and embrace OSS
• MS + R + Python + BYOA
ML Studio for productive development
• Faster experiments results in faster improvements
• Visual Workflows & ML Experiments
ML Operationalization to remove deployment friction
• Build entire ML Apps & Deploy as Cloud APIs
ML Gallery
• Provide ML applications like apps in an ‘app store’
• Publish/consume APIs in a 2 sided market
Help organizations eliminate undifferentiated heavy lifting
Powerful predictive analytics in Azure
Azure Machine Learning
Enable enterprise-wide self-service data source registration and discovery
A metadata repository that allow users to register, enrich,
understand, discover, and consume data sources
Delivers differentiated value though
‒ Data source discovery; rather than data discovery
‒ Support for data from any source; Structured and
unstructured, on premises and in the cloud
‒ Publishing, discovery and consumption through any tool
‒ Annotation crowdsourcing: empowering any user to
capture and share their knowledge.
This, while allowing IT to maintain control and oversight
Power Map with custom maps allows
deeper geospatial explorations and
storytelling
Power Query brings modern data discovery,
connectivity, shaping and publishing to
Excel
Analysis Services connectivity for Power
View allows users to leverage existing IT
investments
Support for more sophisticated data
models in Power Pivot – date and calc
tables, many-to-many relationships, etc
Power Map w/
Custom Maps
Power Query
Power BI dashboards and KPIs for
monitoring the health of your business
New data visualizations and touch-
optimized exploration in HTML5
Power BI mobile apps across devices
including iPad and iPhone
Support for new data sources including
SalesForce.com, Dynamics CRM online
and SQL Server Analysis Services
Dashboard
Tree Map
A hyper scale repository for big data analytic workloads
• Hadoop File System compatible with
HDFS™
• Integrated with HDInsight, Revolution
R, Hortonworks, Cloudera
• Based on YARN
• Petabyte-sized files
• No size limits to data in single account
• Massive throughput to increase
performance
• AAD based access control
• Data management
Devices
Azure
Data Lake
Analytics Service
A new distributed
analytics service
Built on Apache YARN
Scales dynamically with the turn of a dial
Pay by the query
Supports Azure AD for access control,
roles, and integration with on-prem
identity systems
Built with U-SQL to unify the benefits of
SQL with the power of C#
Processes data across Azure
37
Stream Analytics
TransformIngest
Example overall data flow and Architecture
Web logs
Present &
decide
IoT, Mobile Devices
etc.
Social Data
Event Hubs HDInsight
Azure Data
Factory
Azure SQL DB
Azure Data Lake
Azure Machine
Learning
(Fraud detection
etc.)
Power BI
Web
dashboards
Mobile devices
DW / Long-term
storage
Predictive
analytics
Event & data
producers
Azure SQL DW
From zero to finished, analytical apps and scenarios
Pre-Configured
Allows customers to accelerates the process of building analytical apps
Go from zero to sample app in minutes, from sample app to finished solution in a week
The Internet of Things – Manufacturing
GLOBAL
OPERATIONS
I can see my
production line
status and
recommend
adjustments to
better manage
operational cost.
I know when to
deploy the right
resources for
predictive
maintenance to
minimize equipment
failures and reduce
service cost.
I gain insight into
usage patterns from
multiple customers
and track equipment
deterioration,
enabling me to
reengineer products
for better
performance.
MANUFACTURING PLANT
Aggregate product data,
customer sentiment, and
other third-party
syndicated data to identify
and correct quality issues.
Manage equipment remotely, using
temperature limits and other settings
to conserve energy and reduce costs.
Monitor production flow in near-real
time to eliminate waste and
unnecessary work in process inventory.
GLOBAL FACILITY INSIGHT
Implement condition-
based maintenance
alerts to eliminate
machine down-time
and increase
throughput.
THIRD-PARTY LOGISTICS
Provide cross-channel visibility into inventories
to optimize supply and reduce shared costs in
the value chain.
CUSTOMER SITE
Transmits operational information to the
partner (e.g. OEM) and to field service
engineers for remote process
automation and optimization.
Management
R&D
Field Service
The Internet of Things – Retail
Marketing
MOBILE EXPERIENCE
STORE
PURCHASE
HISTORY:
Dog food
M T W Th F
Weather
Data
Merchandizing
IN-STORE SHOPPING
Online
Behavior
Shopping
Route
REFLECTION
BEST
DEAL
INSPIRATION,
DISCOVERY,
PRE-SHOPPING
Purchase
History
RIGHT OFFER, RIGHT TIME, RIGHT PLACE
IoT DATA FUELS CUSTOMER AND PRODUCT INSIGHTS
1001001001001001001011010010101100101101001010000101010101011010010110100101010
CHECKOUT
Retail
200ft
Have you
seen these!
We’re ready for
the rain!
#ShoppingSuccess
42
The Internet of Things – Hospitality & Travel
Save money with more accurate
arrival time predictions
Provide a seamless traveler experience
from the curb to the gate, and enable
context-sensitive notifications
Provide guests with a connected tablet to
control room settings, request services, and
provide feedback—and save their preferences
Centrally manage critical station assets—everything
from communication and security networks to
escalators and HVAC control systems
Send reports and sensor data
to maintenance crews for
faster turnaround
Configure notifications on
employee devices of restaurant
equipment maintenance needs
Manage inventory in near real time,
and monitor food storage
temperatures and expirations
NEW
GATE:
B7
25% off
ON TIME
•
•
•
Thank You
madasi@microsoft.com
UTAD - Jornadas de Informática - Potential of Big Data

More Related Content

What's hot

Victoria Tableau User Group - Getting started with Tableau
Victoria Tableau User Group - Getting started with TableauVictoria Tableau User Group - Getting started with Tableau
Victoria Tableau User Group - Getting started with TableauDmitry Anoshin
 
Afternoons with Azure - Power BI and Azure Analysis Services
Afternoons with Azure - Power BI and Azure Analysis ServicesAfternoons with Azure - Power BI and Azure Analysis Services
Afternoons with Azure - Power BI and Azure Analysis ServicesCCG
 
A developer's introduction to big data processing with Azure Databricks
A developer's introduction to big data processing with Azure DatabricksA developer's introduction to big data processing with Azure Databricks
A developer's introduction to big data processing with Azure DatabricksMicrosoft Tech Community
 
IBM Cloud Native Day April 2021: Serverless Data Lake
IBM Cloud Native Day April 2021: Serverless Data LakeIBM Cloud Native Day April 2021: Serverless Data Lake
IBM Cloud Native Day April 2021: Serverless Data LakeTorsten Steinbach
 
Cepta The Future of Data with Power BI
Cepta The Future of Data with Power BICepta The Future of Data with Power BI
Cepta The Future of Data with Power BIKellyn Pot'Vin-Gorman
 
Microsoft Azure BI Solutions in the Cloud
Microsoft Azure BI Solutions in the CloudMicrosoft Azure BI Solutions in the Cloud
Microsoft Azure BI Solutions in the CloudMark Kromer
 
Uses of Data Lakes: Data Analytics Week SF
Uses of Data Lakes: Data Analytics Week SFUses of Data Lakes: Data Analytics Week SF
Uses of Data Lakes: Data Analytics Week SFAmazon Web Services
 
Azure Databricks for Data Scientists
Azure Databricks for Data ScientistsAzure Databricks for Data Scientists
Azure Databricks for Data ScientistsRichard Garris
 
Azure Analysis Services (Azure Bootcamp 2018)
Azure Analysis Services (Azure Bootcamp 2018)Azure Analysis Services (Azure Bootcamp 2018)
Azure Analysis Services (Azure Bootcamp 2018)Turner Kunkel
 
Eugene Polonichko "Azure Data Lake: what is it? why is it? where is it?"
Eugene Polonichko "Azure Data Lake: what is it? why is it? where is it?"Eugene Polonichko "Azure Data Lake: what is it? why is it? where is it?"
Eugene Polonichko "Azure Data Lake: what is it? why is it? where is it?"DataConf
 
The Hive Think Tank - The Microsoft Big Data Stack by Raghu Ramakrishnan, CTO...
The Hive Think Tank - The Microsoft Big Data Stack by Raghu Ramakrishnan, CTO...The Hive Think Tank - The Microsoft Big Data Stack by Raghu Ramakrishnan, CTO...
The Hive Think Tank - The Microsoft Big Data Stack by Raghu Ramakrishnan, CTO...The Hive
 
Microsoft business intelligence and analytics
Microsoft business intelligence and analyticsMicrosoft business intelligence and analytics
Microsoft business intelligence and analyticsJeannette Browning
 
Big Data Analytics from Azure Cloud to Power BI Mobile
Big Data Analytics from Azure Cloud to Power BI MobileBig Data Analytics from Azure Cloud to Power BI Mobile
Big Data Analytics from Azure Cloud to Power BI MobileRoy Kim
 
Data Architecture for Modern Applications
Data Architecture for Modern ApplicationsData Architecture for Modern Applications
Data Architecture for Modern ApplicationsRaghu Chakravarthi
 
Azure Data Lake Intro (SQLBits 2016)
Azure Data Lake Intro (SQLBits 2016)Azure Data Lake Intro (SQLBits 2016)
Azure Data Lake Intro (SQLBits 2016)Michael Rys
 
Data Con LA 2018 - Why use a columnar database for analytical workloads by Sh...
Data Con LA 2018 - Why use a columnar database for analytical workloads by Sh...Data Con LA 2018 - Why use a columnar database for analytical workloads by Sh...
Data Con LA 2018 - Why use a columnar database for analytical workloads by Sh...Data Con LA
 

What's hot (20)

Victoria Tableau User Group - Getting started with Tableau
Victoria Tableau User Group - Getting started with TableauVictoria Tableau User Group - Getting started with Tableau
Victoria Tableau User Group - Getting started with Tableau
 
Afternoons with Azure - Power BI and Azure Analysis Services
Afternoons with Azure - Power BI and Azure Analysis ServicesAfternoons with Azure - Power BI and Azure Analysis Services
Afternoons with Azure - Power BI and Azure Analysis Services
 
A developer's introduction to big data processing with Azure Databricks
A developer's introduction to big data processing with Azure DatabricksA developer's introduction to big data processing with Azure Databricks
A developer's introduction to big data processing with Azure Databricks
 
IBM Cloud Native Day April 2021: Serverless Data Lake
IBM Cloud Native Day April 2021: Serverless Data LakeIBM Cloud Native Day April 2021: Serverless Data Lake
IBM Cloud Native Day April 2021: Serverless Data Lake
 
Cepta The Future of Data with Power BI
Cepta The Future of Data with Power BICepta The Future of Data with Power BI
Cepta The Future of Data with Power BI
 
Microsoft Azure BI Solutions in the Cloud
Microsoft Azure BI Solutions in the CloudMicrosoft Azure BI Solutions in the Cloud
Microsoft Azure BI Solutions in the Cloud
 
Uses of Data Lakes: Data Analytics Week SF
Uses of Data Lakes: Data Analytics Week SFUses of Data Lakes: Data Analytics Week SF
Uses of Data Lakes: Data Analytics Week SF
 
Azure Databricks for Data Scientists
Azure Databricks for Data ScientistsAzure Databricks for Data Scientists
Azure Databricks for Data Scientists
 
Azure Analysis Services (Azure Bootcamp 2018)
Azure Analysis Services (Azure Bootcamp 2018)Azure Analysis Services (Azure Bootcamp 2018)
Azure Analysis Services (Azure Bootcamp 2018)
 
Uses of Data Lakes
Uses of Data LakesUses of Data Lakes
Uses of Data Lakes
 
Eugene Polonichko "Azure Data Lake: what is it? why is it? where is it?"
Eugene Polonichko "Azure Data Lake: what is it? why is it? where is it?"Eugene Polonichko "Azure Data Lake: what is it? why is it? where is it?"
Eugene Polonichko "Azure Data Lake: what is it? why is it? where is it?"
 
The Hive Think Tank - The Microsoft Big Data Stack by Raghu Ramakrishnan, CTO...
The Hive Think Tank - The Microsoft Big Data Stack by Raghu Ramakrishnan, CTO...The Hive Think Tank - The Microsoft Big Data Stack by Raghu Ramakrishnan, CTO...
The Hive Think Tank - The Microsoft Big Data Stack by Raghu Ramakrishnan, CTO...
 
Microsoft business intelligence and analytics
Microsoft business intelligence and analyticsMicrosoft business intelligence and analytics
Microsoft business intelligence and analytics
 
Big Data Analytics from Azure Cloud to Power BI Mobile
Big Data Analytics from Azure Cloud to Power BI MobileBig Data Analytics from Azure Cloud to Power BI Mobile
Big Data Analytics from Azure Cloud to Power BI Mobile
 
Data Architecture for Modern Applications
Data Architecture for Modern ApplicationsData Architecture for Modern Applications
Data Architecture for Modern Applications
 
Azure Data Lake Intro (SQLBits 2016)
Azure Data Lake Intro (SQLBits 2016)Azure Data Lake Intro (SQLBits 2016)
Azure Data Lake Intro (SQLBits 2016)
 
Introduction to RDF*
Introduction to RDF*Introduction to RDF*
Introduction to RDF*
 
Data Lakes in the Wild
Data Lakes in the WildData Lakes in the Wild
Data Lakes in the Wild
 
Data Con LA 2018 - Why use a columnar database for analytical workloads by Sh...
Data Con LA 2018 - Why use a columnar database for analytical workloads by Sh...Data Con LA 2018 - Why use a columnar database for analytical workloads by Sh...
Data Con LA 2018 - Why use a columnar database for analytical workloads by Sh...
 
Digital Transformation with Microsoft Azure
Digital Transformation with Microsoft AzureDigital Transformation with Microsoft Azure
Digital Transformation with Microsoft Azure
 

Viewers also liked

Internet Society Event on IoT - IoT@Microsoft
Internet Society Event on IoT - IoT@MicrosoftInternet Society Event on IoT - IoT@Microsoft
Internet Society Event on IoT - IoT@MicrosoftMarco Silva
 
Big data - Modelling World 2015, London
Big data - Modelling World 2015, LondonBig data - Modelling World 2015, London
Big data - Modelling World 2015, LondonPer Olof Arnäs
 
Scrum Portugal Meeting 1 Lisbon - ALM
Scrum Portugal Meeting 1 Lisbon - ALMScrum Portugal Meeting 1 Lisbon - ALM
Scrum Portugal Meeting 1 Lisbon - ALMMarco Silva
 
IoTSummit - Introduction to IoT Hub
IoTSummit - Introduction to IoT HubIoTSummit - Introduction to IoT Hub
IoTSummit - Introduction to IoT HubMarco Silva
 
Sustainable Urban Transport Planning using Big Data from Mobile Phones
Sustainable Urban Transport Planning using Big Data from Mobile PhonesSustainable Urban Transport Planning using Big Data from Mobile Phones
Sustainable Urban Transport Planning using Big Data from Mobile PhonesDaniel Emaasit
 
Complex Analysis in Public Transportation: A Step towards Smart Cities
Complex Analysis in Public Transportation: A Step towards Smart CitiesComplex Analysis in Public Transportation: A Step towards Smart Cities
Complex Analysis in Public Transportation: A Step towards Smart CitiesDataWorks Summit
 

Viewers also liked (7)

Internet Society Event on IoT - IoT@Microsoft
Internet Society Event on IoT - IoT@MicrosoftInternet Society Event on IoT - IoT@Microsoft
Internet Society Event on IoT - IoT@Microsoft
 
Big data - Modelling World 2015, London
Big data - Modelling World 2015, LondonBig data - Modelling World 2015, London
Big data - Modelling World 2015, London
 
Scrum Portugal Meeting 1 Lisbon - ALM
Scrum Portugal Meeting 1 Lisbon - ALMScrum Portugal Meeting 1 Lisbon - ALM
Scrum Portugal Meeting 1 Lisbon - ALM
 
the role of Big data and IoT in urban Transport
the role of Big data and IoT in urban Transportthe role of Big data and IoT in urban Transport
the role of Big data and IoT in urban Transport
 
IoTSummit - Introduction to IoT Hub
IoTSummit - Introduction to IoT HubIoTSummit - Introduction to IoT Hub
IoTSummit - Introduction to IoT Hub
 
Sustainable Urban Transport Planning using Big Data from Mobile Phones
Sustainable Urban Transport Planning using Big Data from Mobile PhonesSustainable Urban Transport Planning using Big Data from Mobile Phones
Sustainable Urban Transport Planning using Big Data from Mobile Phones
 
Complex Analysis in Public Transportation: A Step towards Smart Cities
Complex Analysis in Public Transportation: A Step towards Smart CitiesComplex Analysis in Public Transportation: A Step towards Smart Cities
Complex Analysis in Public Transportation: A Step towards Smart Cities
 

Similar to UTAD - Jornadas de Informática - Potential of Big Data

Cortana Analytics Suite
Cortana Analytics SuiteCortana Analytics Suite
Cortana Analytics SuiteJames Serra
 
Big Data: It’s all about the Use Cases
Big Data: It’s all about the Use CasesBig Data: It’s all about the Use Cases
Big Data: It’s all about the Use CasesJames Serra
 
From Business Hindsight to Foresight with Azure Synapse Analytics
From Business Hindsight to Foresight with Azure Synapse AnalyticsFrom Business Hindsight to Foresight with Azure Synapse Analytics
From Business Hindsight to Foresight with Azure Synapse AnalyticsKorcomptenz Inc
 
Big Data Analytics in the Cloud with Microsoft Azure
Big Data Analytics in the Cloud with Microsoft AzureBig Data Analytics in the Cloud with Microsoft Azure
Big Data Analytics in the Cloud with Microsoft AzureMark Kromer
 
Webinar - Accelerating Hadoop Success with Rapid Data Integration for the Mod...
Webinar - Accelerating Hadoop Success with Rapid Data Integration for the Mod...Webinar - Accelerating Hadoop Success with Rapid Data Integration for the Mod...
Webinar - Accelerating Hadoop Success with Rapid Data Integration for the Mod...Hortonworks
 
Bringing the Power of Big Data Computation to Salesforce
Bringing the Power of Big Data Computation to SalesforceBringing the Power of Big Data Computation to Salesforce
Bringing the Power of Big Data Computation to SalesforceSalesforce Developers
 
Derfor skal du bruge en DataLake
Derfor skal du bruge en DataLakeDerfor skal du bruge en DataLake
Derfor skal du bruge en DataLakeMicrosoft
 
Data and Analytics at Holland & Barrett: Building a '3-Michelin-star' Data Pl...
Data and Analytics at Holland & Barrett: Building a '3-Michelin-star' Data Pl...Data and Analytics at Holland & Barrett: Building a '3-Michelin-star' Data Pl...
Data and Analytics at Holland & Barrett: Building a '3-Michelin-star' Data Pl...Dobo Radichkov
 
Dr. Christian Kurze from Denodo, "Data Virtualization: Fulfilling the Promise...
Dr. Christian Kurze from Denodo, "Data Virtualization: Fulfilling the Promise...Dr. Christian Kurze from Denodo, "Data Virtualization: Fulfilling the Promise...
Dr. Christian Kurze from Denodo, "Data Virtualization: Fulfilling the Promise...Dataconomy Media
 
Innovation Track AWS Cloud Experience Argentina - Data Lakes & Analytics en AWS
Innovation Track AWS Cloud Experience Argentina - Data Lakes & Analytics en AWS Innovation Track AWS Cloud Experience Argentina - Data Lakes & Analytics en AWS
Innovation Track AWS Cloud Experience Argentina - Data Lakes & Analytics en AWS Amazon Web Services LATAM
 
Kyvos Insights
Kyvos Insights Kyvos Insights
Kyvos Insights rebeccatho
 
Accelerate Self-Service Analytics with Virtualization and Visualisation (Thai)
Accelerate Self-Service Analytics with Virtualization and Visualisation (Thai)Accelerate Self-Service Analytics with Virtualization and Visualisation (Thai)
Accelerate Self-Service Analytics with Virtualization and Visualisation (Thai)Denodo
 
Driving Business Insights with a Modern Data Architecture AWS Summit SG 2017
Driving Business Insights with a Modern Data Architecture  AWS Summit SG 2017Driving Business Insights with a Modern Data Architecture  AWS Summit SG 2017
Driving Business Insights with a Modern Data Architecture AWS Summit SG 2017Amazon Web Services
 
How does Microsoft solve Big Data?
How does Microsoft solve Big Data?How does Microsoft solve Big Data?
How does Microsoft solve Big Data?James Serra
 
Trivadis Azure Data Lake
Trivadis Azure Data LakeTrivadis Azure Data Lake
Trivadis Azure Data LakeTrivadis
 
Financial Services Analytics on AWS
Financial Services Analytics on AWSFinancial Services Analytics on AWS
Financial Services Analytics on AWSAmazon Web Services
 
Big Data Expo 2015 - Microsoft Transform you data into intelligent action
Big Data Expo 2015 - Microsoft Transform you data into intelligent actionBig Data Expo 2015 - Microsoft Transform you data into intelligent action
Big Data Expo 2015 - Microsoft Transform you data into intelligent actionBigDataExpo
 
Hadoop 2.0: YARN to Further Optimize Data Processing
Hadoop 2.0: YARN to Further Optimize Data ProcessingHadoop 2.0: YARN to Further Optimize Data Processing
Hadoop 2.0: YARN to Further Optimize Data ProcessingHortonworks
 
IoT Crash Course Hadoop Summit SJ
IoT Crash Course Hadoop Summit SJIoT Crash Course Hadoop Summit SJ
IoT Crash Course Hadoop Summit SJDaniel Madrigal
 

Similar to UTAD - Jornadas de Informática - Potential of Big Data (20)

Cortana Analytics Suite
Cortana Analytics SuiteCortana Analytics Suite
Cortana Analytics Suite
 
Big Data: It’s all about the Use Cases
Big Data: It’s all about the Use CasesBig Data: It’s all about the Use Cases
Big Data: It’s all about the Use Cases
 
From Business Hindsight to Foresight with Azure Synapse Analytics
From Business Hindsight to Foresight with Azure Synapse AnalyticsFrom Business Hindsight to Foresight with Azure Synapse Analytics
From Business Hindsight to Foresight with Azure Synapse Analytics
 
Big Data Analytics in the Cloud with Microsoft Azure
Big Data Analytics in the Cloud with Microsoft AzureBig Data Analytics in the Cloud with Microsoft Azure
Big Data Analytics in the Cloud with Microsoft Azure
 
Spring 2017 Sage 300 (Accpac) Users Group
Spring 2017 Sage 300 (Accpac) Users GroupSpring 2017 Sage 300 (Accpac) Users Group
Spring 2017 Sage 300 (Accpac) Users Group
 
Webinar - Accelerating Hadoop Success with Rapid Data Integration for the Mod...
Webinar - Accelerating Hadoop Success with Rapid Data Integration for the Mod...Webinar - Accelerating Hadoop Success with Rapid Data Integration for the Mod...
Webinar - Accelerating Hadoop Success with Rapid Data Integration for the Mod...
 
Bringing the Power of Big Data Computation to Salesforce
Bringing the Power of Big Data Computation to SalesforceBringing the Power of Big Data Computation to Salesforce
Bringing the Power of Big Data Computation to Salesforce
 
Derfor skal du bruge en DataLake
Derfor skal du bruge en DataLakeDerfor skal du bruge en DataLake
Derfor skal du bruge en DataLake
 
Data and Analytics at Holland & Barrett: Building a '3-Michelin-star' Data Pl...
Data and Analytics at Holland & Barrett: Building a '3-Michelin-star' Data Pl...Data and Analytics at Holland & Barrett: Building a '3-Michelin-star' Data Pl...
Data and Analytics at Holland & Barrett: Building a '3-Michelin-star' Data Pl...
 
Dr. Christian Kurze from Denodo, "Data Virtualization: Fulfilling the Promise...
Dr. Christian Kurze from Denodo, "Data Virtualization: Fulfilling the Promise...Dr. Christian Kurze from Denodo, "Data Virtualization: Fulfilling the Promise...
Dr. Christian Kurze from Denodo, "Data Virtualization: Fulfilling the Promise...
 
Innovation Track AWS Cloud Experience Argentina - Data Lakes & Analytics en AWS
Innovation Track AWS Cloud Experience Argentina - Data Lakes & Analytics en AWS Innovation Track AWS Cloud Experience Argentina - Data Lakes & Analytics en AWS
Innovation Track AWS Cloud Experience Argentina - Data Lakes & Analytics en AWS
 
Kyvos Insights
Kyvos Insights Kyvos Insights
Kyvos Insights
 
Accelerate Self-Service Analytics with Virtualization and Visualisation (Thai)
Accelerate Self-Service Analytics with Virtualization and Visualisation (Thai)Accelerate Self-Service Analytics with Virtualization and Visualisation (Thai)
Accelerate Self-Service Analytics with Virtualization and Visualisation (Thai)
 
Driving Business Insights with a Modern Data Architecture AWS Summit SG 2017
Driving Business Insights with a Modern Data Architecture  AWS Summit SG 2017Driving Business Insights with a Modern Data Architecture  AWS Summit SG 2017
Driving Business Insights with a Modern Data Architecture AWS Summit SG 2017
 
How does Microsoft solve Big Data?
How does Microsoft solve Big Data?How does Microsoft solve Big Data?
How does Microsoft solve Big Data?
 
Trivadis Azure Data Lake
Trivadis Azure Data LakeTrivadis Azure Data Lake
Trivadis Azure Data Lake
 
Financial Services Analytics on AWS
Financial Services Analytics on AWSFinancial Services Analytics on AWS
Financial Services Analytics on AWS
 
Big Data Expo 2015 - Microsoft Transform you data into intelligent action
Big Data Expo 2015 - Microsoft Transform you data into intelligent actionBig Data Expo 2015 - Microsoft Transform you data into intelligent action
Big Data Expo 2015 - Microsoft Transform you data into intelligent action
 
Hadoop 2.0: YARN to Further Optimize Data Processing
Hadoop 2.0: YARN to Further Optimize Data ProcessingHadoop 2.0: YARN to Further Optimize Data Processing
Hadoop 2.0: YARN to Further Optimize Data Processing
 
IoT Crash Course Hadoop Summit SJ
IoT Crash Course Hadoop Summit SJIoT Crash Course Hadoop Summit SJ
IoT Crash Course Hadoop Summit SJ
 

More from Marco Silva

IoT Summit 2017 - Leverage W10 IoT Core on a Raspberry Pi to connect your sen...
IoT Summit 2017 - Leverage W10 IoT Core on a Raspberry Pi to connect your sen...IoT Summit 2017 - Leverage W10 IoT Core on a Raspberry Pi to connect your sen...
IoT Summit 2017 - Leverage W10 IoT Core on a Raspberry Pi to connect your sen...Marco Silva
 
IoT Masterclass ESGT Santarem - Connecting The Dots
IoT Masterclass ESGT Santarem -  Connecting The DotsIoT Masterclass ESGT Santarem -  Connecting The Dots
IoT Masterclass ESGT Santarem - Connecting The DotsMarco Silva
 
Tales from the Trenches – Leveraging Agile on Fixed Fee Projects
Tales from the Trenches – Leveraging Agile on Fixed Fee ProjectsTales from the Trenches – Leveraging Agile on Fixed Fee Projects
Tales from the Trenches – Leveraging Agile on Fixed Fee ProjectsMarco Silva
 
Agile Portugal 2016 - Daily Meetings, More Than Just Standing Up and Sharing
Agile Portugal 2016 - Daily Meetings, More Than Just Standing Up and SharingAgile Portugal 2016 - Daily Meetings, More Than Just Standing Up and Sharing
Agile Portugal 2016 - Daily Meetings, More Than Just Standing Up and SharingMarco Silva
 
NUI the 3rd wave - Techdays2010
NUI the 3rd wave - Techdays2010NUI the 3rd wave - Techdays2010
NUI the 3rd wave - Techdays2010Marco Silva
 
How Natural User Interfaces are changing Human Computer Interaction
How Natural User Interfaces are changing Human Computer InteractionHow Natural User Interfaces are changing Human Computer Interaction
How Natural User Interfaces are changing Human Computer InteractionMarco Silva
 
SHiFT2010 - Next Wave of UX
SHiFT2010 - Next Wave of UXSHiFT2010 - Next Wave of UX
SHiFT2010 - Next Wave of UXMarco Silva
 
Get To Know Silverlight
Get To Know SilverlightGet To Know Silverlight
Get To Know SilverlightMarco Silva
 

More from Marco Silva (8)

IoT Summit 2017 - Leverage W10 IoT Core on a Raspberry Pi to connect your sen...
IoT Summit 2017 - Leverage W10 IoT Core on a Raspberry Pi to connect your sen...IoT Summit 2017 - Leverage W10 IoT Core on a Raspberry Pi to connect your sen...
IoT Summit 2017 - Leverage W10 IoT Core on a Raspberry Pi to connect your sen...
 
IoT Masterclass ESGT Santarem - Connecting The Dots
IoT Masterclass ESGT Santarem -  Connecting The DotsIoT Masterclass ESGT Santarem -  Connecting The Dots
IoT Masterclass ESGT Santarem - Connecting The Dots
 
Tales from the Trenches – Leveraging Agile on Fixed Fee Projects
Tales from the Trenches – Leveraging Agile on Fixed Fee ProjectsTales from the Trenches – Leveraging Agile on Fixed Fee Projects
Tales from the Trenches – Leveraging Agile on Fixed Fee Projects
 
Agile Portugal 2016 - Daily Meetings, More Than Just Standing Up and Sharing
Agile Portugal 2016 - Daily Meetings, More Than Just Standing Up and SharingAgile Portugal 2016 - Daily Meetings, More Than Just Standing Up and Sharing
Agile Portugal 2016 - Daily Meetings, More Than Just Standing Up and Sharing
 
NUI the 3rd wave - Techdays2010
NUI the 3rd wave - Techdays2010NUI the 3rd wave - Techdays2010
NUI the 3rd wave - Techdays2010
 
How Natural User Interfaces are changing Human Computer Interaction
How Natural User Interfaces are changing Human Computer InteractionHow Natural User Interfaces are changing Human Computer Interaction
How Natural User Interfaces are changing Human Computer Interaction
 
SHiFT2010 - Next Wave of UX
SHiFT2010 - Next Wave of UXSHiFT2010 - Next Wave of UX
SHiFT2010 - Next Wave of UX
 
Get To Know Silverlight
Get To Know SilverlightGet To Know Silverlight
Get To Know Silverlight
 

Recently uploaded

Implementing KPIs and Right Metrics for Agile Delivery Teams.pdf
Implementing KPIs and Right Metrics for Agile Delivery Teams.pdfImplementing KPIs and Right Metrics for Agile Delivery Teams.pdf
Implementing KPIs and Right Metrics for Agile Delivery Teams.pdfVictor Lopez
 
GraphSummit Stockholm - Neo4j - Knowledge Graphs and Product Updates
GraphSummit Stockholm - Neo4j - Knowledge Graphs and Product UpdatesGraphSummit Stockholm - Neo4j - Knowledge Graphs and Product Updates
GraphSummit Stockholm - Neo4j - Knowledge Graphs and Product UpdatesNeo4j
 
StrimziCon 2024 - Transition to Apache Kafka on Kubernetes with Strimzi
StrimziCon 2024 - Transition to Apache Kafka on Kubernetes with StrimziStrimziCon 2024 - Transition to Apache Kafka on Kubernetes with Strimzi
StrimziCon 2024 - Transition to Apache Kafka on Kubernetes with Strimzisteffenkarlsson2
 
Abortion ^Clinic ^%[+971588192166''] Abortion Pill Al Ain (?@?) Abortion Pill...
Abortion ^Clinic ^%[+971588192166''] Abortion Pill Al Ain (?@?) Abortion Pill...Abortion ^Clinic ^%[+971588192166''] Abortion Pill Al Ain (?@?) Abortion Pill...
Abortion ^Clinic ^%[+971588192166''] Abortion Pill Al Ain (?@?) Abortion Pill...Abortion Clinic
 
AI/ML Infra Meetup | ML explainability in Michelangelo
AI/ML Infra Meetup | ML explainability in MichelangeloAI/ML Infra Meetup | ML explainability in Michelangelo
AI/ML Infra Meetup | ML explainability in MichelangeloAlluxio, Inc.
 
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital TransformationWSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital TransformationWSO2
 
Facemoji Keyboard released its 2023 State of Emoji report, outlining the most...
Facemoji Keyboard released its 2023 State of Emoji report, outlining the most...Facemoji Keyboard released its 2023 State of Emoji report, outlining the most...
Facemoji Keyboard released its 2023 State of Emoji report, outlining the most...rajkumar669520
 
How to install and activate eGrabber JobGrabber
How to install and activate eGrabber JobGrabberHow to install and activate eGrabber JobGrabber
How to install and activate eGrabber JobGrabbereGrabber
 
AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...
AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...
AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...Alluxio, Inc.
 
AI/ML Infra Meetup | Perspective on Deep Learning Framework
AI/ML Infra Meetup | Perspective on Deep Learning FrameworkAI/ML Infra Meetup | Perspective on Deep Learning Framework
AI/ML Infra Meetup | Perspective on Deep Learning FrameworkAlluxio, Inc.
 
Benefits of Employee Monitoring Software
Benefits of  Employee Monitoring SoftwareBenefits of  Employee Monitoring Software
Benefits of Employee Monitoring SoftwareMera Monitor
 
Breaking the Code : A Guide to WhatsApp Business API.pdf
Breaking the Code : A Guide to WhatsApp Business API.pdfBreaking the Code : A Guide to WhatsApp Business API.pdf
Breaking the Code : A Guide to WhatsApp Business API.pdfMeon Technology
 
Agnieszka Andrzejewska - BIM School Course in Kraków
Agnieszka Andrzejewska - BIM School Course in KrakówAgnieszka Andrzejewska - BIM School Course in Kraków
Agnieszka Andrzejewska - BIM School Course in Krakówbim.edu.pl
 
How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?
How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?
How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?XfilesPro
 
A Python-based approach to data loading in TM1 - Using Airflow as an ETL for TM1
A Python-based approach to data loading in TM1 - Using Airflow as an ETL for TM1A Python-based approach to data loading in TM1 - Using Airflow as an ETL for TM1
A Python-based approach to data loading in TM1 - Using Airflow as an ETL for TM1KnowledgeSeed
 
top nidhi software solution freedownload
top nidhi software solution freedownloadtop nidhi software solution freedownload
top nidhi software solution freedownloadvrstrong314
 
JustNaik Solution Deck (stage bus sector)
JustNaik Solution Deck (stage bus sector)JustNaik Solution Deck (stage bus sector)
JustNaik Solution Deck (stage bus sector)Max Lee
 
Crafting the Perfect Measurement Sheet with PLM Integration
Crafting the Perfect Measurement Sheet with PLM IntegrationCrafting the Perfect Measurement Sheet with PLM Integration
Crafting the Perfect Measurement Sheet with PLM IntegrationWave PLM
 

Recently uploaded (20)

Implementing KPIs and Right Metrics for Agile Delivery Teams.pdf
Implementing KPIs and Right Metrics for Agile Delivery Teams.pdfImplementing KPIs and Right Metrics for Agile Delivery Teams.pdf
Implementing KPIs and Right Metrics for Agile Delivery Teams.pdf
 
GraphSummit Stockholm - Neo4j - Knowledge Graphs and Product Updates
GraphSummit Stockholm - Neo4j - Knowledge Graphs and Product UpdatesGraphSummit Stockholm - Neo4j - Knowledge Graphs and Product Updates
GraphSummit Stockholm - Neo4j - Knowledge Graphs and Product Updates
 
StrimziCon 2024 - Transition to Apache Kafka on Kubernetes with Strimzi
StrimziCon 2024 - Transition to Apache Kafka on Kubernetes with StrimziStrimziCon 2024 - Transition to Apache Kafka on Kubernetes with Strimzi
StrimziCon 2024 - Transition to Apache Kafka on Kubernetes with Strimzi
 
Abortion ^Clinic ^%[+971588192166''] Abortion Pill Al Ain (?@?) Abortion Pill...
Abortion ^Clinic ^%[+971588192166''] Abortion Pill Al Ain (?@?) Abortion Pill...Abortion ^Clinic ^%[+971588192166''] Abortion Pill Al Ain (?@?) Abortion Pill...
Abortion ^Clinic ^%[+971588192166''] Abortion Pill Al Ain (?@?) Abortion Pill...
 
AI/ML Infra Meetup | ML explainability in Michelangelo
AI/ML Infra Meetup | ML explainability in MichelangeloAI/ML Infra Meetup | ML explainability in Michelangelo
AI/ML Infra Meetup | ML explainability in Michelangelo
 
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital TransformationWSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
 
Facemoji Keyboard released its 2023 State of Emoji report, outlining the most...
Facemoji Keyboard released its 2023 State of Emoji report, outlining the most...Facemoji Keyboard released its 2023 State of Emoji report, outlining the most...
Facemoji Keyboard released its 2023 State of Emoji report, outlining the most...
 
How to install and activate eGrabber JobGrabber
How to install and activate eGrabber JobGrabberHow to install and activate eGrabber JobGrabber
How to install and activate eGrabber JobGrabber
 
AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...
AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...
AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...
 
AI/ML Infra Meetup | Perspective on Deep Learning Framework
AI/ML Infra Meetup | Perspective on Deep Learning FrameworkAI/ML Infra Meetup | Perspective on Deep Learning Framework
AI/ML Infra Meetup | Perspective on Deep Learning Framework
 
Corporate Management | Session 3 of 3 | Tendenci AMS
Corporate Management | Session 3 of 3 | Tendenci AMSCorporate Management | Session 3 of 3 | Tendenci AMS
Corporate Management | Session 3 of 3 | Tendenci AMS
 
Benefits of Employee Monitoring Software
Benefits of  Employee Monitoring SoftwareBenefits of  Employee Monitoring Software
Benefits of Employee Monitoring Software
 
Breaking the Code : A Guide to WhatsApp Business API.pdf
Breaking the Code : A Guide to WhatsApp Business API.pdfBreaking the Code : A Guide to WhatsApp Business API.pdf
Breaking the Code : A Guide to WhatsApp Business API.pdf
 
Agnieszka Andrzejewska - BIM School Course in Kraków
Agnieszka Andrzejewska - BIM School Course in KrakówAgnieszka Andrzejewska - BIM School Course in Kraków
Agnieszka Andrzejewska - BIM School Course in Kraków
 
Top Mobile App Development Companies 2024
Top Mobile App Development Companies 2024Top Mobile App Development Companies 2024
Top Mobile App Development Companies 2024
 
How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?
How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?
How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?
 
A Python-based approach to data loading in TM1 - Using Airflow as an ETL for TM1
A Python-based approach to data loading in TM1 - Using Airflow as an ETL for TM1A Python-based approach to data loading in TM1 - Using Airflow as an ETL for TM1
A Python-based approach to data loading in TM1 - Using Airflow as an ETL for TM1
 
top nidhi software solution freedownload
top nidhi software solution freedownloadtop nidhi software solution freedownload
top nidhi software solution freedownload
 
JustNaik Solution Deck (stage bus sector)
JustNaik Solution Deck (stage bus sector)JustNaik Solution Deck (stage bus sector)
JustNaik Solution Deck (stage bus sector)
 
Crafting the Perfect Measurement Sheet with PLM Integration
Crafting the Perfect Measurement Sheet with PLM IntegrationCrafting the Perfect Measurement Sheet with PLM Integration
Crafting the Perfect Measurement Sheet with PLM Integration
 

UTAD - Jornadas de Informática - Potential of Big Data

  • 1.
  • 2.
  • 3.
  • 4.
  • 8. • Analysis • Transportation • Access Control • Replication
  • 9. • Analysis • Transportation • Access Control • Replication • Storage
  • 10.
  • 11.
  • 12.
  • 13.
  • 14.
  • 15. Data at Rest Data in Motion Data in Many Forms Data in Doubt Data into Money
  • 16.
  • 17.
  • 18.
  • 19. map (in_key, in_value) -> list(out_key, intermediate_value) reduce (out_key, list(intermediate_value)) -> list(out_value)
  • 20. Read lines from file Convert line to Key-Value Pair(s) Filter (by key/value) Combine Values with similar Keys Shuffle data across nodes for reduces by Key Sort by Key Aggregate (reduce) Filter (based on aggregated value) Write results to file Map Reduce
  • 21. Deer Bear River Car Car River Deer Car Bear Deer Bear River Car Car River Deer Car Bear Deer, 1 Bear, 1 River, 1 Car, 1 Car, 1 River, 1 Deer, 1 Car, 1 Bear, 1 Bear, 1 Bear, 1 Car, 1 Car, 1 Car, 1 Deer, 1 Deer, 1 River, 1 River, 1 Bear, 2 Car, 3 Deer, 2 River, 2 Bear, 2 Car, 3 Deer, 2 River, 2
  • 22.
  • 23. Windows Azure Blob Storage (WABS) Distributed File System Applications (by cluster type) Spark  Spark  Spark Streaming  Spark MLlib Storm  Storm  Kafka HBase  HBase  Zookeeper …. Hadoop  HDFS APIs  MapReduce  Sqoop  Pig  Hive (Tez)  Mahout  Oozie Yet Another Resource Negotiator (YARN) Acquisition  Azure Data Factory Stream Processing • Steam Analytics • Event Hub Machine Learning  Azure Machine Learning NoSQL  Table Storage  DocumentDB
  • 24.
  • 25.
  • 28. Process real-time data in Azure using a simple SQL language Consumes millions of real-time events from Event Hub collected from devices, sensors, infrastructure, and applications Performs time-sensitive analysis using SQL-like language against multiple real-time streams and reference data Outputs to persistent stores, dashboards or back to devices Point of Service Devices Self Checkout Stations Kiosks Smart Phones Slates/ Tablets PCs/ Laptops Servers Digital Signs Diagnostic EquipmentRemote Medical Monitors Logic Controllers Specialized DevicesThin Clients Handhelds Security POS Terminals Automation Devices Vending Machines Kinect ATM
  • 29. Fully managed service to support orchestration of data movement and processing Connect to relational or non-relational data that is on-premises or in the cloud Single pane of glass to monitor and manage data processing pipelines. Publish to Power BI Compose and orchestrate data services at scale C# MapReduce Trusted data BI & analytics Hive Pig Stored Procedures Azure Machine Learning
  • 30. ML Algorithms are best of breed and embrace OSS • MS + R + Python + BYOA ML Studio for productive development • Faster experiments results in faster improvements • Visual Workflows & ML Experiments ML Operationalization to remove deployment friction • Build entire ML Apps & Deploy as Cloud APIs ML Gallery • Provide ML applications like apps in an ‘app store’ • Publish/consume APIs in a 2 sided market Help organizations eliminate undifferentiated heavy lifting Powerful predictive analytics in Azure Azure Machine Learning
  • 31. Enable enterprise-wide self-service data source registration and discovery A metadata repository that allow users to register, enrich, understand, discover, and consume data sources Delivers differentiated value though ‒ Data source discovery; rather than data discovery ‒ Support for data from any source; Structured and unstructured, on premises and in the cloud ‒ Publishing, discovery and consumption through any tool ‒ Annotation crowdsourcing: empowering any user to capture and share their knowledge. This, while allowing IT to maintain control and oversight
  • 32.
  • 33. Power Map with custom maps allows deeper geospatial explorations and storytelling Power Query brings modern data discovery, connectivity, shaping and publishing to Excel Analysis Services connectivity for Power View allows users to leverage existing IT investments Support for more sophisticated data models in Power Pivot – date and calc tables, many-to-many relationships, etc Power Map w/ Custom Maps Power Query
  • 34. Power BI dashboards and KPIs for monitoring the health of your business New data visualizations and touch- optimized exploration in HTML5 Power BI mobile apps across devices including iPad and iPhone Support for new data sources including SalesForce.com, Dynamics CRM online and SQL Server Analysis Services Dashboard Tree Map
  • 35. A hyper scale repository for big data analytic workloads • Hadoop File System compatible with HDFS™ • Integrated with HDInsight, Revolution R, Hortonworks, Cloudera • Based on YARN • Petabyte-sized files • No size limits to data in single account • Massive throughput to increase performance • AAD based access control • Data management Devices
  • 36. Azure Data Lake Analytics Service A new distributed analytics service Built on Apache YARN Scales dynamically with the turn of a dial Pay by the query Supports Azure AD for access control, roles, and integration with on-prem identity systems Built with U-SQL to unify the benefits of SQL with the power of C# Processes data across Azure 37
  • 37. Stream Analytics TransformIngest Example overall data flow and Architecture Web logs Present & decide IoT, Mobile Devices etc. Social Data Event Hubs HDInsight Azure Data Factory Azure SQL DB Azure Data Lake Azure Machine Learning (Fraud detection etc.) Power BI Web dashboards Mobile devices DW / Long-term storage Predictive analytics Event & data producers Azure SQL DW
  • 38.
  • 39. From zero to finished, analytical apps and scenarios Pre-Configured Allows customers to accelerates the process of building analytical apps Go from zero to sample app in minutes, from sample app to finished solution in a week
  • 40.
  • 41.
  • 42.
  • 43. The Internet of Things – Manufacturing GLOBAL OPERATIONS I can see my production line status and recommend adjustments to better manage operational cost. I know when to deploy the right resources for predictive maintenance to minimize equipment failures and reduce service cost. I gain insight into usage patterns from multiple customers and track equipment deterioration, enabling me to reengineer products for better performance. MANUFACTURING PLANT Aggregate product data, customer sentiment, and other third-party syndicated data to identify and correct quality issues. Manage equipment remotely, using temperature limits and other settings to conserve energy and reduce costs. Monitor production flow in near-real time to eliminate waste and unnecessary work in process inventory. GLOBAL FACILITY INSIGHT Implement condition- based maintenance alerts to eliminate machine down-time and increase throughput. THIRD-PARTY LOGISTICS Provide cross-channel visibility into inventories to optimize supply and reduce shared costs in the value chain. CUSTOMER SITE Transmits operational information to the partner (e.g. OEM) and to field service engineers for remote process automation and optimization. Management R&D Field Service
  • 44. The Internet of Things – Retail Marketing MOBILE EXPERIENCE STORE PURCHASE HISTORY: Dog food M T W Th F Weather Data Merchandizing IN-STORE SHOPPING Online Behavior Shopping Route REFLECTION BEST DEAL INSPIRATION, DISCOVERY, PRE-SHOPPING Purchase History RIGHT OFFER, RIGHT TIME, RIGHT PLACE IoT DATA FUELS CUSTOMER AND PRODUCT INSIGHTS 1001001001001001001011010010101100101101001010000101010101011010010110100101010 CHECKOUT Retail 200ft Have you seen these! We’re ready for the rain! #ShoppingSuccess 42
  • 45. The Internet of Things – Hospitality & Travel Save money with more accurate arrival time predictions Provide a seamless traveler experience from the curb to the gate, and enable context-sensitive notifications Provide guests with a connected tablet to control room settings, request services, and provide feedback—and save their preferences Centrally manage critical station assets—everything from communication and security networks to escalators and HVAC control systems Send reports and sensor data to maintenance crews for faster turnaround Configure notifications on employee devices of restaurant equipment maintenance needs Manage inventory in near real time, and monitor food storage temperatures and expirations NEW GATE: B7 25% off ON TIME
  • 46.

Editor's Notes

  1. The Cortana Analytics Suite integrates with Cortana, Microsoft’s digital personal assistant. Cortana works with the Cortana Analytics Suite to enable your business, and or your customers business, to get things done in more helpful, proactive, and natural ways. Building on years of Microsoft’s research and innovation in perceptual intelligence including speech recognition, natural user interaction, predictive and advanced analytics, Cortana brings the capabilities of a personal digital assistant to business. Cortana Analytics helps you Interact with customers and stakeholders in new ways and infer intent with vision, face, speech, text and sentiment analysis to customize responses and drive appropriate actions. We call this Perceptual Intelligence. The Vision, Face, Text and Speech APIs enable these new types of scenarios. What we showcased with www.how-old.net is a small example of what is possible.
  2. Cortana Analytics Suite delivers an end-to-end platform with integrated and comprehensive set of tools and services to help you build intelligent applications that let you easily take advantage of Advanced Analytics. First Cortana Analytics Suite provides services to bring data in, so that you can analyze it.  It provides information management capabilities like Azure Data Factory so that you can pull data from any source (relational DB like SQL or non-relational ones like your Hadoop cluster) in an automated and scheduled way, while performing the necessary data transforms (like setting certain data colums as dates vs. currency etc).  Think ETL (Extract, Transform, Load) in the cloud. Event hub does the same for IoT type ingestion of data that streams in from lots of end points. The data brought in then can be persisted in flexible big data storage services like Data Lake and Azure SQL DW. You can then use a wide range of analytics services from Azure ML to Azure HDInsight to Azure Stream Analytics to analyze the data that are stored in the big data storage.  This means you can create analytics services and models specific to your business need (say real time demand forecasting). The resultant analytics services and models created by taking these steps can then be surfaced as interactive dashboards and visualizations via Power BI These same analytics services and models created can also be integrated into various different UI (web apps or mobile apps or rich client apps) as well as via integrations with Cortana, so end users can naturally interact with them via speech etc., and so that end users can get proactively be notified by Cortana if the analytics model finds a new anomaly (unusual growth in certain product purchases- in the case of real time demand forecasting example given above) or whatever deserves the attention of the business users.
  3. As I mentioned, these products and services are available to transact today. Our data science team and field teams have seen 4 key areas in which there is the most opportunity. For example, sales and marketing is an area where there is an explosion of non-sensitive customer sentiment and transaction data which is a perfect match for the scalability of the cloud. In customer and channel, we’re also seeing a tremendous level of demand for personalized offers across retail and financial services online and in store. Cortana Analytics is the Suite that can deliver on these scenarios and more.
  4. Areas of investment for BI in Excel: Filtering for Power Map: Available Sept 2014: With filtering in Power Map, use familiar Excel filter controls to uncover more insights from your 3D geospacial visualizations. When using filters, you can adjust the amount of data shown, toggle between different categories or simply search and select specific values for more targeted analyses. Custom Maps for Power Map: Available Sept 2014: Custom Maps extends all the features of Power Map so you can tell rich and interactive stories using any map type. Simply choose an image – like building floor maps, the human body, public transit routes, and system architectures - and Excel will guide you through transforming your data into visualizations that can be explored and shared. OLAP Connectivity within Power View: Connect Power View in Excel to an external Analysis Services model without the need to import the data into Excel. Richer Data Models with Power Pivot: We are enhancing Power Pivot to enable you to create and analyze richer data models, like calculated tables and many-to-many relationships. The relationship between your business data can be complex and Power Pivot, with more powerful data modeling capabilities, allows you to analyze that data effectively to uncover deeper insights that will boost your competitive edge. Deeper Integration of BI in Excel: Power BI for Office 365 adds value to your businesses because it makes BI accessible to your entire team through the familiarity of Excel. The Power BI features in Excel will be integrated more deeply to make it even easier for any business user to discover and start benefiting from the collective intelligence of your business community.
  5. Areas of investment for Power BI Power BI dashboards and KPIs – Power BI will provide new capabilities to allow for the creation of live dashboards and easy to create KPIs that can be pinned to the dashboard - from which you can drill into underlying Power View reports for additional detail and data exploration. New data visualizations – we will introduce a host of new data visualizations for Power BI. eg. Tree Map. Touch optimized data exploration in Power View HTML5 – Power View will gain new touch optimized data exploration features allowing users to explore data more easily on touch devices. Power BI mobile applications – beyond the mobile experiences provide through HTML5 we also continue to invest in providing native mobile apps and will soon support both iPad and iPhone. Support for new data sources such as SalesForce.com and Dynamics CRM – new data sources will be added such as SalesFoce.com and tighter integration with CRM online. Support for SQL Server Analysis Services – Power Query will support SQL Server Analysis Services as a data source. Power BI will also support interactive query directly to SQL Server Analysis services on-premises. This will be to both tabular and multidimensional cubes. This will allow organizations to managing and maintain their existing Analysis Services models without having to move their data to the cloud. Users will be able to view and explore their data from Power View in Power BI and the system will directly connect and query against SQL Server Analysis Service on-premises.
  6. A new distributed analytics service Built on Apache YARN Dynamically scales Handles jobs of any scale instantly by simply setting the dial for how much power you need. You only pay for the cost of the query Supports Azure Active Directory for Access Control, Roles, Integration with on-premises identity systems It also includes U-SQL, a language that unifies the benefits of SQL with the expressive power of C# U-SQL’s scalable runtime processes data across multiple Azure data sources
  7. In a moment Sanjay will show you how Pier 1 is truly putting their data to work. They’re experimenting with monitoring in-store activity with the power of Kinect sensors and combining that with data from customer activity on the web. They’re ingesting that through Event hubs and then putting the data that needs further processing into Azure Data Factory to use HDInsight for batch processing. Stream Analytics takes on data as well. Data Factory then moves that data into Blob storage, where it’s further processed and combined with the Analytics data already sent to Azure SQL Database. Then that Azure DB data is sent to Azure ML, where it can then be modeled, made sense out of, to then deliver predictive results to any number of devices and visualization tools. Does this sound like a lot and a lot of things to buy? Perhaps it does. But what you have bought here – all you need to do all this is Azure. That’s the beauty of the cloud.
  8. https://www.microsoft.com/cognitive-services
  9. http://gallery.cortanaintelligence.com/
  10. Manufacturing Plant Manage data remotely from a centralized location and push updates and key notifications to the factory floor, making relevant information available to manufacturing employees. Monitor whether components are arriving at the plant floor as expected, and slow production if needed to reduce or eliminate excess work-in-process inventory Predefine rules for equipment use and plant management (e.g. shut down production or equipment based on demand or environmental data), to optimize productivity and profitability Establish predictive maintenance schedules - with planned maintenance, cost of operations can be reduced and throughput can be increased Identify and correct quality issues – with IoT and the ability to perform Big Data analytics, manufacturers can increase the number of quality checks that are performed, collect more quality inspection data and analyze more data than ever before. This enables them to spot defect patterns, and correct them more quickly. This also enables manufacturers to create predictive algorithms so that times/places where quality issues may occur are identified ahead of time. (e.g. extra humid day might imply more likelihood of quality issues)   Customer Site and Third-Party Logistics Continue to collect data from products once they leave the factory floor (e.g. throughout the distribution process and once implemented into customer sites) to help drive predictive maintenance and inform product improvements E.g. a water pump could send data indicating that it will break down in 2-3 weeks. An analyst at the customer’s OEM or service provider could determine whether the pump is in need of simple repairs, or whether it makes sense to refurbish it. The analyst could also identify a spare parts promotion that the customer could take advantage of so the customer is prepared for future maintenance needs Access more data than ever before and integrate with 3rd party syndicated data to improve process and quality control (e.g. use data on regional weather patterns to determine locations where weather conditions will result in higher demand, or view data about fuel and other input prices to predict profit margins) Provide ‘single pane of glass’ visibility across all distribution/sales channels – this enables better inventory management and savings on logistics and distribution costs because the full channel would know would where products are, so redundancies can be reduced Global Operations powerful BI tools – derive business insights from Big Data analytics Make data available to the right individuals for a variety of purposes based on role, such as product development, facility and device servicing, or business and operations management
  11. The Retail industry is dealing with major shifts in consumer shopping behavior, preferences, and expectations, largely driven by new technologies and form factors. As consumers, we expect to access information in ways that are fast but familiar to us in every aspect of our daily lives, including when shopping for groceries, visiting an ATM, or checking out at a store. By building an end-to-end omni-channel solution based on Microsoft and partner technology, you can deliver the seamless, relevant experiences that your customers expect in today’s digital world. With IoT, almost every interaction among customers involving products and services can be captured, measured, and analyzed. You can gather where the shopper goes and everything they do – on Instagram or Twitter, up and down your aisles, on your website. Which freezer case did they open? What products did they carry into the fitting room? Or, what was weather like at the time? Warm and sunny? Cold and rainy? While you once relied on data from the cash register, with IoT you now can collect data from a variety of store sensors, RFID data, integration with external sources like social media and weather reports, and more. All these points of customer interaction, or touch points, can be considered as a sort of “shopstream” – where data exhaust is produced at each step along the customer journey. Millions of data points available from all of these new interactions enable you to create far more granular customer segmentations and make very accurate predictions about their behavior. You can drive increasingly relevant, personalized campaigns with data collected on individual customer behavior. Apply machine learning to all the ways the consumer is interacting with you and get a 360-degree view of the customer—tracking, understanding and gaining insight across all channels—that then informs marketing and merchandising to enable the delivery of the highest value offers. Improve your business performance by turning data into relevant context—turning all that exhaust into relevant insights. Get the right offer back to the customer at the right time – on the web, on their mobile phone, at the shelf, or at the cash register. In our example here, we have a customer on their home computer demonstrating the many ways shoppers are informed about the products and services they want. This phase of the customer journey is a lot like Pinterest, as they plan, combine, view, and get inspiration. Wanting to attract customers into your online and physical storefronts, you want to be in the showcases where your customers are. Monitor Instagram behavior, and turn that into knowledge of your customer. Collect traffic from Twitter, Facebook, Groupon, etc., and use that to drive traffic in and yield greater returns based on relevancy and upsell. The best offers require context and relevance. Use location tracking on carts, cell phones or video cameras to gain a more complete picture of the customer in-store experience. Combine that insight with what you’ve learned from the customer’s pre-shopping experiences, and send personalized recommendations and promotions based on customer location and preferences. Target your customers in store with store apps, so that they continue their product searching in your store. Keep attention in the store with more effective real time offers and segmentation models. Help your customers to see your store as a destination. In Retail, the recent surge in the presence of edge devices such as point of service solutions, digital signage, kiosks and handheld devices has become just as important in the store as applications for mobile phones, tablets, and PCs for consumers. Enable customers to simply tap their smart phone at the cash register to pay—and be on their way, excited to share about their recent shopping success. Create a leading-edge solution based on Microsoft technologies, and you’ll realize the untapped potential of your business data, giving you the competitive edge that comes from providing the best in customer service. Enable a personal, seamless, and differentiated shopping experience.
  12. IoT enables hospitality and travel organizations to create personal, seamless, and differentiated guest experiences while gaining business agility. The following are just a few quick examples to get you thinking. Airline With the proliferation of mobile and online applications replacing traditional face-to-face interactions, passengers are demanding a seamless traveler experience. Microsoft is delivering capabilities to transform the passenger experience from the curb to the gate. Provide your customers with the best deal, the best experience, and a real relationship with their favorite company. IoT solutions dramatically improves your ability to understand and serve your customers. Enable passengers to self-check bags with RFID luggage tags associated with frequent flyer data, reducing baggage loss and infrastructure requirements and providing passengers with more time to shop in retail stores and order services. Retail stores can send context-relevant promotions as passengers walk by. You can also send notifications regarding gate changes or departure times. Then, enable restaurant recommendations for passengers near a new gate assignment. Save millions of dollars with more accurate arrival time predictions. Use machine learning, sensor data, weather data, and other inputs to fine tune predictions and provide ground crews and passengers with the most accurate arrival information. Differentiate yourself in the highly-competitive airline industry by offering new in-flight customer experiences. Microsoft is helping transform onboard sales into an online, fast, connected experience. Integrate with payment acquirers so that flight attendants get an instantaneous response when swiping a credit card during onboard sales transactions. Engage directly with your passengers, surround them with brand information and entertainment, and bring the richness of online information to the plane. In-flight engagement solutions enable the comprehensive and connected consumer experience and increased ancillary services. With modern electronic flight bag applications, pilots employ a single device for planning, filing, and flying, reducing the weight required for paper flight books on-board. The same device provides collaboration and corporate communications over a highly secure connection, whether swapping shifts with other pilots, consuming training, or simply checking and responding to email. Together, these solutions come together to create a seamless, connected experience for flight crews and travelers. Cruise Use business intelligence to analyze the revenue-generating performance of the various venues and activities onboard ships to identify best practices that generate the most profit and deliver the best guest experience. Tap into existing resources to create new business intelligence—gather information from multiple connected devices and systems, including POS terminals, ticketing systems, and in-room amenities. The more information you can collect about guests, the more you can customize your products for them. For example, as ships travel between ports and passenger loads and demographics change, segment passengers by demographic and analyze their propensity to spend and participate in spa, photo, retail, laundry, and other areas of the ship. Dynamically change your offerings, retail inventory, and activities to match the preferences of the guests onboard. Learning behavior patterns by passenger groups and adjusting offerings and programs to better reflect passenger preferences increases revenue and gives customers a better experience. Centrally monitor critical ship assets and reduce equipment downtime. Streamline formerly manual maintenance processes with proactive response to near real-time data. Meaningful data from sensors and intelligent edge devices are all available securely in the cloud to provide access to needed information on mobile apps, via a Web browser or through text alerts. Provide an advanced field maintenance solution, enabling work flows for utility work crews through hand-held devices. Instead of going to an office, maintenance technicians can get work orders electronically from anywhere on the ship or dock. In the past, it may have taken more than 30 minutes just for technicians to pick up a new work order and return to the site. But now they can quickly retrieve a work order on their devices, finish the job, and notify people that the project is complete. Connecting handheld devices with existing IT infrastructure and food storage equipment can improve workflow throughout the ship, including reducing food-inspection time. To monitor food temperature, deliver inspection tasks and checklists to handheld devices. An employee can use the device’s built-in RFID sensor to read tags installed in coolers. Within seconds, the device downloads temperature records collected during the previous visit and compares them to the current reading. The device immediately alerts the user if the cooler is non-compliant and suggests corrective actions to resolve the problem. Then it sends a message to the facility maintenance team to check the cooler, and the employee moves on to inspect the next station. Use an integrated temperature probe on devices to monitor food temperatures on buffet lines and other open areas. The automated processes replace digital kitchen thermometers and paper logs. Instead of manually transferring records from logs to spreadsheet software, inspectors can immediately run reports against the data collected. Rail Ensure passengers reach their destinations on time and in the greatest comfort possible. Provide passengers with a better experience—for example, supply information on digital signs and to passengers’ mobile devices. Improve on-board service for passengers and gather data to understand purchase patterns and make accurate stock decisions. Implement a point-of-sale solution that connects remotely to financial and business systems and aid transactions from train carts and cafes. Reduce service delays and the cost of equipment downtime. Streamline formerly manual processes with proactive response to near real-time data. Meaningful data from sensors and intelligent edge devices — to closely monitor temperature, vibration, humidity, fault warnings and system alerts — are all available securely in the cloud to provide access to needed information on mobile apps, via a Web browser or through text alerts. Provide an advanced field maintenance solution, enabling work flows for utility work crews through hand-held devices. Centrally monitor critical station assets, such as escalators, elevators, and HVAC control systems. Connected security networks and personnel heighten security visibility to save more lives. Hospitality Drive improvements in your business by reducing travel stress and uncertainty, and by encouraging collaboration among your customers and employees. Implement technologies that offer a more consistent and personalized experience across various channels. Provide guests with a connected tablet to personalize and customize room settings, including the thermostat, lighting, windows shades, and stereo—and save their preferences. When they visit any of your other hotels around the globe, their room can automatically sync with their preferences. Enable the property manager to view room statuses as well, and send staff to repair any issues or change a light bulb as needed. Create a more unique and on-brand experience with guests; device apps can provide guests with information about the hotel, its offerings, and local attractions and act as a valuable source of information that you can use to build customer connections. Offer guests interactive touch-enabled computing to enhance their social experience at your hotels with personalized, highly secure computing experiences. With custom apps, such as an online concierge, capture guest information to improve service delivery and increase competitive advantage. Quick Service Restaurant Improve service with a solution that is fast, secure, and reliable, and drive better decisions with greater data access. Ease business expansion and management. Cut time to open new restaurants and easily push the latest data to existing locations. When you open a new store, create a package that you can deploy quickly though the cloud, and deliver all the necessary information with the click of a button. You can also update software, menu items, prices, coupons and more across multiple locations. Managers have instant access to current sales, inventory, and workforce information. Improve efficiency and enhance the customer experience. Install a point-of-service solution with easy-to-use, engaging self-service touch screens as well as kitchen displays and order confirmation boards connected to a corporate network and cloud-based services. Take orders faster and more accurately so that customers feel good about their visits. Electronically store and search receipts. Control food and labor costs to improve profitability. Managers can look at daily inventory of food items as well as when employees signed in and out of shifts. Connected inventory management enables much more accurate correlation between actual and ideal cost. With alerts from sensors installed in cookers, refrigerators, coffee machines, and more, easily identify mechanical problems and address them quickly. Configure notifications on employee devices of restaurant equipment maintenance needs. Use built-in RFID sensors to read tags installed in coolers. Use devices with integrated temperature probes to monitor food temperatures on buffet lines, in food cases and in other open areas.