SlideShare a Scribd company logo
©2017 Xanadu Big Data, LLC All Rights Reserved www.xanadubigdata.com
Xanadu for
Big Data + IoT + Deep Learning + Cloud
Integration Strategy
July 25, 2017
Alex G. Lee (alexglee@xanadubigdata.com)
©2017 Xanadu Big Data, LLC All Rights Reserved
Index
-Big Data in IoT & Deep Learning
-Challenges of IoT Big Data Analytics Applications
-Challenges of Cloud-based IoT Platform
-Cloud-based IoT Platform Use Case: GE Predix for Smart Building
Energy Management
-Fog/Edge Computing & Micro Data Centers
-Deep Learning for IoT Big Data Analytics Introduction
-Deep Learning for IoT Big Data Analytics Use Case
-Distributed Deep Learning
-Big Data + IoT + Cloud + Deep Learning Insights from Patents
-Big Data + IoT + Cloud + Deep Learning Strategy Development
-Designing Data-Intensive Applications
-Xanadu Functionality
-Xanadu Use Case
-Xanadu + Deep Learning + Hadoop Integration
©2017 Xanadu Big Data, LLC All Rights Reserved
Big Data in IoT & Deep Learning
Big Data IoT Deep Learning
Volume:
Size of Data
Very large volumes of
data from sensors and
connected devices
Increase in algorithm
complexity and
computing time
Velocity:
Data Processing Speed
Real time streaming data
of very shot time scales,
high frequencies, high
ingestion rates
Difficulty in data learning
process in a timely
manner
Variety:
Different Types of Data
Heterogeneous datasets
from geographically
distributed diverse IoT
sensors and connected
devices
Increase in data
processing diversity for
different data
characteristics and
behavior
Veracity:
Truthfulness of Data
Noisy & incomplete data
which are characterized
by uncertainty; Data
security issues
Significant increase in
pre-processing of data
©2017 Xanadu Big Data, LLC All Rights Reserved
How to provide interoperability among heterogenious IoT data streams in
formats, velocities, and semantics?
How to provide data reliability by taking into account noisy and
incomplete nature of IoT data streams?
How to process nearly real-time streaming IoT data?
How to deal with temporal and special dependences of IoT data?
How to comply with security and privacy requirements of IoT data?
Challenges of IoT Big Data Analytics Applications
©2017 Xanadu Big Data, LLC All Rights Reserved
A cloud-based IoT platform should provide a dynamic and flexible
analytics resource sharing platform delivering IaaS, PaaS, and SaaS.
A cloud-based IoT platform should provide optimized data management
and processing across multiple geographically distributed datacenters.
A cloud-based IoT platform should provide required quality of service
guarantees regarding data storage management and security and
privacy of sensitive data.
A cloud-based IoT platform should provide low latency end-to-end
processing of IoT data.
Challenges of Cloud-based IoT Platform
©2017 Xanadu Big Data, LLC All Rights Reserved
Cloud-based IoT Platform Use Case:
GE Predix for Smart Building Energy Management
GE Current demo@GE Predix Boston (Industrial Internet) Meetup
©2017 Xanadu Big Data, LLC All Rights Reserved
Fog/Edge computing extends the cloud computing and services to near
the IoT sensors and connected devices.
Fog/Edge computing is similar to the cloud computing in data storage and
management, data processing and application services, but significantly
different in terms of its short geographical distance from edgy devices,
its dense geographical distribution, and its support for mobility.
Fog/Edge computing requires micro data centers that are scalable,
flexible and agile data centers co-located with distributed IoT data
sources.
Fog/Edge Computing & Micro Data Centers
©2017 Xanadu Big Data, LLC All Rights Reserved
Deep Learning for IoT Big Data Analytics Introduction
Convolutional Neural Networks (CNNs): image/video analysis
Source: Deep Learning A-Z™: Hands-On Artificial Neural Networks by SuperDataScience@udemy
Recurrent Neural Networks (RNNs):time series analysis
Reinforcement Learning (RL): automatically determine the ideal behaviour
within a specific context, in order to maximize its performance for a specific goal
Source: Reinforcement Learning in Python by Lazy Programmer Inc.@udemy
©2017 Xanadu Big Data, LLC All Rights Reserved
Deep Learning for IoT Big Data Analytics Use Case
CNN + RNN
Source: SoftPoint Consultores S.L.
Deep RL
Source: Mobileye
Source: ODSTCEAST 2017
©2017 Xanadu Big Data, LLC All Rights Reserved
Distributed Deep Learning
Issues with IoT big data in deep learning:
High resolution/scale microscopic images 81,025 pixels by 86,273 pixels
(roughly 6.99 gigapixels) requires 78.12 GB memory to store
Trained on 1.28 M images and evaluated on 50 K images took 2 – 3
weeks using 8 GPU machine in MS ResNet
Distributed training:
In model parallelism, different machines in the distributed system are
responsible for the computations in different parts of a single network - for
example, each layer in the neural network may be assigned to a different
machine.
In data parallelism, different machines have a complete copy of the model;
each machine simply gets a different portion of the data, and results from
each are somehow combined.
For details: Skymind web: http://engineering.skymind.io
©2017 Xanadu Big Data, LLC All Rights Reserved
US20170175645 (GE: IIoT Application)
Deep learning enables automatically learning actionable information
relevant to a desired operation of a gas turbine in industrial plants from
seemingly uncorrelated massive amounts of sensor and controller data.
Big Data + IoT + Cloud + Deep Learning Insights from Patents
©2017 Xanadu Big Data, LLC All Rights Reserved
US20170169358 (Samsung: Fog Computing)
Decentralized deep learning system on the local IoT data using edge
storage network that is configure to store and process streaming IoT data.
Big Data + IoT + Cloud + Deep Learning Insights from Patents
©2017 Xanadu Big Data, LLC All Rights Reserved
US20170060574 (Foghorn Systems: IIoT + Fog Computing)
A real-time edge IoT analytics system that can handle the large amounts
of data generated by industrial machines and provides intelligent edge
computing platform.
Big Data + IoT + Cloud + Deep Learning Insights from Patents
©2017 Xanadu Big Data, LLC All Rights Reserved
US20160196527 (FALKONRY : Smart Logistics)
Cyber-physical supply chain logistics transportation system for predictive
estimation of QoS across supply chains using condition monitoring and
predictive analytics.
Big Data + IoT + Cloud + Deep Learning Insights from Patents
©2017 Xanadu Big Data, LLC All Rights Reserved
Source: Prof. Pierre Azoulay@MIT Sloan Executive Education
Big Data + IoT + Cloud + Deep Learning Strategy Development
©2017 Xanadu Big Data, LLC All Rights Reserved
Chapter 2 Data Models
Chapter 3 Storage and Retrieval
Chapter 5 Replication
Chapter 6 Partitioning
Chapter 7 Transactions
Chapter 8 Trouble with Distributed Systems
Chapter 9 Consistency and Consensus
Chapter 10 Batch Processing
Chapter 11 Stream Processing
Designing Data-Intensive Applications
©2017 Xanadu Big Data, LLC All Rights Reserved
Xanadu enables competitive big data management in the Clouds or
Enterprises
Xanadu Functionality
K
AnyTypes&SizeofData
NoSQL Database
Data De-duplication
Data Replication
Massively Scalable Fault Tolerance
Data Store
NoSQL
Database
ACID Compliance
High
Throughput
Low Latency
Data
Access
©2017 Xanadu Big Data, LLC All Rights Reserved
Xanadu Performance BMT
©2017 Xanadu Big Data, LLC All Rights Reserved
Xanadu Fault Tolerance Test Demo
©2017 Xanadu Big Data, LLC All Rights Reserved
Xanadu provides a composable architecture that can be integrated with
other big data systems
Xanadu Use Case
+
Total Integration
Big Data
Applications
Big Data
IT Infrastructure
Xanadu
Data Management
Platform
GPS /
GLONASS
WCDMA /
LTE
+
©2017 Xanadu Big Data, LLC All Rights Reserved
Xanadu Commodity Storage System Use Case
©2017 Xanadu Big Data, LLC All Rights Reserved
Xanadu Cloud Computing Use Case
©2017 Xanadu Big Data, LLC All Rights Reserved
AlexNet CNN architecture in
DeepLearning4J (DL4J)
Distributed deep leaning on
CPUs/GPUs (+Hadoop/Spark)
Xanadu file system used to store
images and load directly into DL4J
Local Machines & AWS Clusters
Xanadu + Deep Learning + Hadoop Integration
Source: researchgate.net.
Data Source: https://www.kaggle.com/c/diabetic-retinopathy-detection
©2017 Xanadu Big Data, LLC All Rights Reserved
Thank you
Xanadu Big Data, LLC

More Related Content

What's hot

Sap Leonardo IoT Overview
Sap Leonardo IoT OverviewSap Leonardo IoT Overview
Sap Leonardo IoT Overview
Pierre Erasmus
 
Overcoming the AIoT Obstacles through Smart Component Integration
Overcoming the AIoT Obstacles through Smart Component IntegrationOvercoming the AIoT Obstacles through Smart Component Integration
Overcoming the AIoT Obstacles through Smart Component Integration
Innodisk Corporation
 
Why and-how-to-choose-an-iot-platforms-201701
Why and-how-to-choose-an-iot-platforms-201701Why and-how-to-choose-an-iot-platforms-201701
Why and-how-to-choose-an-iot-platforms-201701
Omar Nawaz
 
Accelerating the AIoT @ the EDGE
Accelerating the AIoT @ the EDGE Accelerating the AIoT @ the EDGE
Accelerating the AIoT @ the EDGE
Amazon Web Services
 
Watson IoT Platform Sizing & Pricing - Sept 2016
Watson IoT Platform Sizing & Pricing - Sept 2016Watson IoT Platform Sizing & Pricing - Sept 2016
Watson IoT Platform Sizing & Pricing - Sept 2016
Jason Lu
 
Internet of things (IoT) and big data- r.nabati
Internet of things (IoT) and big data- r.nabatiInternet of things (IoT) and big data- r.nabati
Internet of things (IoT) and big data- r.nabati
nabati
 
Logicalis IoT & Smart Cities (Use Case)
Logicalis IoT & Smart Cities (Use Case)Logicalis IoT & Smart Cities (Use Case)
Logicalis IoT & Smart Cities (Use Case)
Cloudera, Inc.
 
IoT NY - Google Cloud Services for IoT
IoT NY - Google Cloud Services for IoTIoT NY - Google Cloud Services for IoT
IoT NY - Google Cloud Services for IoT
James Chittenden
 
Key Data Management Requirements for the IoT
Key Data Management Requirements for the IoTKey Data Management Requirements for the IoT
Key Data Management Requirements for the IoT
MongoDB
 
Internet of Things and Big Data
Internet of Things and Big DataInternet of Things and Big Data
Internet of Things and Big Data
Swiss Data Forum Swiss Data Forum
 
Phoenix Data Conference - Big Data Analytics for IoT 11/4/17
Phoenix Data Conference - Big Data Analytics for IoT 11/4/17Phoenix Data Conference - Big Data Analytics for IoT 11/4/17
Phoenix Data Conference - Big Data Analytics for IoT 11/4/17
Mark Goldstein
 
CL2015 - Datacenter and Cloud Strategy and Planning
CL2015 - Datacenter and Cloud Strategy and PlanningCL2015 - Datacenter and Cloud Strategy and Planning
CL2015 - Datacenter and Cloud Strategy and Planning
Cisco
 
re:Invent re:Cap - Big Data & IoT at Any Scale
re:Invent re:Cap - Big Data & IoT at Any Scalere:Invent re:Cap - Big Data & IoT at Any Scale
re:Invent re:Cap - Big Data & IoT at Any Scale
Adrian Hornsby
 
ttec - ParStream
ttec - ParStreamttec - ParStream
ttec - ParStream
Marco van der Hart
 
ParStream - Big Data for Business Users
ParStream - Big Data for Business UsersParStream - Big Data for Business Users
ParStream - Big Data for Business Users
ParStream Inc.
 
Windows for Raspberry Pi 2 Makers (and more!)
Windows for Raspberry Pi 2Makers (and more!)Windows for Raspberry Pi 2Makers (and more!)
Windows for Raspberry Pi 2 Makers (and more!)
Guy Barrette
 
Powering the Intelligent Edge: HPE's Strategy and Direction for IoT & Big Data
Powering the Intelligent Edge: HPE's Strategy and Direction for IoT & Big DataPowering the Intelligent Edge: HPE's Strategy and Direction for IoT & Big Data
Powering the Intelligent Edge: HPE's Strategy and Direction for IoT & Big Data
DataWorks Summit
 
Architect Your IoT Platform for Success
Architect Your IoT Platform for SuccessArchitect Your IoT Platform for Success
Architect Your IoT Platform for Success
Solace
 
Short introduction to Big Data Analytics, the Internet of Things, and their s...
Short introduction to Big Data Analytics, the Internet of Things, and their s...Short introduction to Big Data Analytics, the Internet of Things, and their s...
Short introduction to Big Data Analytics, the Internet of Things, and their s...
Andrei Khurshudov
 
Internet of Things and Azure - DevTeach 2016
Internet of Things and Azure - DevTeach 2016Internet of Things and Azure - DevTeach 2016
Internet of Things and Azure - DevTeach 2016
Guy Barrette
 

What's hot (20)

Sap Leonardo IoT Overview
Sap Leonardo IoT OverviewSap Leonardo IoT Overview
Sap Leonardo IoT Overview
 
Overcoming the AIoT Obstacles through Smart Component Integration
Overcoming the AIoT Obstacles through Smart Component IntegrationOvercoming the AIoT Obstacles through Smart Component Integration
Overcoming the AIoT Obstacles through Smart Component Integration
 
Why and-how-to-choose-an-iot-platforms-201701
Why and-how-to-choose-an-iot-platforms-201701Why and-how-to-choose-an-iot-platforms-201701
Why and-how-to-choose-an-iot-platforms-201701
 
Accelerating the AIoT @ the EDGE
Accelerating the AIoT @ the EDGE Accelerating the AIoT @ the EDGE
Accelerating the AIoT @ the EDGE
 
Watson IoT Platform Sizing & Pricing - Sept 2016
Watson IoT Platform Sizing & Pricing - Sept 2016Watson IoT Platform Sizing & Pricing - Sept 2016
Watson IoT Platform Sizing & Pricing - Sept 2016
 
Internet of things (IoT) and big data- r.nabati
Internet of things (IoT) and big data- r.nabatiInternet of things (IoT) and big data- r.nabati
Internet of things (IoT) and big data- r.nabati
 
Logicalis IoT & Smart Cities (Use Case)
Logicalis IoT & Smart Cities (Use Case)Logicalis IoT & Smart Cities (Use Case)
Logicalis IoT & Smart Cities (Use Case)
 
IoT NY - Google Cloud Services for IoT
IoT NY - Google Cloud Services for IoTIoT NY - Google Cloud Services for IoT
IoT NY - Google Cloud Services for IoT
 
Key Data Management Requirements for the IoT
Key Data Management Requirements for the IoTKey Data Management Requirements for the IoT
Key Data Management Requirements for the IoT
 
Internet of Things and Big Data
Internet of Things and Big DataInternet of Things and Big Data
Internet of Things and Big Data
 
Phoenix Data Conference - Big Data Analytics for IoT 11/4/17
Phoenix Data Conference - Big Data Analytics for IoT 11/4/17Phoenix Data Conference - Big Data Analytics for IoT 11/4/17
Phoenix Data Conference - Big Data Analytics for IoT 11/4/17
 
CL2015 - Datacenter and Cloud Strategy and Planning
CL2015 - Datacenter and Cloud Strategy and PlanningCL2015 - Datacenter and Cloud Strategy and Planning
CL2015 - Datacenter and Cloud Strategy and Planning
 
re:Invent re:Cap - Big Data & IoT at Any Scale
re:Invent re:Cap - Big Data & IoT at Any Scalere:Invent re:Cap - Big Data & IoT at Any Scale
re:Invent re:Cap - Big Data & IoT at Any Scale
 
ttec - ParStream
ttec - ParStreamttec - ParStream
ttec - ParStream
 
ParStream - Big Data for Business Users
ParStream - Big Data for Business UsersParStream - Big Data for Business Users
ParStream - Big Data for Business Users
 
Windows for Raspberry Pi 2 Makers (and more!)
Windows for Raspberry Pi 2Makers (and more!)Windows for Raspberry Pi 2Makers (and more!)
Windows for Raspberry Pi 2 Makers (and more!)
 
Powering the Intelligent Edge: HPE's Strategy and Direction for IoT & Big Data
Powering the Intelligent Edge: HPE's Strategy and Direction for IoT & Big DataPowering the Intelligent Edge: HPE's Strategy and Direction for IoT & Big Data
Powering the Intelligent Edge: HPE's Strategy and Direction for IoT & Big Data
 
Architect Your IoT Platform for Success
Architect Your IoT Platform for SuccessArchitect Your IoT Platform for Success
Architect Your IoT Platform for Success
 
Short introduction to Big Data Analytics, the Internet of Things, and their s...
Short introduction to Big Data Analytics, the Internet of Things, and their s...Short introduction to Big Data Analytics, the Internet of Things, and their s...
Short introduction to Big Data Analytics, the Internet of Things, and their s...
 
Internet of Things and Azure - DevTeach 2016
Internet of Things and Azure - DevTeach 2016Internet of Things and Azure - DevTeach 2016
Internet of Things and Azure - DevTeach 2016
 

Similar to Xanadu for Big Data + IoT + Deep Learning + Cloud Integration Strategy

Data Virtualization: An Introduction
Data Virtualization: An IntroductionData Virtualization: An Introduction
Data Virtualization: An Introduction
Denodo
 
Slides-Discover-Power-of-Live-Data(2).pdf
Slides-Discover-Power-of-Live-Data(2).pdfSlides-Discover-Power-of-Live-Data(2).pdf
Slides-Discover-Power-of-Live-Data(2).pdf
butthead7
 
Research data management 1.5
Research data management 1.5Research data management 1.5
Research data management 1.5
John Martin
 
Delivering Data Democratization in the Cloud with Snowflake
Delivering Data Democratization in the Cloud with SnowflakeDelivering Data Democratization in the Cloud with Snowflake
Delivering Data Democratization in the Cloud with Snowflake
Kent Graziano
 
Big Data - A Real Life Revolution
Big Data - A Real Life RevolutionBig Data - A Real Life Revolution
Big Data - A Real Life Revolution
Capgemini
 
Demystifying Data Warehousing as a Service - DFW
Demystifying Data Warehousing as a Service - DFWDemystifying Data Warehousing as a Service - DFW
Demystifying Data Warehousing as a Service - DFW
Kent Graziano
 
Data Virtualization: An Introduction
Data Virtualization: An IntroductionData Virtualization: An Introduction
Data Virtualization: An Introduction
Denodo
 
Hybrid Cloud Strategy for Big Data and Analytics
Hybrid Cloud Strategy for Big Data and Analytics Hybrid Cloud Strategy for Big Data and Analytics
Hybrid Cloud Strategy for Big Data and Analytics
DataWorks Summit/Hadoop Summit
 
Veritas Solution Day 2017, France, keynote by Mike Palmer
Veritas Solution Day 2017, France, keynote by Mike PalmerVeritas Solution Day 2017, France, keynote by Mike Palmer
Veritas Solution Day 2017, France, keynote by Mike Palmer
Veritas Technologies LLC
 
Denodo DataFest 2016: The Role of Data Virtualization in IoT Integration
Denodo DataFest 2016: The Role of Data Virtualization in IoT IntegrationDenodo DataFest 2016: The Role of Data Virtualization in IoT Integration
Denodo DataFest 2016: The Role of Data Virtualization in IoT Integration
Denodo
 
Mykola Murha "Using Google Cloud Platform for creating of Big Data Analysis ...
Mykola Murha  "Using Google Cloud Platform for creating of Big Data Analysis ...Mykola Murha  "Using Google Cloud Platform for creating of Big Data Analysis ...
Mykola Murha "Using Google Cloud Platform for creating of Big Data Analysis ...
Lviv Startup Club
 
IoT Architectural Overview - 3 use case studies from InfluxData
IoT Architectural Overview - 3 use case studies from InfluxData IoT Architectural Overview - 3 use case studies from InfluxData
IoT Architectural Overview - 3 use case studies from InfluxData
InfluxData
 
Snowflake Overview
Snowflake OverviewSnowflake Overview
Snowflake Overview
Snowflake Computing
 
Big Data Companies and Apache Software
Big Data Companies and Apache SoftwareBig Data Companies and Apache Software
Big Data Companies and Apache Software
Bob Marcus
 
Leveraging a big data model in the IT domain
Leveraging a big data model in the IT domainLeveraging a big data model in the IT domain
Leveraging a big data model in the IT domain
VSS Monitoring
 
How Can Edge Computing and IoT Transform Your Business?
How Can Edge Computing and IoT Transform Your Business?How Can Edge Computing and IoT Transform Your Business?
How Can Edge Computing and IoT Transform Your Business?
Amazon Web Services
 
Simplifying Your Journey to the Cloud: The Benefits of a Cloud-Based Data War...
Simplifying Your Journey to the Cloud: The Benefits of a Cloud-Based Data War...Simplifying Your Journey to the Cloud: The Benefits of a Cloud-Based Data War...
Simplifying Your Journey to the Cloud: The Benefits of a Cloud-Based Data War...
Matillion
 
B1803031217
B1803031217B1803031217
B1803031217
IOSR Journals
 
Building Large-Scale Applications for the Internet of Things at Bosch
Building Large-Scale Applications for the Internet of Things at BoschBuilding Large-Scale Applications for the Internet of Things at Bosch
Building Large-Scale Applications for the Internet of Things at Bosch
MongoDB
 
Mike Palmer of Veritas: Debunking the myths of multi-cloud to achieve 360 Dat...
Mike Palmer of Veritas: Debunking the myths of multi-cloud to achieve 360 Dat...Mike Palmer of Veritas: Debunking the myths of multi-cloud to achieve 360 Dat...
Mike Palmer of Veritas: Debunking the myths of multi-cloud to achieve 360 Dat...
Veritas Technologies LLC
 

Similar to Xanadu for Big Data + IoT + Deep Learning + Cloud Integration Strategy (20)

Data Virtualization: An Introduction
Data Virtualization: An IntroductionData Virtualization: An Introduction
Data Virtualization: An Introduction
 
Slides-Discover-Power-of-Live-Data(2).pdf
Slides-Discover-Power-of-Live-Data(2).pdfSlides-Discover-Power-of-Live-Data(2).pdf
Slides-Discover-Power-of-Live-Data(2).pdf
 
Research data management 1.5
Research data management 1.5Research data management 1.5
Research data management 1.5
 
Delivering Data Democratization in the Cloud with Snowflake
Delivering Data Democratization in the Cloud with SnowflakeDelivering Data Democratization in the Cloud with Snowflake
Delivering Data Democratization in the Cloud with Snowflake
 
Big Data - A Real Life Revolution
Big Data - A Real Life RevolutionBig Data - A Real Life Revolution
Big Data - A Real Life Revolution
 
Demystifying Data Warehousing as a Service - DFW
Demystifying Data Warehousing as a Service - DFWDemystifying Data Warehousing as a Service - DFW
Demystifying Data Warehousing as a Service - DFW
 
Data Virtualization: An Introduction
Data Virtualization: An IntroductionData Virtualization: An Introduction
Data Virtualization: An Introduction
 
Hybrid Cloud Strategy for Big Data and Analytics
Hybrid Cloud Strategy for Big Data and Analytics Hybrid Cloud Strategy for Big Data and Analytics
Hybrid Cloud Strategy for Big Data and Analytics
 
Veritas Solution Day 2017, France, keynote by Mike Palmer
Veritas Solution Day 2017, France, keynote by Mike PalmerVeritas Solution Day 2017, France, keynote by Mike Palmer
Veritas Solution Day 2017, France, keynote by Mike Palmer
 
Denodo DataFest 2016: The Role of Data Virtualization in IoT Integration
Denodo DataFest 2016: The Role of Data Virtualization in IoT IntegrationDenodo DataFest 2016: The Role of Data Virtualization in IoT Integration
Denodo DataFest 2016: The Role of Data Virtualization in IoT Integration
 
Mykola Murha "Using Google Cloud Platform for creating of Big Data Analysis ...
Mykola Murha  "Using Google Cloud Platform for creating of Big Data Analysis ...Mykola Murha  "Using Google Cloud Platform for creating of Big Data Analysis ...
Mykola Murha "Using Google Cloud Platform for creating of Big Data Analysis ...
 
IoT Architectural Overview - 3 use case studies from InfluxData
IoT Architectural Overview - 3 use case studies from InfluxData IoT Architectural Overview - 3 use case studies from InfluxData
IoT Architectural Overview - 3 use case studies from InfluxData
 
Snowflake Overview
Snowflake OverviewSnowflake Overview
Snowflake Overview
 
Big Data Companies and Apache Software
Big Data Companies and Apache SoftwareBig Data Companies and Apache Software
Big Data Companies and Apache Software
 
Leveraging a big data model in the IT domain
Leveraging a big data model in the IT domainLeveraging a big data model in the IT domain
Leveraging a big data model in the IT domain
 
How Can Edge Computing and IoT Transform Your Business?
How Can Edge Computing and IoT Transform Your Business?How Can Edge Computing and IoT Transform Your Business?
How Can Edge Computing and IoT Transform Your Business?
 
Simplifying Your Journey to the Cloud: The Benefits of a Cloud-Based Data War...
Simplifying Your Journey to the Cloud: The Benefits of a Cloud-Based Data War...Simplifying Your Journey to the Cloud: The Benefits of a Cloud-Based Data War...
Simplifying Your Journey to the Cloud: The Benefits of a Cloud-Based Data War...
 
B1803031217
B1803031217B1803031217
B1803031217
 
Building Large-Scale Applications for the Internet of Things at Bosch
Building Large-Scale Applications for the Internet of Things at BoschBuilding Large-Scale Applications for the Internet of Things at Bosch
Building Large-Scale Applications for the Internet of Things at Bosch
 
Mike Palmer of Veritas: Debunking the myths of multi-cloud to achieve 360 Dat...
Mike Palmer of Veritas: Debunking the myths of multi-cloud to achieve 360 Dat...Mike Palmer of Veritas: Debunking the myths of multi-cloud to achieve 360 Dat...
Mike Palmer of Veritas: Debunking the myths of multi-cloud to achieve 360 Dat...
 

More from Alex G. Lee, Ph.D. Esq. CLP

[Presentation] Webinar on Patent Management and Patent Asset STO in the ChatG...
[Presentation] Webinar on Patent Management and Patent Asset STO in the ChatG...[Presentation] Webinar on Patent Management and Patent Asset STO in the ChatG...
[Presentation] Webinar on Patent Management and Patent Asset STO in the ChatG...
Alex G. Lee, Ph.D. Esq. CLP
 
Metaverse x AI x Web3 x Sustainability Convergence
Metaverse x AI x  Web3 x Sustainability ConvergenceMetaverse x AI x  Web3 x Sustainability Convergence
Metaverse x AI x Web3 x Sustainability Convergence
Alex G. Lee, Ph.D. Esq. CLP
 
Tokenization, Securitization, Monetization of Real-World Assets
Tokenization, Securitization, Monetization of Real-World AssetsTokenization, Securitization, Monetization of Real-World Assets
Tokenization, Securitization, Monetization of Real-World Assets
Alex G. Lee, Ph.D. Esq. CLP
 
Maximizing Innovation through ChatGPT Powered Patent Analysis
Maximizing Innovation through ChatGPT Powered Patent AnalysisMaximizing Innovation through ChatGPT Powered Patent Analysis
Maximizing Innovation through ChatGPT Powered Patent Analysis
Alex G. Lee, Ph.D. Esq. CLP
 
Maximizing AI Business Value Creation Utilizing Patents
Maximizing AI Business Value Creation Utilizing PatentsMaximizing AI Business Value Creation Utilizing Patents
Maximizing AI Business Value Creation Utilizing Patents
Alex G. Lee, Ph.D. Esq. CLP
 
Real-World Assets STO + Institutional DeFi Integration
Real-World Assets STO + Institutional DeFi IntegrationReal-World Assets STO + Institutional DeFi Integration
Real-World Assets STO + Institutional DeFi Integration
Alex G. Lee, Ph.D. Esq. CLP
 
Metaverse x Web3 Interoperability Overview
Metaverse x Web3 Interoperability OverviewMetaverse x Web3 Interoperability Overview
Metaverse x Web3 Interoperability Overview
Alex G. Lee, Ph.D. Esq. CLP
 
AI for Metaverse x Web3 Overview
AI for Metaverse x Web3 OverviewAI for Metaverse x Web3 Overview
AI for Metaverse x Web3 Overview
Alex G. Lee, Ph.D. Esq. CLP
 
NFT Web3 Metaverse Global Leaders Roundtable
NFT Web3 Metaverse Global Leaders RoundtableNFT Web3 Metaverse Global Leaders Roundtable
NFT Web3 Metaverse Global Leaders Roundtable
Alex G. Lee, Ph.D. Esq. CLP
 
Fame Universe Introduction
Fame Universe IntroductionFame Universe Introduction
Fame Universe Introduction
Alex G. Lee, Ph.D. Esq. CLP
 
Metaverse Fashion Overview
Metaverse Fashion OverviewMetaverse Fashion Overview
Metaverse Fashion Overview
Alex G. Lee, Ph.D. Esq. CLP
 
Global Metaverse Fashion Innovators Roadshow
Global Metaverse Fashion Innovators RoadshowGlobal Metaverse Fashion Innovators Roadshow
Global Metaverse Fashion Innovators Roadshow
Alex G. Lee, Ph.D. Esq. CLP
 
NFT Financialization Overview
NFT Financialization OverviewNFT Financialization Overview
NFT Financialization Overview
Alex G. Lee, Ph.D. Esq. CLP
 
Metaverse & Web3 Technology Innovation & Business Development
Metaverse & Web3 Technology Innovation & Business DevelopmentMetaverse & Web3 Technology Innovation & Business Development
Metaverse & Web3 Technology Innovation & Business Development
Alex G. Lee, Ph.D. Esq. CLP
 
NFT Monetization Innovation Webinar
NFT Monetization Innovation WebinarNFT Monetization Innovation Webinar
NFT Monetization Innovation Webinar
Alex G. Lee, Ph.D. Esq. CLP
 
웹3.0기반 메타버스 응용을 위한 NFT 가치개발과 가치평가 특강
웹3.0기반 메타버스 응용을 위한 NFT 가치개발과 가치평가 특강웹3.0기반 메타버스 응용을 위한 NFT 가치개발과 가치평가 특강
웹3.0기반 메타버스 응용을 위한 NFT 가치개발과 가치평가 특강
Alex G. Lee, Ph.D. Esq. CLP
 
NFT for Web3 Based Metaverse Monetization Webinar.pdf
NFT for Web3 Based Metaverse Monetization Webinar.pdfNFT for Web3 Based Metaverse Monetization Webinar.pdf
NFT for Web3 Based Metaverse Monetization Webinar.pdf
Alex G. Lee, Ph.D. Esq. CLP
 
FAME UNIVERSE Fashion NFT Monetization Platform Introduction
FAME UNIVERSE Fashion NFT Monetization Platform IntroductionFAME UNIVERSE Fashion NFT Monetization Platform Introduction
FAME UNIVERSE Fashion NFT Monetization Platform Introduction
Alex G. Lee, Ph.D. Esq. CLP
 
NAVIGATING THE METAVERSE (Wiley) One Page Book Summary
NAVIGATING THE METAVERSE (Wiley)  One Page Book SummaryNAVIGATING THE METAVERSE (Wiley)  One Page Book Summary
NAVIGATING THE METAVERSE (Wiley) One Page Book Summary
Alex G. Lee, Ph.D. Esq. CLP
 
FAME Universe Introduction
FAME Universe IntroductionFAME Universe Introduction
FAME Universe Introduction
Alex G. Lee, Ph.D. Esq. CLP
 

More from Alex G. Lee, Ph.D. Esq. CLP (20)

[Presentation] Webinar on Patent Management and Patent Asset STO in the ChatG...
[Presentation] Webinar on Patent Management and Patent Asset STO in the ChatG...[Presentation] Webinar on Patent Management and Patent Asset STO in the ChatG...
[Presentation] Webinar on Patent Management and Patent Asset STO in the ChatG...
 
Metaverse x AI x Web3 x Sustainability Convergence
Metaverse x AI x  Web3 x Sustainability ConvergenceMetaverse x AI x  Web3 x Sustainability Convergence
Metaverse x AI x Web3 x Sustainability Convergence
 
Tokenization, Securitization, Monetization of Real-World Assets
Tokenization, Securitization, Monetization of Real-World AssetsTokenization, Securitization, Monetization of Real-World Assets
Tokenization, Securitization, Monetization of Real-World Assets
 
Maximizing Innovation through ChatGPT Powered Patent Analysis
Maximizing Innovation through ChatGPT Powered Patent AnalysisMaximizing Innovation through ChatGPT Powered Patent Analysis
Maximizing Innovation through ChatGPT Powered Patent Analysis
 
Maximizing AI Business Value Creation Utilizing Patents
Maximizing AI Business Value Creation Utilizing PatentsMaximizing AI Business Value Creation Utilizing Patents
Maximizing AI Business Value Creation Utilizing Patents
 
Real-World Assets STO + Institutional DeFi Integration
Real-World Assets STO + Institutional DeFi IntegrationReal-World Assets STO + Institutional DeFi Integration
Real-World Assets STO + Institutional DeFi Integration
 
Metaverse x Web3 Interoperability Overview
Metaverse x Web3 Interoperability OverviewMetaverse x Web3 Interoperability Overview
Metaverse x Web3 Interoperability Overview
 
AI for Metaverse x Web3 Overview
AI for Metaverse x Web3 OverviewAI for Metaverse x Web3 Overview
AI for Metaverse x Web3 Overview
 
NFT Web3 Metaverse Global Leaders Roundtable
NFT Web3 Metaverse Global Leaders RoundtableNFT Web3 Metaverse Global Leaders Roundtable
NFT Web3 Metaverse Global Leaders Roundtable
 
Fame Universe Introduction
Fame Universe IntroductionFame Universe Introduction
Fame Universe Introduction
 
Metaverse Fashion Overview
Metaverse Fashion OverviewMetaverse Fashion Overview
Metaverse Fashion Overview
 
Global Metaverse Fashion Innovators Roadshow
Global Metaverse Fashion Innovators RoadshowGlobal Metaverse Fashion Innovators Roadshow
Global Metaverse Fashion Innovators Roadshow
 
NFT Financialization Overview
NFT Financialization OverviewNFT Financialization Overview
NFT Financialization Overview
 
Metaverse & Web3 Technology Innovation & Business Development
Metaverse & Web3 Technology Innovation & Business DevelopmentMetaverse & Web3 Technology Innovation & Business Development
Metaverse & Web3 Technology Innovation & Business Development
 
NFT Monetization Innovation Webinar
NFT Monetization Innovation WebinarNFT Monetization Innovation Webinar
NFT Monetization Innovation Webinar
 
웹3.0기반 메타버스 응용을 위한 NFT 가치개발과 가치평가 특강
웹3.0기반 메타버스 응용을 위한 NFT 가치개발과 가치평가 특강웹3.0기반 메타버스 응용을 위한 NFT 가치개발과 가치평가 특강
웹3.0기반 메타버스 응용을 위한 NFT 가치개발과 가치평가 특강
 
NFT for Web3 Based Metaverse Monetization Webinar.pdf
NFT for Web3 Based Metaverse Monetization Webinar.pdfNFT for Web3 Based Metaverse Monetization Webinar.pdf
NFT for Web3 Based Metaverse Monetization Webinar.pdf
 
FAME UNIVERSE Fashion NFT Monetization Platform Introduction
FAME UNIVERSE Fashion NFT Monetization Platform IntroductionFAME UNIVERSE Fashion NFT Monetization Platform Introduction
FAME UNIVERSE Fashion NFT Monetization Platform Introduction
 
NAVIGATING THE METAVERSE (Wiley) One Page Book Summary
NAVIGATING THE METAVERSE (Wiley)  One Page Book SummaryNAVIGATING THE METAVERSE (Wiley)  One Page Book Summary
NAVIGATING THE METAVERSE (Wiley) One Page Book Summary
 
FAME Universe Introduction
FAME Universe IntroductionFAME Universe Introduction
FAME Universe Introduction
 

Recently uploaded

Nanandann Nilekani's ppt On India's .pdf
Nanandann Nilekani's ppt On India's .pdfNanandann Nilekani's ppt On India's .pdf
Nanandann Nilekani's ppt On India's .pdf
eddie19851
 
ViewShift: Hassle-free Dynamic Policy Enforcement for Every Data Lake
ViewShift: Hassle-free Dynamic Policy Enforcement for Every Data LakeViewShift: Hassle-free Dynamic Policy Enforcement for Every Data Lake
ViewShift: Hassle-free Dynamic Policy Enforcement for Every Data Lake
Walaa Eldin Moustafa
 
一比一原版(BCU毕业证书)伯明翰城市大学毕业证如何办理
一比一原版(BCU毕业证书)伯明翰城市大学毕业证如何办理一比一原版(BCU毕业证书)伯明翰城市大学毕业证如何办理
一比一原版(BCU毕业证书)伯明翰城市大学毕业证如何办理
dwreak4tg
 
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
Timothy Spann
 
Intelligence supported media monitoring in veterinary medicine
Intelligence supported media monitoring in veterinary medicineIntelligence supported media monitoring in veterinary medicine
Intelligence supported media monitoring in veterinary medicine
AndrzejJarynowski
 
Global Situational Awareness of A.I. and where its headed
Global Situational Awareness of A.I. and where its headedGlobal Situational Awareness of A.I. and where its headed
Global Situational Awareness of A.I. and where its headed
vikram sood
 
Analysis insight about a Flyball dog competition team's performance
Analysis insight about a Flyball dog competition team's performanceAnalysis insight about a Flyball dog competition team's performance
Analysis insight about a Flyball dog competition team's performance
roli9797
 
4th Modern Marketing Reckoner by MMA Global India & Group M: 60+ experts on W...
4th Modern Marketing Reckoner by MMA Global India & Group M: 60+ experts on W...4th Modern Marketing Reckoner by MMA Global India & Group M: 60+ experts on W...
4th Modern Marketing Reckoner by MMA Global India & Group M: 60+ experts on W...
Social Samosa
 
一比一原版(Dalhousie毕业证书)达尔豪斯大学毕业证如何办理
一比一原版(Dalhousie毕业证书)达尔豪斯大学毕业证如何办理一比一原版(Dalhousie毕业证书)达尔豪斯大学毕业证如何办理
一比一原版(Dalhousie毕业证书)达尔豪斯大学毕业证如何办理
mzpolocfi
 
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
nuttdpt
 
Unleashing the Power of Data_ Choosing a Trusted Analytics Platform.pdf
Unleashing the Power of Data_ Choosing a Trusted Analytics Platform.pdfUnleashing the Power of Data_ Choosing a Trusted Analytics Platform.pdf
Unleashing the Power of Data_ Choosing a Trusted Analytics Platform.pdf
Enterprise Wired
 
一比一原版(CBU毕业证)卡普顿大学毕业证如何办理
一比一原版(CBU毕业证)卡普顿大学毕业证如何办理一比一原版(CBU毕业证)卡普顿大学毕业证如何办理
一比一原版(CBU毕业证)卡普顿大学毕业证如何办理
ahzuo
 
My burning issue is homelessness K.C.M.O.
My burning issue is homelessness K.C.M.O.My burning issue is homelessness K.C.M.O.
My burning issue is homelessness K.C.M.O.
rwarrenll
 
Learn SQL from basic queries to Advance queries
Learn SQL from basic queries to Advance queriesLearn SQL from basic queries to Advance queries
Learn SQL from basic queries to Advance queries
manishkhaire30
 
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
apvysm8
 
一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理
一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理
一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理
ahzuo
 
一比一原版(GWU,GW文凭证书)乔治·华盛顿大学毕业证如何办理
一比一原版(GWU,GW文凭证书)乔治·华盛顿大学毕业证如何办理一比一原版(GWU,GW文凭证书)乔治·华盛顿大学毕业证如何办理
一比一原版(GWU,GW文凭证书)乔治·华盛顿大学毕业证如何办理
bopyb
 
State of Artificial intelligence Report 2023
State of Artificial intelligence Report 2023State of Artificial intelligence Report 2023
State of Artificial intelligence Report 2023
kuntobimo2016
 
University of New South Wales degree offer diploma Transcript
University of New South Wales degree offer diploma TranscriptUniversity of New South Wales degree offer diploma Transcript
University of New South Wales degree offer diploma Transcript
soxrziqu
 
Malana- Gimlet Market Analysis (Portfolio 2)
Malana- Gimlet Market Analysis (Portfolio 2)Malana- Gimlet Market Analysis (Portfolio 2)
Malana- Gimlet Market Analysis (Portfolio 2)
TravisMalana
 

Recently uploaded (20)

Nanandann Nilekani's ppt On India's .pdf
Nanandann Nilekani's ppt On India's .pdfNanandann Nilekani's ppt On India's .pdf
Nanandann Nilekani's ppt On India's .pdf
 
ViewShift: Hassle-free Dynamic Policy Enforcement for Every Data Lake
ViewShift: Hassle-free Dynamic Policy Enforcement for Every Data LakeViewShift: Hassle-free Dynamic Policy Enforcement for Every Data Lake
ViewShift: Hassle-free Dynamic Policy Enforcement for Every Data Lake
 
一比一原版(BCU毕业证书)伯明翰城市大学毕业证如何办理
一比一原版(BCU毕业证书)伯明翰城市大学毕业证如何办理一比一原版(BCU毕业证书)伯明翰城市大学毕业证如何办理
一比一原版(BCU毕业证书)伯明翰城市大学毕业证如何办理
 
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
 
Intelligence supported media monitoring in veterinary medicine
Intelligence supported media monitoring in veterinary medicineIntelligence supported media monitoring in veterinary medicine
Intelligence supported media monitoring in veterinary medicine
 
Global Situational Awareness of A.I. and where its headed
Global Situational Awareness of A.I. and where its headedGlobal Situational Awareness of A.I. and where its headed
Global Situational Awareness of A.I. and where its headed
 
Analysis insight about a Flyball dog competition team's performance
Analysis insight about a Flyball dog competition team's performanceAnalysis insight about a Flyball dog competition team's performance
Analysis insight about a Flyball dog competition team's performance
 
4th Modern Marketing Reckoner by MMA Global India & Group M: 60+ experts on W...
4th Modern Marketing Reckoner by MMA Global India & Group M: 60+ experts on W...4th Modern Marketing Reckoner by MMA Global India & Group M: 60+ experts on W...
4th Modern Marketing Reckoner by MMA Global India & Group M: 60+ experts on W...
 
一比一原版(Dalhousie毕业证书)达尔豪斯大学毕业证如何办理
一比一原版(Dalhousie毕业证书)达尔豪斯大学毕业证如何办理一比一原版(Dalhousie毕业证书)达尔豪斯大学毕业证如何办理
一比一原版(Dalhousie毕业证书)达尔豪斯大学毕业证如何办理
 
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
 
Unleashing the Power of Data_ Choosing a Trusted Analytics Platform.pdf
Unleashing the Power of Data_ Choosing a Trusted Analytics Platform.pdfUnleashing the Power of Data_ Choosing a Trusted Analytics Platform.pdf
Unleashing the Power of Data_ Choosing a Trusted Analytics Platform.pdf
 
一比一原版(CBU毕业证)卡普顿大学毕业证如何办理
一比一原版(CBU毕业证)卡普顿大学毕业证如何办理一比一原版(CBU毕业证)卡普顿大学毕业证如何办理
一比一原版(CBU毕业证)卡普顿大学毕业证如何办理
 
My burning issue is homelessness K.C.M.O.
My burning issue is homelessness K.C.M.O.My burning issue is homelessness K.C.M.O.
My burning issue is homelessness K.C.M.O.
 
Learn SQL from basic queries to Advance queries
Learn SQL from basic queries to Advance queriesLearn SQL from basic queries to Advance queries
Learn SQL from basic queries to Advance queries
 
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
 
一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理
一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理
一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理
 
一比一原版(GWU,GW文凭证书)乔治·华盛顿大学毕业证如何办理
一比一原版(GWU,GW文凭证书)乔治·华盛顿大学毕业证如何办理一比一原版(GWU,GW文凭证书)乔治·华盛顿大学毕业证如何办理
一比一原版(GWU,GW文凭证书)乔治·华盛顿大学毕业证如何办理
 
State of Artificial intelligence Report 2023
State of Artificial intelligence Report 2023State of Artificial intelligence Report 2023
State of Artificial intelligence Report 2023
 
University of New South Wales degree offer diploma Transcript
University of New South Wales degree offer diploma TranscriptUniversity of New South Wales degree offer diploma Transcript
University of New South Wales degree offer diploma Transcript
 
Malana- Gimlet Market Analysis (Portfolio 2)
Malana- Gimlet Market Analysis (Portfolio 2)Malana- Gimlet Market Analysis (Portfolio 2)
Malana- Gimlet Market Analysis (Portfolio 2)
 

Xanadu for Big Data + IoT + Deep Learning + Cloud Integration Strategy

  • 1. ©2017 Xanadu Big Data, LLC All Rights Reserved www.xanadubigdata.com Xanadu for Big Data + IoT + Deep Learning + Cloud Integration Strategy July 25, 2017 Alex G. Lee (alexglee@xanadubigdata.com)
  • 2. ©2017 Xanadu Big Data, LLC All Rights Reserved Index -Big Data in IoT & Deep Learning -Challenges of IoT Big Data Analytics Applications -Challenges of Cloud-based IoT Platform -Cloud-based IoT Platform Use Case: GE Predix for Smart Building Energy Management -Fog/Edge Computing & Micro Data Centers -Deep Learning for IoT Big Data Analytics Introduction -Deep Learning for IoT Big Data Analytics Use Case -Distributed Deep Learning -Big Data + IoT + Cloud + Deep Learning Insights from Patents -Big Data + IoT + Cloud + Deep Learning Strategy Development -Designing Data-Intensive Applications -Xanadu Functionality -Xanadu Use Case -Xanadu + Deep Learning + Hadoop Integration
  • 3. ©2017 Xanadu Big Data, LLC All Rights Reserved Big Data in IoT & Deep Learning Big Data IoT Deep Learning Volume: Size of Data Very large volumes of data from sensors and connected devices Increase in algorithm complexity and computing time Velocity: Data Processing Speed Real time streaming data of very shot time scales, high frequencies, high ingestion rates Difficulty in data learning process in a timely manner Variety: Different Types of Data Heterogeneous datasets from geographically distributed diverse IoT sensors and connected devices Increase in data processing diversity for different data characteristics and behavior Veracity: Truthfulness of Data Noisy & incomplete data which are characterized by uncertainty; Data security issues Significant increase in pre-processing of data
  • 4. ©2017 Xanadu Big Data, LLC All Rights Reserved How to provide interoperability among heterogenious IoT data streams in formats, velocities, and semantics? How to provide data reliability by taking into account noisy and incomplete nature of IoT data streams? How to process nearly real-time streaming IoT data? How to deal with temporal and special dependences of IoT data? How to comply with security and privacy requirements of IoT data? Challenges of IoT Big Data Analytics Applications
  • 5. ©2017 Xanadu Big Data, LLC All Rights Reserved A cloud-based IoT platform should provide a dynamic and flexible analytics resource sharing platform delivering IaaS, PaaS, and SaaS. A cloud-based IoT platform should provide optimized data management and processing across multiple geographically distributed datacenters. A cloud-based IoT platform should provide required quality of service guarantees regarding data storage management and security and privacy of sensitive data. A cloud-based IoT platform should provide low latency end-to-end processing of IoT data. Challenges of Cloud-based IoT Platform
  • 6. ©2017 Xanadu Big Data, LLC All Rights Reserved Cloud-based IoT Platform Use Case: GE Predix for Smart Building Energy Management GE Current demo@GE Predix Boston (Industrial Internet) Meetup
  • 7. ©2017 Xanadu Big Data, LLC All Rights Reserved Fog/Edge computing extends the cloud computing and services to near the IoT sensors and connected devices. Fog/Edge computing is similar to the cloud computing in data storage and management, data processing and application services, but significantly different in terms of its short geographical distance from edgy devices, its dense geographical distribution, and its support for mobility. Fog/Edge computing requires micro data centers that are scalable, flexible and agile data centers co-located with distributed IoT data sources. Fog/Edge Computing & Micro Data Centers
  • 8. ©2017 Xanadu Big Data, LLC All Rights Reserved Deep Learning for IoT Big Data Analytics Introduction Convolutional Neural Networks (CNNs): image/video analysis Source: Deep Learning A-Z™: Hands-On Artificial Neural Networks by SuperDataScience@udemy Recurrent Neural Networks (RNNs):time series analysis Reinforcement Learning (RL): automatically determine the ideal behaviour within a specific context, in order to maximize its performance for a specific goal Source: Reinforcement Learning in Python by Lazy Programmer Inc.@udemy
  • 9. ©2017 Xanadu Big Data, LLC All Rights Reserved Deep Learning for IoT Big Data Analytics Use Case CNN + RNN Source: SoftPoint Consultores S.L. Deep RL Source: Mobileye Source: ODSTCEAST 2017
  • 10. ©2017 Xanadu Big Data, LLC All Rights Reserved Distributed Deep Learning Issues with IoT big data in deep learning: High resolution/scale microscopic images 81,025 pixels by 86,273 pixels (roughly 6.99 gigapixels) requires 78.12 GB memory to store Trained on 1.28 M images and evaluated on 50 K images took 2 – 3 weeks using 8 GPU machine in MS ResNet Distributed training: In model parallelism, different machines in the distributed system are responsible for the computations in different parts of a single network - for example, each layer in the neural network may be assigned to a different machine. In data parallelism, different machines have a complete copy of the model; each machine simply gets a different portion of the data, and results from each are somehow combined. For details: Skymind web: http://engineering.skymind.io
  • 11. ©2017 Xanadu Big Data, LLC All Rights Reserved US20170175645 (GE: IIoT Application) Deep learning enables automatically learning actionable information relevant to a desired operation of a gas turbine in industrial plants from seemingly uncorrelated massive amounts of sensor and controller data. Big Data + IoT + Cloud + Deep Learning Insights from Patents
  • 12. ©2017 Xanadu Big Data, LLC All Rights Reserved US20170169358 (Samsung: Fog Computing) Decentralized deep learning system on the local IoT data using edge storage network that is configure to store and process streaming IoT data. Big Data + IoT + Cloud + Deep Learning Insights from Patents
  • 13. ©2017 Xanadu Big Data, LLC All Rights Reserved US20170060574 (Foghorn Systems: IIoT + Fog Computing) A real-time edge IoT analytics system that can handle the large amounts of data generated by industrial machines and provides intelligent edge computing platform. Big Data + IoT + Cloud + Deep Learning Insights from Patents
  • 14. ©2017 Xanadu Big Data, LLC All Rights Reserved US20160196527 (FALKONRY : Smart Logistics) Cyber-physical supply chain logistics transportation system for predictive estimation of QoS across supply chains using condition monitoring and predictive analytics. Big Data + IoT + Cloud + Deep Learning Insights from Patents
  • 15. ©2017 Xanadu Big Data, LLC All Rights Reserved Source: Prof. Pierre Azoulay@MIT Sloan Executive Education Big Data + IoT + Cloud + Deep Learning Strategy Development
  • 16. ©2017 Xanadu Big Data, LLC All Rights Reserved Chapter 2 Data Models Chapter 3 Storage and Retrieval Chapter 5 Replication Chapter 6 Partitioning Chapter 7 Transactions Chapter 8 Trouble with Distributed Systems Chapter 9 Consistency and Consensus Chapter 10 Batch Processing Chapter 11 Stream Processing Designing Data-Intensive Applications
  • 17. ©2017 Xanadu Big Data, LLC All Rights Reserved Xanadu enables competitive big data management in the Clouds or Enterprises Xanadu Functionality K AnyTypes&SizeofData NoSQL Database Data De-duplication Data Replication Massively Scalable Fault Tolerance Data Store NoSQL Database ACID Compliance High Throughput Low Latency Data Access
  • 18. ©2017 Xanadu Big Data, LLC All Rights Reserved Xanadu Performance BMT
  • 19. ©2017 Xanadu Big Data, LLC All Rights Reserved Xanadu Fault Tolerance Test Demo
  • 20. ©2017 Xanadu Big Data, LLC All Rights Reserved Xanadu provides a composable architecture that can be integrated with other big data systems Xanadu Use Case + Total Integration Big Data Applications Big Data IT Infrastructure Xanadu Data Management Platform GPS / GLONASS WCDMA / LTE +
  • 21. ©2017 Xanadu Big Data, LLC All Rights Reserved Xanadu Commodity Storage System Use Case
  • 22. ©2017 Xanadu Big Data, LLC All Rights Reserved Xanadu Cloud Computing Use Case
  • 23. ©2017 Xanadu Big Data, LLC All Rights Reserved AlexNet CNN architecture in DeepLearning4J (DL4J) Distributed deep leaning on CPUs/GPUs (+Hadoop/Spark) Xanadu file system used to store images and load directly into DL4J Local Machines & AWS Clusters Xanadu + Deep Learning + Hadoop Integration Source: researchgate.net. Data Source: https://www.kaggle.com/c/diabetic-retinopathy-detection
  • 24. ©2017 Xanadu Big Data, LLC All Rights Reserved Thank you Xanadu Big Data, LLC