SlideShare a Scribd company logo
Rainer Sternfeld, CE September 2014
The Critical Role of IoT Data Integration
to develop Big Data Applications
February 5, 2015
The Unmanned Systems Expo 2015, The Hague
Rainer Sternfeld, CEO, Planet OS
@planet_os Image Credit: Northrop Grumman
2 February 2015
Sensor data
will outgrow
social data in 2 years
Sensor data is
too big to move
Data Management
will not scale
as we know it
The bigger picture
Swimming in sensors, drowning in data
3 February 2015
Hewlett Packard:
“By 2020, 40% of all data
ever collected by human kind
will be generated by sensors.”
4 February 2015
If you can’t use this data…
what’s the point?
5 February 2015
Case #1: NOAA
Real-time weather and climate data + forecasts
They are working hard on a challenge presented by:
• Tens of thousands of devices deployed in the ocean, on land, and space
• Tens of terabytes coming in every day
• 700 scattered “web services” (FTPs, flat files, Threads servers, no APIs)
• Breaking connections (all.the.time.)
• 25,000 employees
• Critical data for the government, the industry, and citizens
What if all this data would be easily discoverable and machine-readable?
6 February 2015
Example to case #1: Marinexplore.org
40,000+ data streams from 33 organizations of open data
Advanced Data Discovery Raster data / heat map overlays Access with third party applications
Raster data / quiver plots Graph Monitor Build custom datasets
7 February 2015
Consolidate dataflows, organize and make sense of your data
Access your data with 3rd party tools and systems
One interface to search and discover your local and remote data
Securely exchange, acquire or sell datasets
Build advanced domain specific solutions without hassle
Industrial IoT Platform for Real-World Sensor Networks
designed for ocean, land, air and space data
8 February 2015
Integrate, curate, control access and monitor dataflows
Analytics dashboard Integrate and configure new data channels
Roles, authorizations and logs Dataflow dashboard
9 February 2015
Case #2: Agriculture + data science
Models, predictions, outliers, multi-source data
New companies are emerging:
• Predict a farmer’s profit statement based using adaptive models

(drone data + environmental data + in-situ data + soil/seed/pesticide choices)
• Open data is sparse and scattered
• Data dissemination is hard
• Farmer’s data input in hard
• “Do we really need to build a data platform to build our business?”
What if newco’s and farmers could focus on what they know best?
10 February 2015
Case #3: Surveillance and tactical in-flight data
Having a 2-way data aggregation is critical
• End-users using a variety of drones need data versatility
• “How can I get a data-edge in a chase scenario?”
• Situational awareness based on the same surrounding data
for all unmanned vehicles in your fleet
• Drones need more accurate surrounding data than manned
crafts (don’t fly with your windows taped)
11 February 2015
Case #4: Planet OS data exchange in a swarm scenario
Secure data exchange for tactical navigation & interoperability
• Connected cars / drones / UGVs / AUVs / fleets
• Multi-particle computation for ensuring privacy
• Collision avoidance using encrypted data
• Behavioral data collection using encrypted data
12 February 2015
Main Use Cases
Visualisation
Analytics
Event Processing
Models
Curation & Logistics
Marketplace
Search
Exploration
TECHNICAL DATA
• Spatio-Temporal
• Sensors
• Observations
• Models
• Predictions
• Metadata
13 February 2015
Interfaces and Integrations
DATA FORMATS
• CSV, Spreadsheet
• GeoTiff, ESRI Raster
• HDF, NetCDF (CF), GRIB
• Shapefile, KML
• OGC Geopackage
• Metadata: Exif, SRID, ISO 19139
• Images, Audio, Video
• Custom formats
DATA ACCESS / EXPORT
• CSV, Spreadsheet
• GeoTIFF, HDF, NetCDF (CF)
• OGC WFS / WCS / WMS
• OpenDAP
• ESRI ArcGIS
• ISO-19139
• Custom formats and protocols
DATA SOURCES
• HTTP, FTP
• NFS, Samba, Sharepoint
• OpenDAP, THREDDS, ERDAP
• OGC WFS / WCS / WMS
• ESRI ArcGIS, PostGIS
• Archives: ZIP, etc
• Custom protocols
14
Index the real world

More Related Content

What's hot

Airline traffic management analysis
Airline traffic management analysisAirline traffic management analysis
Airline traffic management analysis
Sumit Mendiratta
 
INEGI ESS big data workshop
INEGI ESS big data workshopINEGI ESS big data workshop
INEGI ESS big data workshop
Abel Alejandro Coronado Iruegas
 
Big Data - part 5/7 of "7 modern trends that every IT Pro should know about"
Big Data - part 5/7 of "7 modern trends that every IT Pro should know about"Big Data - part 5/7 of "7 modern trends that every IT Pro should know about"
Big Data - part 5/7 of "7 modern trends that every IT Pro should know about"
Ibrahim Muhammadi
 
Super BDaaS Government
Super BDaaS GovernmentSuper BDaaS Government
Super BDaaS Government
Dave Goodsmith
 
Research Data Australia and the national research data landscape
Research Data Australia and the national research data landscapeResearch Data Australia and the national research data landscape
Research Data Australia and the national research data landscape
Richard Ferrers
 
Experience Big Data Analytics use cases ranging from cancer research to IoT a...
Experience Big Data Analytics use cases ranging from cancer research to IoT a...Experience Big Data Analytics use cases ranging from cancer research to IoT a...
Experience Big Data Analytics use cases ranging from cancer research to IoT a...
Fujitsu Middle East
 
Chek mate geolocation analyzer
Chek mate geolocation analyzerChek mate geolocation analyzer
Chek mate geolocation analyzer
priyal mistry
 
SDSC Technology Forum: Increasing the Impact of High Resolution Topography Da...
SDSC Technology Forum: Increasing the Impact of High Resolution Topography Da...SDSC Technology Forum: Increasing the Impact of High Resolution Topography Da...
SDSC Technology Forum: Increasing the Impact of High Resolution Topography Da...
OpenTopography Facility
 
Geolocation analysis using HiveQL
Geolocation analysis using HiveQLGeolocation analysis using HiveQL
Geolocation analysis using HiveQL
Priyanka Kale
 
Distributed system
Distributed systemDistributed system
Distributed system
MD Redaan
 
PIOTRe: Personal Internet of Things Repository
PIOTRe: Personal Internet of Things RepositoryPIOTRe: Personal Internet of Things Repository
PIOTRe: Personal Internet of Things Repository
Eugene Siow
 
CouchDB Day NYC 2017: Using Geospatial Data in Cloudant & CouchDB
CouchDB Day NYC 2017: Using Geospatial Data in Cloudant & CouchDBCouchDB Day NYC 2017: Using Geospatial Data in Cloudant & CouchDB
CouchDB Day NYC 2017: Using Geospatial Data in Cloudant & CouchDB
IBM Cloud Data Services
 
Airline Analysis of Data Using Hadoop
Airline Analysis of Data Using HadoopAirline Analysis of Data Using Hadoop
Airline Analysis of Data Using Hadoop
Greater Noida Institute Of Technology
 
BUILDING BETTER PREDICTIVE MODELS WITH COGNITIVE ASSISTANCE IN A DATA SCIENCE...
BUILDING BETTER PREDICTIVE MODELS WITH COGNITIVE ASSISTANCE IN A DATA SCIENCE...BUILDING BETTER PREDICTIVE MODELS WITH COGNITIVE ASSISTANCE IN A DATA SCIENCE...
BUILDING BETTER PREDICTIVE MODELS WITH COGNITIVE ASSISTANCE IN A DATA SCIENCE...
Alex Liu
 
PowerStream: Propelling Energy Innovation with Predictive Analytics
PowerStream: Propelling Energy Innovation with Predictive Analytics PowerStream: Propelling Energy Innovation with Predictive Analytics
PowerStream: Propelling Energy Innovation with Predictive Analytics
SingleStore
 
Floods of Twitter Data - StampedeCon 2016
Floods of Twitter Data - StampedeCon 2016Floods of Twitter Data - StampedeCon 2016
Floods of Twitter Data - StampedeCon 2016
StampedeCon
 
Data Sources
Data SourcesData Sources
Data Sources
Joe Larson
 

What's hot (17)

Airline traffic management analysis
Airline traffic management analysisAirline traffic management analysis
Airline traffic management analysis
 
INEGI ESS big data workshop
INEGI ESS big data workshopINEGI ESS big data workshop
INEGI ESS big data workshop
 
Big Data - part 5/7 of "7 modern trends that every IT Pro should know about"
Big Data - part 5/7 of "7 modern trends that every IT Pro should know about"Big Data - part 5/7 of "7 modern trends that every IT Pro should know about"
Big Data - part 5/7 of "7 modern trends that every IT Pro should know about"
 
Super BDaaS Government
Super BDaaS GovernmentSuper BDaaS Government
Super BDaaS Government
 
Research Data Australia and the national research data landscape
Research Data Australia and the national research data landscapeResearch Data Australia and the national research data landscape
Research Data Australia and the national research data landscape
 
Experience Big Data Analytics use cases ranging from cancer research to IoT a...
Experience Big Data Analytics use cases ranging from cancer research to IoT a...Experience Big Data Analytics use cases ranging from cancer research to IoT a...
Experience Big Data Analytics use cases ranging from cancer research to IoT a...
 
Chek mate geolocation analyzer
Chek mate geolocation analyzerChek mate geolocation analyzer
Chek mate geolocation analyzer
 
SDSC Technology Forum: Increasing the Impact of High Resolution Topography Da...
SDSC Technology Forum: Increasing the Impact of High Resolution Topography Da...SDSC Technology Forum: Increasing the Impact of High Resolution Topography Da...
SDSC Technology Forum: Increasing the Impact of High Resolution Topography Da...
 
Geolocation analysis using HiveQL
Geolocation analysis using HiveQLGeolocation analysis using HiveQL
Geolocation analysis using HiveQL
 
Distributed system
Distributed systemDistributed system
Distributed system
 
PIOTRe: Personal Internet of Things Repository
PIOTRe: Personal Internet of Things RepositoryPIOTRe: Personal Internet of Things Repository
PIOTRe: Personal Internet of Things Repository
 
CouchDB Day NYC 2017: Using Geospatial Data in Cloudant & CouchDB
CouchDB Day NYC 2017: Using Geospatial Data in Cloudant & CouchDBCouchDB Day NYC 2017: Using Geospatial Data in Cloudant & CouchDB
CouchDB Day NYC 2017: Using Geospatial Data in Cloudant & CouchDB
 
Airline Analysis of Data Using Hadoop
Airline Analysis of Data Using HadoopAirline Analysis of Data Using Hadoop
Airline Analysis of Data Using Hadoop
 
BUILDING BETTER PREDICTIVE MODELS WITH COGNITIVE ASSISTANCE IN A DATA SCIENCE...
BUILDING BETTER PREDICTIVE MODELS WITH COGNITIVE ASSISTANCE IN A DATA SCIENCE...BUILDING BETTER PREDICTIVE MODELS WITH COGNITIVE ASSISTANCE IN A DATA SCIENCE...
BUILDING BETTER PREDICTIVE MODELS WITH COGNITIVE ASSISTANCE IN A DATA SCIENCE...
 
PowerStream: Propelling Energy Innovation with Predictive Analytics
PowerStream: Propelling Energy Innovation with Predictive Analytics PowerStream: Propelling Energy Innovation with Predictive Analytics
PowerStream: Propelling Energy Innovation with Predictive Analytics
 
Floods of Twitter Data - StampedeCon 2016
Floods of Twitter Data - StampedeCon 2016Floods of Twitter Data - StampedeCon 2016
Floods of Twitter Data - StampedeCon 2016
 
Data Sources
Data SourcesData Sources
Data Sources
 

Viewers also liked

Sx sw2012 expo_ceo
Sx sw2012 expo_ceoSx sw2012 expo_ceo
Sx sw2012 expo_ceo
tcantwell
 
Social Media for Students
Social Media for StudentsSocial Media for Students
Social Media for Students
Kevin Manne
 
Key messages & recommendations to become an Insight Driven Organisation
Key messages & recommendations to become an Insight Driven OrganisationKey messages & recommendations to become an Insight Driven Organisation
Key messages & recommendations to become an Insight Driven Organisation
Deloitte UK
 
Workplace mental health and wellbeing
Workplace mental health and wellbeingWorkplace mental health and wellbeing
Workplace mental health and wellbeing
Deloitte UK
 
Fjord CES 2017: What We Saw
Fjord CES 2017: What We SawFjord CES 2017: What We Saw
Fjord CES 2017: What We Saw
Fjord
 
The Value Game-Changer: Digital Performance in The Post and Parcel Industry
The Value Game-Changer: Digital Performance in The Post and Parcel IndustryThe Value Game-Changer: Digital Performance in The Post and Parcel Industry
The Value Game-Changer: Digital Performance in The Post and Parcel Industry
accenture
 
Video Transforming
Video TransformingVideo Transforming
Video Transforming
accenture
 
Video is Changing the World
Video is Changing the WorldVideo is Changing the World
Video is Changing the World
accenture
 
Tech Trends 2017: The kinetic enterprise
Tech Trends 2017: The kinetic enterpriseTech Trends 2017: The kinetic enterprise
Tech Trends 2017: The kinetic enterprise
Deloitte United States
 
Banking Technology Vision 2017
Banking Technology Vision 2017Banking Technology Vision 2017
Banking Technology Vision 2017
accenture
 
Liquid Workforce - Tech Vision 2016 Trend 2
Liquid Workforce - Tech Vision 2016 Trend 2Liquid Workforce - Tech Vision 2016 Trend 2
Liquid Workforce - Tech Vision 2016 Trend 2
Accenture Technology
 
What People Want: Accenture Public Service Citizen Survey
What People Want: Accenture Public Service Citizen SurveyWhat People Want: Accenture Public Service Citizen Survey
What People Want: Accenture Public Service Citizen Survey
accenture
 
The Deloitte Global Chief Procurement Officer Survey 2017
The Deloitte Global Chief Procurement Officer Survey 2017The Deloitte Global Chief Procurement Officer Survey 2017
The Deloitte Global Chief Procurement Officer Survey 2017
Deloitte UK
 
The Deloitte Millennial Survey 2016
The Deloitte Millennial Survey 2016The Deloitte Millennial Survey 2016
The Deloitte Millennial Survey 2016
Deloitte United States
 
4 “I wish I would haves” to avoid – Lease management and lease accounting
4 “I wish I would haves” to avoid – Lease management and lease accounting4 “I wish I would haves” to avoid – Lease management and lease accounting
4 “I wish I would haves” to avoid – Lease management and lease accounting
Deloitte United States
 
TMT Outlook 2017: A new wave of advances offer opportunities and challenges
TMT Outlook 2017:  A new wave of advances offer opportunities and challengesTMT Outlook 2017:  A new wave of advances offer opportunities and challenges
TMT Outlook 2017: A new wave of advances offer opportunities and challenges
Deloitte United States
 
Fjord Trends 2017
Fjord Trends 2017 Fjord Trends 2017
Fjord Trends 2017
Fjord
 
Fjord Trends 2017 - Brasil
Fjord Trends 2017 - Brasil Fjord Trends 2017 - Brasil
Fjord Trends 2017 - Brasil
Fjord
 
Technology Vision 2017 infographic
Technology Vision 2017 infographicTechnology Vision 2017 infographic
Technology Vision 2017 infographic
Accenture Technology
 

Viewers also liked (19)

Sx sw2012 expo_ceo
Sx sw2012 expo_ceoSx sw2012 expo_ceo
Sx sw2012 expo_ceo
 
Social Media for Students
Social Media for StudentsSocial Media for Students
Social Media for Students
 
Key messages & recommendations to become an Insight Driven Organisation
Key messages & recommendations to become an Insight Driven OrganisationKey messages & recommendations to become an Insight Driven Organisation
Key messages & recommendations to become an Insight Driven Organisation
 
Workplace mental health and wellbeing
Workplace mental health and wellbeingWorkplace mental health and wellbeing
Workplace mental health and wellbeing
 
Fjord CES 2017: What We Saw
Fjord CES 2017: What We SawFjord CES 2017: What We Saw
Fjord CES 2017: What We Saw
 
The Value Game-Changer: Digital Performance in The Post and Parcel Industry
The Value Game-Changer: Digital Performance in The Post and Parcel IndustryThe Value Game-Changer: Digital Performance in The Post and Parcel Industry
The Value Game-Changer: Digital Performance in The Post and Parcel Industry
 
Video Transforming
Video TransformingVideo Transforming
Video Transforming
 
Video is Changing the World
Video is Changing the WorldVideo is Changing the World
Video is Changing the World
 
Tech Trends 2017: The kinetic enterprise
Tech Trends 2017: The kinetic enterpriseTech Trends 2017: The kinetic enterprise
Tech Trends 2017: The kinetic enterprise
 
Banking Technology Vision 2017
Banking Technology Vision 2017Banking Technology Vision 2017
Banking Technology Vision 2017
 
Liquid Workforce - Tech Vision 2016 Trend 2
Liquid Workforce - Tech Vision 2016 Trend 2Liquid Workforce - Tech Vision 2016 Trend 2
Liquid Workforce - Tech Vision 2016 Trend 2
 
What People Want: Accenture Public Service Citizen Survey
What People Want: Accenture Public Service Citizen SurveyWhat People Want: Accenture Public Service Citizen Survey
What People Want: Accenture Public Service Citizen Survey
 
The Deloitte Global Chief Procurement Officer Survey 2017
The Deloitte Global Chief Procurement Officer Survey 2017The Deloitte Global Chief Procurement Officer Survey 2017
The Deloitte Global Chief Procurement Officer Survey 2017
 
The Deloitte Millennial Survey 2016
The Deloitte Millennial Survey 2016The Deloitte Millennial Survey 2016
The Deloitte Millennial Survey 2016
 
4 “I wish I would haves” to avoid – Lease management and lease accounting
4 “I wish I would haves” to avoid – Lease management and lease accounting4 “I wish I would haves” to avoid – Lease management and lease accounting
4 “I wish I would haves” to avoid – Lease management and lease accounting
 
TMT Outlook 2017: A new wave of advances offer opportunities and challenges
TMT Outlook 2017:  A new wave of advances offer opportunities and challengesTMT Outlook 2017:  A new wave of advances offer opportunities and challenges
TMT Outlook 2017: A new wave of advances offer opportunities and challenges
 
Fjord Trends 2017
Fjord Trends 2017 Fjord Trends 2017
Fjord Trends 2017
 
Fjord Trends 2017 - Brasil
Fjord Trends 2017 - Brasil Fjord Trends 2017 - Brasil
Fjord Trends 2017 - Brasil
 
Technology Vision 2017 infographic
Technology Vision 2017 infographicTechnology Vision 2017 infographic
Technology Vision 2017 infographic
 

Similar to The Critical Role of IoT Data Integration to develop Big Data Applications (for The Unmanned Systems Expo 2015, The Hague)

Planet OS: Indexing the Real World (a lecture at the Stanford Engineering Sch...
Planet OS: Indexing the Real World (a lecture at the Stanford Engineering Sch...Planet OS: Indexing the Real World (a lecture at the Stanford Engineering Sch...
Planet OS: Indexing the Real World (a lecture at the Stanford Engineering Sch...
Rainer Sternfeld
 
Data science and its potential to change business as we know it. The Roadmap ...
Data science and its potential to change business as we know it. The Roadmap ...Data science and its potential to change business as we know it. The Roadmap ...
Data science and its potential to change business as we know it. The Roadmap ...
InnoTech
 
Business with Big data
Business with Big dataBusiness with Big data
Business with Big data
Bruno Curtarelli
 
Advanced Analytics and Machine Learning with Data Virtualization
Advanced Analytics and Machine Learning with Data VirtualizationAdvanced Analytics and Machine Learning with Data Virtualization
Advanced Analytics and Machine Learning with Data Virtualization
Denodo
 
No big data without small data
No big data without small dataNo big data without small data
No big data without small data
Norman Manley
 
Data Science Perspective and DS demo
Data Science Perspective and DS demo Data Science Perspective and DS demo
Data Science Perspective and DS demo
PivotalOpenSourceHub
 
Geospatial Intelligence Middle East 2013_Big Data_Steven Ramage
Geospatial Intelligence Middle East 2013_Big Data_Steven RamageGeospatial Intelligence Middle East 2013_Big Data_Steven Ramage
Geospatial Intelligence Middle East 2013_Big Data_Steven Ramage
Steven Ramage
 
Big Data et eGovernment
Big Data et eGovernmentBig Data et eGovernment
Big Data et eGovernment
eGov Innovation Center
 
Data Virtualization: An Introduction
Data Virtualization: An IntroductionData Virtualization: An Introduction
Data Virtualization: An Introduction
Denodo
 
Data Virtualization: An Introduction
Data Virtualization: An IntroductionData Virtualization: An Introduction
Data Virtualization: An Introduction
Denodo
 
Big data
Big dataBig data
Big data
madhavsolanki
 
Session Sponsored by Splunk: Splunk for the Cloud, in the Cloud
Session Sponsored by Splunk: Splunk for the Cloud, in the CloudSession Sponsored by Splunk: Splunk for the Cloud, in the Cloud
Session Sponsored by Splunk: Splunk for the Cloud, in the Cloud
Amazon Web Services
 
Data Pioneers - Roland Haeve (Atos Nederland) - Big data in organisaties
Data Pioneers - Roland Haeve (Atos Nederland) - Big data in organisatiesData Pioneers - Roland Haeve (Atos Nederland) - Big data in organisaties
Data Pioneers - Roland Haeve (Atos Nederland) - Big data in organisaties
Multiscope
 
Identifying the new frontier of big data as an enabler for T&T industries: Re...
Identifying the new frontier of big data as an enabler for T&T industries: Re...Identifying the new frontier of big data as an enabler for T&T industries: Re...
Identifying the new frontier of big data as an enabler for T&T industries: Re...
International Federation for Information Technologies in Travel and Tourism (IFITT)
 
Data in Motion - tech-intro-for-paris-hackathon
Data in Motion - tech-intro-for-paris-hackathonData in Motion - tech-intro-for-paris-hackathon
Data in Motion - tech-intro-for-paris-hackathon
Cisco DevNet
 
New York City Technology Forum 2015
New York City Technology Forum 2015New York City Technology Forum 2015
New York City Technology Forum 2015
Splunk
 
NYC Technology Forum 2015
NYC Technology Forum 2015NYC Technology Forum 2015
NYC Technology Forum 2015
Splunk
 
Future of Data Strategy (ASEAN)
Future of Data Strategy (ASEAN)Future of Data Strategy (ASEAN)
Future of Data Strategy (ASEAN)
Denodo
 
Maximizing Your Data’s Potential: DOTs & DPWs Edition
Maximizing Your Data’s Potential: DOTs & DPWs EditionMaximizing Your Data’s Potential: DOTs & DPWs Edition
Maximizing Your Data’s Potential: DOTs & DPWs Edition
Safe Software
 
Teradata and Cisco integrated journey to IoT and Smart city
Teradata and Cisco integrated journey to IoT and Smart cityTeradata and Cisco integrated journey to IoT and Smart city
Teradata and Cisco integrated journey to IoT and Smart city
Artur Borycki
 

Similar to The Critical Role of IoT Data Integration to develop Big Data Applications (for The Unmanned Systems Expo 2015, The Hague) (20)

Planet OS: Indexing the Real World (a lecture at the Stanford Engineering Sch...
Planet OS: Indexing the Real World (a lecture at the Stanford Engineering Sch...Planet OS: Indexing the Real World (a lecture at the Stanford Engineering Sch...
Planet OS: Indexing the Real World (a lecture at the Stanford Engineering Sch...
 
Data science and its potential to change business as we know it. The Roadmap ...
Data science and its potential to change business as we know it. The Roadmap ...Data science and its potential to change business as we know it. The Roadmap ...
Data science and its potential to change business as we know it. The Roadmap ...
 
Business with Big data
Business with Big dataBusiness with Big data
Business with Big data
 
Advanced Analytics and Machine Learning with Data Virtualization
Advanced Analytics and Machine Learning with Data VirtualizationAdvanced Analytics and Machine Learning with Data Virtualization
Advanced Analytics and Machine Learning with Data Virtualization
 
No big data without small data
No big data without small dataNo big data without small data
No big data without small data
 
Data Science Perspective and DS demo
Data Science Perspective and DS demo Data Science Perspective and DS demo
Data Science Perspective and DS demo
 
Geospatial Intelligence Middle East 2013_Big Data_Steven Ramage
Geospatial Intelligence Middle East 2013_Big Data_Steven RamageGeospatial Intelligence Middle East 2013_Big Data_Steven Ramage
Geospatial Intelligence Middle East 2013_Big Data_Steven Ramage
 
Big Data et eGovernment
Big Data et eGovernmentBig Data et eGovernment
Big Data et eGovernment
 
Data Virtualization: An Introduction
Data Virtualization: An IntroductionData Virtualization: An Introduction
Data Virtualization: An Introduction
 
Data Virtualization: An Introduction
Data Virtualization: An IntroductionData Virtualization: An Introduction
Data Virtualization: An Introduction
 
Big data
Big dataBig data
Big data
 
Session Sponsored by Splunk: Splunk for the Cloud, in the Cloud
Session Sponsored by Splunk: Splunk for the Cloud, in the CloudSession Sponsored by Splunk: Splunk for the Cloud, in the Cloud
Session Sponsored by Splunk: Splunk for the Cloud, in the Cloud
 
Data Pioneers - Roland Haeve (Atos Nederland) - Big data in organisaties
Data Pioneers - Roland Haeve (Atos Nederland) - Big data in organisatiesData Pioneers - Roland Haeve (Atos Nederland) - Big data in organisaties
Data Pioneers - Roland Haeve (Atos Nederland) - Big data in organisaties
 
Identifying the new frontier of big data as an enabler for T&T industries: Re...
Identifying the new frontier of big data as an enabler for T&T industries: Re...Identifying the new frontier of big data as an enabler for T&T industries: Re...
Identifying the new frontier of big data as an enabler for T&T industries: Re...
 
Data in Motion - tech-intro-for-paris-hackathon
Data in Motion - tech-intro-for-paris-hackathonData in Motion - tech-intro-for-paris-hackathon
Data in Motion - tech-intro-for-paris-hackathon
 
New York City Technology Forum 2015
New York City Technology Forum 2015New York City Technology Forum 2015
New York City Technology Forum 2015
 
NYC Technology Forum 2015
NYC Technology Forum 2015NYC Technology Forum 2015
NYC Technology Forum 2015
 
Future of Data Strategy (ASEAN)
Future of Data Strategy (ASEAN)Future of Data Strategy (ASEAN)
Future of Data Strategy (ASEAN)
 
Maximizing Your Data’s Potential: DOTs & DPWs Edition
Maximizing Your Data’s Potential: DOTs & DPWs EditionMaximizing Your Data’s Potential: DOTs & DPWs Edition
Maximizing Your Data’s Potential: DOTs & DPWs Edition
 
Teradata and Cisco integrated journey to IoT and Smart city
Teradata and Cisco integrated journey to IoT and Smart cityTeradata and Cisco integrated journey to IoT and Smart city
Teradata and Cisco integrated journey to IoT and Smart city
 

Recently uploaded

End-to-end pipeline agility - Berlin Buzzwords 2024
End-to-end pipeline agility - Berlin Buzzwords 2024End-to-end pipeline agility - Berlin Buzzwords 2024
End-to-end pipeline agility - Berlin Buzzwords 2024
Lars Albertsson
 
一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理
一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理
一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理
mbawufebxi
 
一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理
一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理
一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理
ahzuo
 
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
Timothy Spann
 
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
nuttdpt
 
一比一原版(牛布毕业证书)牛津布鲁克斯大学毕业证如何办理
一比一原版(牛布毕业证书)牛津布鲁克斯大学毕业证如何办理一比一原版(牛布毕业证书)牛津布鲁克斯大学毕业证如何办理
一比一原版(牛布毕业证书)牛津布鲁克斯大学毕业证如何办理
74nqk8xf
 
Predictably Improve Your B2B Tech Company's Performance by Leveraging Data
Predictably Improve Your B2B Tech Company's Performance by Leveraging DataPredictably Improve Your B2B Tech Company's Performance by Leveraging Data
Predictably Improve Your B2B Tech Company's Performance by Leveraging Data
Kiwi Creative
 
Everything you wanted to know about LIHTC
Everything you wanted to know about LIHTCEverything you wanted to know about LIHTC
Everything you wanted to know about LIHTC
Roger Valdez
 
在线办理(英国UCA毕业证书)创意艺术大学毕业证在读证明一模一样
在线办理(英国UCA毕业证书)创意艺术大学毕业证在读证明一模一样在线办理(英国UCA毕业证书)创意艺术大学毕业证在读证明一模一样
在线办理(英国UCA毕业证书)创意艺术大学毕业证在读证明一模一样
v7oacc3l
 
My burning issue is homelessness K.C.M.O.
My burning issue is homelessness K.C.M.O.My burning issue is homelessness K.C.M.O.
My burning issue is homelessness K.C.M.O.
rwarrenll
 
The Ipsos - AI - Monitor 2024 Report.pdf
The  Ipsos - AI - Monitor 2024 Report.pdfThe  Ipsos - AI - Monitor 2024 Report.pdf
The Ipsos - AI - Monitor 2024 Report.pdf
Social Samosa
 
一比一原版(BCU毕业证书)伯明翰城市大学毕业证如何办理
一比一原版(BCU毕业证书)伯明翰城市大学毕业证如何办理一比一原版(BCU毕业证书)伯明翰城市大学毕业证如何办理
一比一原版(BCU毕业证书)伯明翰城市大学毕业证如何办理
dwreak4tg
 
一比一原版(UniSA毕业证书)南澳大学毕业证如何办理
一比一原版(UniSA毕业证书)南澳大学毕业证如何办理一比一原版(UniSA毕业证书)南澳大学毕业证如何办理
一比一原版(UniSA毕业证书)南澳大学毕业证如何办理
slg6lamcq
 
一比一原版(Dalhousie毕业证书)达尔豪斯大学毕业证如何办理
一比一原版(Dalhousie毕业证书)达尔豪斯大学毕业证如何办理一比一原版(Dalhousie毕业证书)达尔豪斯大学毕业证如何办理
一比一原版(Dalhousie毕业证书)达尔豪斯大学毕业证如何办理
mzpolocfi
 
原版制作(Deakin毕业证书)迪肯大学毕业证学位证一模一样
原版制作(Deakin毕业证书)迪肯大学毕业证学位证一模一样原版制作(Deakin毕业证书)迪肯大学毕业证学位证一模一样
原版制作(Deakin毕业证书)迪肯大学毕业证学位证一模一样
u86oixdj
 
一比一原版(Chester毕业证书)切斯特大学毕业证如何办理
一比一原版(Chester毕业证书)切斯特大学毕业证如何办理一比一原版(Chester毕业证书)切斯特大学毕业证如何办理
一比一原版(Chester毕业证书)切斯特大学毕业证如何办理
74nqk8xf
 
Learn SQL from basic queries to Advance queries
Learn SQL from basic queries to Advance queriesLearn SQL from basic queries to Advance queries
Learn SQL from basic queries to Advance queries
manishkhaire30
 
The Building Blocks of QuestDB, a Time Series Database
The Building Blocks of QuestDB, a Time Series DatabaseThe Building Blocks of QuestDB, a Time Series Database
The Building Blocks of QuestDB, a Time Series Database
javier ramirez
 
一比一原版(Glasgow毕业证书)格拉斯哥大学毕业证如何办理
一比一原版(Glasgow毕业证书)格拉斯哥大学毕业证如何办理一比一原版(Glasgow毕业证书)格拉斯哥大学毕业证如何办理
一比一原版(Glasgow毕业证书)格拉斯哥大学毕业证如何办理
g4dpvqap0
 
一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理
一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理
一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理
nyfuhyz
 

Recently uploaded (20)

End-to-end pipeline agility - Berlin Buzzwords 2024
End-to-end pipeline agility - Berlin Buzzwords 2024End-to-end pipeline agility - Berlin Buzzwords 2024
End-to-end pipeline agility - Berlin Buzzwords 2024
 
一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理
一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理
一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理
 
一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理
一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理
一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理
 
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
 
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
 
一比一原版(牛布毕业证书)牛津布鲁克斯大学毕业证如何办理
一比一原版(牛布毕业证书)牛津布鲁克斯大学毕业证如何办理一比一原版(牛布毕业证书)牛津布鲁克斯大学毕业证如何办理
一比一原版(牛布毕业证书)牛津布鲁克斯大学毕业证如何办理
 
Predictably Improve Your B2B Tech Company's Performance by Leveraging Data
Predictably Improve Your B2B Tech Company's Performance by Leveraging DataPredictably Improve Your B2B Tech Company's Performance by Leveraging Data
Predictably Improve Your B2B Tech Company's Performance by Leveraging Data
 
Everything you wanted to know about LIHTC
Everything you wanted to know about LIHTCEverything you wanted to know about LIHTC
Everything you wanted to know about LIHTC
 
在线办理(英国UCA毕业证书)创意艺术大学毕业证在读证明一模一样
在线办理(英国UCA毕业证书)创意艺术大学毕业证在读证明一模一样在线办理(英国UCA毕业证书)创意艺术大学毕业证在读证明一模一样
在线办理(英国UCA毕业证书)创意艺术大学毕业证在读证明一模一样
 
My burning issue is homelessness K.C.M.O.
My burning issue is homelessness K.C.M.O.My burning issue is homelessness K.C.M.O.
My burning issue is homelessness K.C.M.O.
 
The Ipsos - AI - Monitor 2024 Report.pdf
The  Ipsos - AI - Monitor 2024 Report.pdfThe  Ipsos - AI - Monitor 2024 Report.pdf
The Ipsos - AI - Monitor 2024 Report.pdf
 
一比一原版(BCU毕业证书)伯明翰城市大学毕业证如何办理
一比一原版(BCU毕业证书)伯明翰城市大学毕业证如何办理一比一原版(BCU毕业证书)伯明翰城市大学毕业证如何办理
一比一原版(BCU毕业证书)伯明翰城市大学毕业证如何办理
 
一比一原版(UniSA毕业证书)南澳大学毕业证如何办理
一比一原版(UniSA毕业证书)南澳大学毕业证如何办理一比一原版(UniSA毕业证书)南澳大学毕业证如何办理
一比一原版(UniSA毕业证书)南澳大学毕业证如何办理
 
一比一原版(Dalhousie毕业证书)达尔豪斯大学毕业证如何办理
一比一原版(Dalhousie毕业证书)达尔豪斯大学毕业证如何办理一比一原版(Dalhousie毕业证书)达尔豪斯大学毕业证如何办理
一比一原版(Dalhousie毕业证书)达尔豪斯大学毕业证如何办理
 
原版制作(Deakin毕业证书)迪肯大学毕业证学位证一模一样
原版制作(Deakin毕业证书)迪肯大学毕业证学位证一模一样原版制作(Deakin毕业证书)迪肯大学毕业证学位证一模一样
原版制作(Deakin毕业证书)迪肯大学毕业证学位证一模一样
 
一比一原版(Chester毕业证书)切斯特大学毕业证如何办理
一比一原版(Chester毕业证书)切斯特大学毕业证如何办理一比一原版(Chester毕业证书)切斯特大学毕业证如何办理
一比一原版(Chester毕业证书)切斯特大学毕业证如何办理
 
Learn SQL from basic queries to Advance queries
Learn SQL from basic queries to Advance queriesLearn SQL from basic queries to Advance queries
Learn SQL from basic queries to Advance queries
 
The Building Blocks of QuestDB, a Time Series Database
The Building Blocks of QuestDB, a Time Series DatabaseThe Building Blocks of QuestDB, a Time Series Database
The Building Blocks of QuestDB, a Time Series Database
 
一比一原版(Glasgow毕业证书)格拉斯哥大学毕业证如何办理
一比一原版(Glasgow毕业证书)格拉斯哥大学毕业证如何办理一比一原版(Glasgow毕业证书)格拉斯哥大学毕业证如何办理
一比一原版(Glasgow毕业证书)格拉斯哥大学毕业证如何办理
 
一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理
一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理
一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理
 

The Critical Role of IoT Data Integration to develop Big Data Applications (for The Unmanned Systems Expo 2015, The Hague)

  • 1. Rainer Sternfeld, CE September 2014 The Critical Role of IoT Data Integration to develop Big Data Applications February 5, 2015 The Unmanned Systems Expo 2015, The Hague Rainer Sternfeld, CEO, Planet OS @planet_os Image Credit: Northrop Grumman
  • 2. 2 February 2015 Sensor data will outgrow social data in 2 years Sensor data is too big to move Data Management will not scale as we know it The bigger picture Swimming in sensors, drowning in data
  • 3. 3 February 2015 Hewlett Packard: “By 2020, 40% of all data ever collected by human kind will be generated by sensors.”
  • 4. 4 February 2015 If you can’t use this data… what’s the point?
  • 5. 5 February 2015 Case #1: NOAA Real-time weather and climate data + forecasts They are working hard on a challenge presented by: • Tens of thousands of devices deployed in the ocean, on land, and space • Tens of terabytes coming in every day • 700 scattered “web services” (FTPs, flat files, Threads servers, no APIs) • Breaking connections (all.the.time.) • 25,000 employees • Critical data for the government, the industry, and citizens What if all this data would be easily discoverable and machine-readable?
  • 6. 6 February 2015 Example to case #1: Marinexplore.org 40,000+ data streams from 33 organizations of open data Advanced Data Discovery Raster data / heat map overlays Access with third party applications Raster data / quiver plots Graph Monitor Build custom datasets
  • 7. 7 February 2015 Consolidate dataflows, organize and make sense of your data Access your data with 3rd party tools and systems One interface to search and discover your local and remote data Securely exchange, acquire or sell datasets Build advanced domain specific solutions without hassle Industrial IoT Platform for Real-World Sensor Networks designed for ocean, land, air and space data
  • 8. 8 February 2015 Integrate, curate, control access and monitor dataflows Analytics dashboard Integrate and configure new data channels Roles, authorizations and logs Dataflow dashboard
  • 9. 9 February 2015 Case #2: Agriculture + data science Models, predictions, outliers, multi-source data New companies are emerging: • Predict a farmer’s profit statement based using adaptive models
 (drone data + environmental data + in-situ data + soil/seed/pesticide choices) • Open data is sparse and scattered • Data dissemination is hard • Farmer’s data input in hard • “Do we really need to build a data platform to build our business?” What if newco’s and farmers could focus on what they know best?
  • 10. 10 February 2015 Case #3: Surveillance and tactical in-flight data Having a 2-way data aggregation is critical • End-users using a variety of drones need data versatility • “How can I get a data-edge in a chase scenario?” • Situational awareness based on the same surrounding data for all unmanned vehicles in your fleet • Drones need more accurate surrounding data than manned crafts (don’t fly with your windows taped)
  • 11. 11 February 2015 Case #4: Planet OS data exchange in a swarm scenario Secure data exchange for tactical navigation & interoperability • Connected cars / drones / UGVs / AUVs / fleets • Multi-particle computation for ensuring privacy • Collision avoidance using encrypted data • Behavioral data collection using encrypted data
  • 12. 12 February 2015 Main Use Cases Visualisation Analytics Event Processing Models Curation & Logistics Marketplace Search Exploration TECHNICAL DATA • Spatio-Temporal • Sensors • Observations • Models • Predictions • Metadata
  • 13. 13 February 2015 Interfaces and Integrations DATA FORMATS • CSV, Spreadsheet • GeoTiff, ESRI Raster • HDF, NetCDF (CF), GRIB • Shapefile, KML • OGC Geopackage • Metadata: Exif, SRID, ISO 19139 • Images, Audio, Video • Custom formats DATA ACCESS / EXPORT • CSV, Spreadsheet • GeoTIFF, HDF, NetCDF (CF) • OGC WFS / WCS / WMS • OpenDAP • ESRI ArcGIS • ISO-19139 • Custom formats and protocols DATA SOURCES • HTTP, FTP • NFS, Samba, Sharepoint • OpenDAP, THREDDS, ERDAP • OGC WFS / WCS / WMS • ESRI ArcGIS, PostGIS • Archives: ZIP, etc • Custom protocols