SlideShare a Scribd company logo
Creating the Foundations 
for the Internet of Things
Companies that manufacture and support physical ‘things’ 
are facing a revolution driven by improvements in connectivity, 
storage and processing efficiency. The objects themselves 
have evolved from being passive recipients of support to 
become active players in their own lifecycle. Previously, the 
only way to see if something was broken was to send someone 
out to check. Now, devices are able to issue alerts that they 
could be about to fail or need service, requiring a support call 
before the problem has even occurred. 
The term given to this revolution in connectivity is The Internet 
of Things. The term describes the way these new devices and 
objects are connected to the internet and stream information, 
enabling improved support and smarter decision-making. 
To be ready for the Internet of Things there are four broad 
challenges that an organization needs to address: 
1. Storing large volumes of information 
2. Handling high volume streams of information from devices 
3. Undertaking predictive analytics based on historical data 
4. Using machine learning to drive adaptive analytics to react 
in real time. 
The value comes from the analytics. Global manufacturer, 
and leader in the Internet of Things, General Electric touts a 
principle they call “The Power of One”. For example, a one 
percent operational improvement, powered by better use of 
big data, would create a $27bn reduction in system inefficiency 
in freight utilization. A one percent reduction in process 
inefficiency in healthcare would lead to $63bn in savings, and a 
one percent improvement in predictive diagnostics would drive 
a $66bn value in efficiency improvement in gas-fired power 
plant fleets. 
If one percent can have such an impact, the potential value 
of the Internet of Things is almost inestimable. The biggest 
challenge today is creating an infrastructure to deliver 
that value. 
Using big data and fast data 
to drive advantage 
2
To be ready for this explosion of information your company needs to be able to do two things: ingest at speed and store cheaply. If a device produces 1kb of data every second (a reasonably modest amount) this will generate 315 gigabytes of data each year. If a company has 1,000 devices this creates 320 terabytes of information each year. If you were to use traditional data warehouse technologies – which can cost anything between $30k and $80k a terabyte – this would cost $9m to $25m to store. Clearly, a different approach is required. 
This different approach is to utilize a big data technology like Pivotal HD which dramatically reduces the cost, so that 320 terabytes can now be stored for under $1m. This makes the return on investment much faster which helps to spur innovation and drives new services to market more quickly. 
The Internet of Things brings a simple but fundamental challenge: lots of devices that are constantly sending out information. the way we see itInternet of Things 
Fast makes Big 
BusinessTraditional HD CostPivotal HD Costunder $1mupto $25 m 
Fast ingest for now and the future 
The first challenge, however, is to handle very fast ingestion speeds. Traditional enterprise data warehouse (EDW) approaches have focused on the batch movement of data: large bundles of information being loaded in one go. The problem with this, when approaching the Internet of Things, is that devices are constantly running. So a batch solution can never respond to the ‘now,’ only to the past and misses a significant opportunity for adding value. 
This is not a new problem, however. High-performance websites have been facing this challenge for many years and have solved it by using in-memory database technologies which then ‘archive’ information once it is no longer needed for active processing. Pivotal’s Gemfire XD follows this approach, providing a lightning fast in-memory ingest and analytics engine which automatically archives information to Hadoop for later predictive analytical processing. 
3
Analytics 
Apps 
Speed 
Data 
4 
GemFire XD 
Pivotal HD 
This approach also delivers a steady stream of information 
which is easier to handle than attempting to load massive 
volumes every night hoping they will be processed in time. 
Analytics not reporting 
Once you have the foundation to handle fast data ingestion 
and big data storage it then becomes possible to extract value 
from that information. To do this you need to stop thinking 
about information and BI as being simply about reports and 
dashboards. There is some value to be had by reporting 
against device information but the real value comes through 
the application of data science. Reporting looks backwards at 
what has happened but data science looks forwards. 
Data science is about applying new types of analytics, 
designing new algorithms and tuning existing ones to turn 
these massive data sets into insight. This requires new sets 
of skills but the good news is that you don’t need to hire and 
manage PhD level mathematicians. Working together, the 
Pivotal and Capgemini data science teams can either design 
wholly new algorithms or tune existing ones to add predictive 
analytics on top of device data. Technologies such as MADLib 
help your internal teams take control of the power of advanced 
analytics without having to become experts themselves. 
The Capgemini and Pivotal teams will work with your BI and 
business leaders to create the right types of predictive 
analytics and ensure the insight created is actionable and will 
deliver value. 
Dashboards for monitoring and action 
Once the analytics has been done, you face the challenge 
of how to represent that information to your customers and 
operations teams. This is where the use of Pivotal’s HAWQ and 
SQLFire technologies are used to distill information from the 
advance analytics into more traditional structured data stores. 
This allows information to be used in the creation of 
dashboards and also to create new applications that are 
driven from the information and insight derived. 
This information can be combined with other critical enterprise 
information such as customer priority, contractual SLAs or 
inventory levels to create a fully integrated view of what is 
required and what should be done. 
This ability to construct applications and to integrate 
information back into operational systems helps drive 
significantly higher levels of operational effectiveness than are 
possible today. These dashboards and applications will help 
deliver pre-emptive maintenance and monitor device health. 
They will also provide a potential new revenue channel for 
companies looking to offer value-added services alongside 
and supplementing the devices themselves.
5 
Internet of Things the way we see it 
Reacting as it happens 
The final stage for an organization, when looking at the Internet 
of Things, is how to leverage predictive analytics at the point 
of action. While Hadoop is cost effective it cannot react to 
changes in real time. This means that while Pivotal HD can 
predict that a device is liable to fail and that fixing it tomorrow 
would be more cost effective, it cannot deal with events as they 
happen, for instance if a device is broken due to a physical 
mishap. 
This is where the ability to handle real-time ingestion of data 
moves beyond merely helping to smooth out loading and 
towards adding the next stage of value. By pushing analytical 
models that are calculated based on the large history within 
Pivotal HD you can create a new generation of algorithms that 
are routinely tuned via Pivotal HD analytics and react in real 
time to the flow of information. 
By pushing analytical models 
that are calculated based 
on the large history within 
Pivotal HD you can create a 
new generation of algorithms 
that are routinely tuned via 
Pivotal HD analytics and 
react in real time to the flow 
of information. 
GemFire XD 
Pivotal HD 
Applications doing 
real-time analytics 
HAWQ 
This gives you the ability to combine heavy statistical analysis 
with the latest information to further optimize operations 
and service. 
For instance, one of the leading suppliers of railroad equipment 
is collecting and analyzing real-time sensor performance 
data from locomotive operations and from the train tracks
6 
themselves to perform diagnostics and root cause analysis that prescribes predictive maintenance before a problem occurs. 
Agriculture and farming organizations are looking to use sensor data from tractors to identify where to best plant seeds for higher crop yields. They are measuring the moisture content of the soil, nutrient density, exposure to sun and shade, spacing between rows, and other factors to automate and improve the planting process. 
Where to start 
The first step to achieving maximum benefit from the Internet of Things is to create foundations. This means putting in place a next-generation information architecture designed to handle the Internet of Things and combine the information with traditional enterprise data sources. 
Capgemini and Pivotal have created the Business Data Lake (BDL) reference architecture to address the challenges of big and fast data. The BDL enables device information to be on-boarded and integrated in a way that scales separately to traditional BI requirements, minimizing costs while enabling sharing. 
Gemfire XD and Pivotal HD form the foundation, respectively ingesting and storing your device information and so ultimately delivering value from the data. 
Results at the heart of your business 
The Internet of Things is a growing opportunity for organizations, one that is built around the ability to analyze and react to information at two different paces. The first is at the pace of the ‘thing’ itself, to tune, to optimize and to help it react more effectively. The second is the pace of the business, to reduce costs, optimize outcomes and better assure its future. 
An architectural approach which addresses both of these opportunities embeds the results into the heart of a business. This turns the Internet of Things from a massive data silo into a core feature of your basic operations. 
SourcesIngestiontierRealtimeMicrobatchMegabatchInsights tierSQLNoSQLSQLQuery interfacesSystem monitoringSystem managementData mgmt. servicesMDMRDMAudit and policy mgmt. Workflow managementUnified operations tierUnified data management tierIn-memoryProcessing tierDistillation tierMPP databaseReal-time ingestionMicro batch ingestionBatch ingestionReal-time insightsBatchinsightsTrends and KPIsSQLMapReduceDataTuningAction tierInteractiveinsightsPredictive maintenanceSensorsUnstructured and structured dataHDFS storage
7 
Internet of Things the way we see it
The information contained in this document is proprietary. ©2014 Capgemini. All rights reserved. 
Rightshore® is a trademark belonging to Capgemini. 
About Capgemini 
With almost 140,000 people in over 40 countries, Capgemini is one 
of the world’s foremost providers of consulting, technology and 
outsourcing services. The Group reported 2013 global revenues of 
EUR 10.1 billion. 
Together with its clients, Capgemini creates and delivers business and 
technology solutions that fit their needs and drive the results they want. 
A deeply multicultural organization, Capgemini has developed its own 
way of working, the Collaborative Business ExperienceTM, and draws 
on Rightshore®, its worldwide delivery model. 
Find out more at www.capgemini.com/bdl 
and www.pivotal.io 
Or 
contact us at bim@capgemini.com 
MCOS_GI_MK_20141128

More Related Content

What's hot

Take Action on Big Data With Actian's Action Apps
Take Action on Big Data With Actian's Action AppsTake Action on Big Data With Actian's Action Apps
Take Action on Big Data With Actian's Action Apps
Actian Corporation
 
Impact of big data on analytics
Impact of big data on analyticsImpact of big data on analytics
Impact of big data on analytics
Capgemini
 
Smart Data Module 6 d drive the future
Smart Data Module 6 d drive the futureSmart Data Module 6 d drive the future
Smart Data Module 6 d drive the future
caniceconsulting
 
Telco Big Data Workshop Sample
Telco Big Data Workshop SampleTelco Big Data Workshop Sample
Telco Big Data Workshop Sample
Alan Quayle
 
Big data course | big data training | big data classes
Big data course | big data training | big data classesBig data course | big data training | big data classes
Big data course | big data training | big data classes
NaviWalker
 
IRJET- A Scrutiny on Research Analysis of Big Data Analytical Method and Clou...
IRJET- A Scrutiny on Research Analysis of Big Data Analytical Method and Clou...IRJET- A Scrutiny on Research Analysis of Big Data Analytical Method and Clou...
IRJET- A Scrutiny on Research Analysis of Big Data Analytical Method and Clou...
IRJET Journal
 
Big Data Tutorial For Beginners | What Is Big Data | Big Data Tutorial | Hado...
Big Data Tutorial For Beginners | What Is Big Data | Big Data Tutorial | Hado...Big Data Tutorial For Beginners | What Is Big Data | Big Data Tutorial | Hado...
Big Data Tutorial For Beginners | What Is Big Data | Big Data Tutorial | Hado...
Edureka!
 
Better Architecture for Data: Adaptable, Scalable, and Smart
Better Architecture for Data: Adaptable, Scalable, and SmartBetter Architecture for Data: Adaptable, Scalable, and Smart
Better Architecture for Data: Adaptable, Scalable, and Smart
Paul Boal
 
Module 6 The Future of Big and Smart Data- Online
Module 6 The Future of Big and Smart Data- Online Module 6 The Future of Big and Smart Data- Online
Module 6 The Future of Big and Smart Data- Online
caniceconsulting
 
Big Data Expo 2015 - Pentaho The Future of Analytics
Big Data Expo 2015 - Pentaho The Future of AnalyticsBig Data Expo 2015 - Pentaho The Future of Analytics
Big Data Expo 2015 - Pentaho The Future of Analytics
BigDataExpo
 
Embracing data science
Embracing data scienceEmbracing data science
Embracing data science
Vipul Kalamkar
 
Analytics: The Real-world Use of Big Data
Analytics: The Real-world Use of Big DataAnalytics: The Real-world Use of Big Data
Analytics: The Real-world Use of Big Data
David Pittman
 
Orzota all-in-one Big Data Platform
Orzota all-in-one Big Data PlatformOrzota all-in-one Big Data Platform
Orzota all-in-one Big Data Platform
Orzota
 
How to Avoid Pitfalls in Big Data Analytics Webinar
How to Avoid Pitfalls in Big Data Analytics WebinarHow to Avoid Pitfalls in Big Data Analytics Webinar
How to Avoid Pitfalls in Big Data Analytics Webinar
Datameer
 
Big data upload
Big data uploadBig data upload
Big data upload
Bhavin Tandel
 
Practical analytics john enoch white paper
Practical analytics john enoch white paperPractical analytics john enoch white paper
Practical analytics john enoch white paper
John Enoch
 
Big Data and Analytics: The IBM Perspective
Big Data and Analytics: The IBM PerspectiveBig Data and Analytics: The IBM Perspective
Big Data and Analytics: The IBM Perspective
The_IPA
 
Revolution in Business Analytics-Zika Virus Example
Revolution in Business Analytics-Zika Virus ExampleRevolution in Business Analytics-Zika Virus Example
Revolution in Business Analytics-Zika Virus Example
Bardess Group
 
Optimize your cloud strategy for machine learning and analytics
Optimize your cloud strategy for machine learning and analyticsOptimize your cloud strategy for machine learning and analytics
Optimize your cloud strategy for machine learning and analytics
Cloudera, Inc.
 
Big Data, Big Innovations
Big Data, Big Innovations  Big Data, Big Innovations
Big Data, Big Innovations
EMC
 

What's hot (20)

Take Action on Big Data With Actian's Action Apps
Take Action on Big Data With Actian's Action AppsTake Action on Big Data With Actian's Action Apps
Take Action on Big Data With Actian's Action Apps
 
Impact of big data on analytics
Impact of big data on analyticsImpact of big data on analytics
Impact of big data on analytics
 
Smart Data Module 6 d drive the future
Smart Data Module 6 d drive the futureSmart Data Module 6 d drive the future
Smart Data Module 6 d drive the future
 
Telco Big Data Workshop Sample
Telco Big Data Workshop SampleTelco Big Data Workshop Sample
Telco Big Data Workshop Sample
 
Big data course | big data training | big data classes
Big data course | big data training | big data classesBig data course | big data training | big data classes
Big data course | big data training | big data classes
 
IRJET- A Scrutiny on Research Analysis of Big Data Analytical Method and Clou...
IRJET- A Scrutiny on Research Analysis of Big Data Analytical Method and Clou...IRJET- A Scrutiny on Research Analysis of Big Data Analytical Method and Clou...
IRJET- A Scrutiny on Research Analysis of Big Data Analytical Method and Clou...
 
Big Data Tutorial For Beginners | What Is Big Data | Big Data Tutorial | Hado...
Big Data Tutorial For Beginners | What Is Big Data | Big Data Tutorial | Hado...Big Data Tutorial For Beginners | What Is Big Data | Big Data Tutorial | Hado...
Big Data Tutorial For Beginners | What Is Big Data | Big Data Tutorial | Hado...
 
Better Architecture for Data: Adaptable, Scalable, and Smart
Better Architecture for Data: Adaptable, Scalable, and SmartBetter Architecture for Data: Adaptable, Scalable, and Smart
Better Architecture for Data: Adaptable, Scalable, and Smart
 
Module 6 The Future of Big and Smart Data- Online
Module 6 The Future of Big and Smart Data- Online Module 6 The Future of Big and Smart Data- Online
Module 6 The Future of Big and Smart Data- Online
 
Big Data Expo 2015 - Pentaho The Future of Analytics
Big Data Expo 2015 - Pentaho The Future of AnalyticsBig Data Expo 2015 - Pentaho The Future of Analytics
Big Data Expo 2015 - Pentaho The Future of Analytics
 
Embracing data science
Embracing data scienceEmbracing data science
Embracing data science
 
Analytics: The Real-world Use of Big Data
Analytics: The Real-world Use of Big DataAnalytics: The Real-world Use of Big Data
Analytics: The Real-world Use of Big Data
 
Orzota all-in-one Big Data Platform
Orzota all-in-one Big Data PlatformOrzota all-in-one Big Data Platform
Orzota all-in-one Big Data Platform
 
How to Avoid Pitfalls in Big Data Analytics Webinar
How to Avoid Pitfalls in Big Data Analytics WebinarHow to Avoid Pitfalls in Big Data Analytics Webinar
How to Avoid Pitfalls in Big Data Analytics Webinar
 
Big data upload
Big data uploadBig data upload
Big data upload
 
Practical analytics john enoch white paper
Practical analytics john enoch white paperPractical analytics john enoch white paper
Practical analytics john enoch white paper
 
Big Data and Analytics: The IBM Perspective
Big Data and Analytics: The IBM PerspectiveBig Data and Analytics: The IBM Perspective
Big Data and Analytics: The IBM Perspective
 
Revolution in Business Analytics-Zika Virus Example
Revolution in Business Analytics-Zika Virus ExampleRevolution in Business Analytics-Zika Virus Example
Revolution in Business Analytics-Zika Virus Example
 
Optimize your cloud strategy for machine learning and analytics
Optimize your cloud strategy for machine learning and analyticsOptimize your cloud strategy for machine learning and analytics
Optimize your cloud strategy for machine learning and analytics
 
Big Data, Big Innovations
Big Data, Big Innovations  Big Data, Big Innovations
Big Data, Big Innovations
 

Similar to Creating the Foundations for the Internet of Things

Ab cs of big data
Ab cs of big dataAb cs of big data
Ab cs of big data
Digimark
 
Unlocking big data
Unlocking big dataUnlocking big data
Activating Big Data: The Key To Success with Machine Learning Advanced Analyt...
Activating Big Data: The Key To Success with Machine Learning Advanced Analyt...Activating Big Data: The Key To Success with Machine Learning Advanced Analyt...
Activating Big Data: The Key To Success with Machine Learning Advanced Analyt...
Vasu S
 
10 top notch big data trends to watch out for in 2017
10 top notch big data trends to watch out for in 201710 top notch big data trends to watch out for in 2017
10 top notch big data trends to watch out for in 2017
Ajeet Singh
 
Data Analytics - The Insight
Data Analytics - The InsightData Analytics - The Insight
Data Analytics - The Insight
SysDiva Consultants
 
HP Vertica and IIS: Big Data = Big Literacy
HP Vertica and IIS: Big Data = Big LiteracyHP Vertica and IIS: Big Data = Big Literacy
HP Vertica and IIS: Big Data = Big Literacy
IIS International Integrated Solutions
 
Fast Data and Architecting the Digital Enterprise Fast Data drivers, componen...
Fast Data and Architecting the Digital Enterprise Fast Data drivers, componen...Fast Data and Architecting the Digital Enterprise Fast Data drivers, componen...
Fast Data and Architecting the Digital Enterprise Fast Data drivers, componen...
Stuart Blair
 
The New Enterprise Blueprint featuring the Gartner Magic Quadrant
The New Enterprise Blueprint featuring the Gartner Magic QuadrantThe New Enterprise Blueprint featuring the Gartner Magic Quadrant
The New Enterprise Blueprint featuring the Gartner Magic Quadrant
LindaWatson19
 
intelligent-data-lake_executive-brief
intelligent-data-lake_executive-briefintelligent-data-lake_executive-brief
intelligent-data-lake_executive-brief
Lindy-Anne Botha
 
Transforming Big Data into business value
Transforming Big Data into business valueTransforming Big Data into business value
Transforming Big Data into business value
The Marketing Distillery
 
Big Data Tools: A Deep Dive into Essential Tools
Big Data Tools: A Deep Dive into Essential ToolsBig Data Tools: A Deep Dive into Essential Tools
Big Data Tools: A Deep Dive into Essential Tools
FredReynolds2
 
Balance your Supply Chain with Big Data
Balance your Supply Chain with Big DataBalance your Supply Chain with Big Data
Balance your Supply Chain with Big Data
Bodhtree
 
Loving_HowToDrive-ValuA7A3B4
Loving_HowToDrive-ValuA7A3B4Loving_HowToDrive-ValuA7A3B4
Loving_HowToDrive-ValuA7A3B4
Steven Loving
 
Oea big-data-guide-1522052
Oea big-data-guide-1522052Oea big-data-guide-1522052
Oea big-data-guide-1522052
kavi172
 
Oea big-data-guide-1522052
Oea big-data-guide-1522052Oea big-data-guide-1522052
Oea big-data-guide-1522052
Gilbert Rozario
 
Big data
Big dataBig data
Cloud Analytics Playbook
Cloud Analytics PlaybookCloud Analytics Playbook
Cloud Analytics Playbook
Booz Allen Hamilton
 
Case studies for Application of Acceldata - TrueDigital and PhonePe.docx
Case studies for Application of Acceldata - TrueDigital and PhonePe.docxCase studies for Application of Acceldata - TrueDigital and PhonePe.docx
Case studies for Application of Acceldata - TrueDigital and PhonePe.docx
AfzalAkthar2
 
How In-memory Computing Drives IT Simplification
How In-memory Computing Drives IT SimplificationHow In-memory Computing Drives IT Simplification
How In-memory Computing Drives IT Simplification
SAP Technology
 
The Evolving Role of the Data Engineer - Whitepaper | Qubole
The Evolving Role of the Data Engineer - Whitepaper | QuboleThe Evolving Role of the Data Engineer - Whitepaper | Qubole
The Evolving Role of the Data Engineer - Whitepaper | Qubole
Vasu S
 

Similar to Creating the Foundations for the Internet of Things (20)

Ab cs of big data
Ab cs of big dataAb cs of big data
Ab cs of big data
 
Unlocking big data
Unlocking big dataUnlocking big data
Unlocking big data
 
Activating Big Data: The Key To Success with Machine Learning Advanced Analyt...
Activating Big Data: The Key To Success with Machine Learning Advanced Analyt...Activating Big Data: The Key To Success with Machine Learning Advanced Analyt...
Activating Big Data: The Key To Success with Machine Learning Advanced Analyt...
 
10 top notch big data trends to watch out for in 2017
10 top notch big data trends to watch out for in 201710 top notch big data trends to watch out for in 2017
10 top notch big data trends to watch out for in 2017
 
Data Analytics - The Insight
Data Analytics - The InsightData Analytics - The Insight
Data Analytics - The Insight
 
HP Vertica and IIS: Big Data = Big Literacy
HP Vertica and IIS: Big Data = Big LiteracyHP Vertica and IIS: Big Data = Big Literacy
HP Vertica and IIS: Big Data = Big Literacy
 
Fast Data and Architecting the Digital Enterprise Fast Data drivers, componen...
Fast Data and Architecting the Digital Enterprise Fast Data drivers, componen...Fast Data and Architecting the Digital Enterprise Fast Data drivers, componen...
Fast Data and Architecting the Digital Enterprise Fast Data drivers, componen...
 
The New Enterprise Blueprint featuring the Gartner Magic Quadrant
The New Enterprise Blueprint featuring the Gartner Magic QuadrantThe New Enterprise Blueprint featuring the Gartner Magic Quadrant
The New Enterprise Blueprint featuring the Gartner Magic Quadrant
 
intelligent-data-lake_executive-brief
intelligent-data-lake_executive-briefintelligent-data-lake_executive-brief
intelligent-data-lake_executive-brief
 
Transforming Big Data into business value
Transforming Big Data into business valueTransforming Big Data into business value
Transforming Big Data into business value
 
Big Data Tools: A Deep Dive into Essential Tools
Big Data Tools: A Deep Dive into Essential ToolsBig Data Tools: A Deep Dive into Essential Tools
Big Data Tools: A Deep Dive into Essential Tools
 
Balance your Supply Chain with Big Data
Balance your Supply Chain with Big DataBalance your Supply Chain with Big Data
Balance your Supply Chain with Big Data
 
Loving_HowToDrive-ValuA7A3B4
Loving_HowToDrive-ValuA7A3B4Loving_HowToDrive-ValuA7A3B4
Loving_HowToDrive-ValuA7A3B4
 
Oea big-data-guide-1522052
Oea big-data-guide-1522052Oea big-data-guide-1522052
Oea big-data-guide-1522052
 
Oea big-data-guide-1522052
Oea big-data-guide-1522052Oea big-data-guide-1522052
Oea big-data-guide-1522052
 
Big data
Big dataBig data
Big data
 
Cloud Analytics Playbook
Cloud Analytics PlaybookCloud Analytics Playbook
Cloud Analytics Playbook
 
Case studies for Application of Acceldata - TrueDigital and PhonePe.docx
Case studies for Application of Acceldata - TrueDigital and PhonePe.docxCase studies for Application of Acceldata - TrueDigital and PhonePe.docx
Case studies for Application of Acceldata - TrueDigital and PhonePe.docx
 
How In-memory Computing Drives IT Simplification
How In-memory Computing Drives IT SimplificationHow In-memory Computing Drives IT Simplification
How In-memory Computing Drives IT Simplification
 
The Evolving Role of the Data Engineer - Whitepaper | Qubole
The Evolving Role of the Data Engineer - Whitepaper | QuboleThe Evolving Role of the Data Engineer - Whitepaper | Qubole
The Evolving Role of the Data Engineer - Whitepaper | Qubole
 

More from Capgemini

Top Healthcare Trends 2022
Top Healthcare Trends 2022Top Healthcare Trends 2022
Top Healthcare Trends 2022
Capgemini
 
Top P&C Insurance Trends 2022
Top P&C Insurance Trends 2022Top P&C Insurance Trends 2022
Top P&C Insurance Trends 2022
Capgemini
 
Commercial Banking Trends book 2022
Commercial Banking Trends book 2022Commercial Banking Trends book 2022
Commercial Banking Trends book 2022
Capgemini
 
Top Trends in Payments 2022
Top Trends in Payments 2022Top Trends in Payments 2022
Top Trends in Payments 2022
Capgemini
 
Top Trends in Wealth Management 2022
Top Trends in Wealth Management 2022Top Trends in Wealth Management 2022
Top Trends in Wealth Management 2022
Capgemini
 
Retail Banking Trends book 2022
Retail Banking Trends book 2022Retail Banking Trends book 2022
Retail Banking Trends book 2022
Capgemini
 
Top Life Insurance Trends 2022
Top Life Insurance Trends 2022Top Life Insurance Trends 2022
Top Life Insurance Trends 2022
Capgemini
 
キャップジェミニ、あなたの『RISE WITH SAP』のパートナーです
キャップジェミニ、あなたの『RISE WITH SAP』のパートナーですキャップジェミニ、あなたの『RISE WITH SAP』のパートナーです
キャップジェミニ、あなたの『RISE WITH SAP』のパートナーです
Capgemini
 
Property & Casualty Insurance Top Trends 2021
Property & Casualty Insurance Top Trends 2021Property & Casualty Insurance Top Trends 2021
Property & Casualty Insurance Top Trends 2021
Capgemini
 
Life Insurance Top Trends 2021
Life Insurance Top Trends 2021Life Insurance Top Trends 2021
Life Insurance Top Trends 2021
Capgemini
 
Top Trends in Commercial Banking: 2021
Top Trends in Commercial Banking: 2021Top Trends in Commercial Banking: 2021
Top Trends in Commercial Banking: 2021
Capgemini
 
Top Trends in Wealth Management: 2021
Top Trends in Wealth Management: 2021Top Trends in Wealth Management: 2021
Top Trends in Wealth Management: 2021
Capgemini
 
Top Trends in Payments: 2021
Top Trends in Payments: 2021Top Trends in Payments: 2021
Top Trends in Payments: 2021
Capgemini
 
Health Insurance Top Trends 2021
Health Insurance Top Trends 2021Health Insurance Top Trends 2021
Health Insurance Top Trends 2021
Capgemini
 
Top Trends in Retail Banking: 2021
Top Trends in Retail Banking: 2021Top Trends in Retail Banking: 2021
Top Trends in Retail Banking: 2021
Capgemini
 
Capgemini’s Connected Autonomous Planning
Capgemini’s Connected Autonomous PlanningCapgemini’s Connected Autonomous Planning
Capgemini’s Connected Autonomous Planning
Capgemini
 
Top Trends in Retail Banking: 2020
Top Trends in Retail Banking: 2020Top Trends in Retail Banking: 2020
Top Trends in Retail Banking: 2020
Capgemini
 
Top Trends in Life Insurance: 2020
Top Trends in Life Insurance: 2020Top Trends in Life Insurance: 2020
Top Trends in Life Insurance: 2020
Capgemini
 
Top Trends in Health Insurance: 2020
Top Trends in Health Insurance: 2020Top Trends in Health Insurance: 2020
Top Trends in Health Insurance: 2020
Capgemini
 
Top Trends in Payments: 2020
Top Trends in Payments: 2020Top Trends in Payments: 2020
Top Trends in Payments: 2020
Capgemini
 

More from Capgemini (20)

Top Healthcare Trends 2022
Top Healthcare Trends 2022Top Healthcare Trends 2022
Top Healthcare Trends 2022
 
Top P&C Insurance Trends 2022
Top P&C Insurance Trends 2022Top P&C Insurance Trends 2022
Top P&C Insurance Trends 2022
 
Commercial Banking Trends book 2022
Commercial Banking Trends book 2022Commercial Banking Trends book 2022
Commercial Banking Trends book 2022
 
Top Trends in Payments 2022
Top Trends in Payments 2022Top Trends in Payments 2022
Top Trends in Payments 2022
 
Top Trends in Wealth Management 2022
Top Trends in Wealth Management 2022Top Trends in Wealth Management 2022
Top Trends in Wealth Management 2022
 
Retail Banking Trends book 2022
Retail Banking Trends book 2022Retail Banking Trends book 2022
Retail Banking Trends book 2022
 
Top Life Insurance Trends 2022
Top Life Insurance Trends 2022Top Life Insurance Trends 2022
Top Life Insurance Trends 2022
 
キャップジェミニ、あなたの『RISE WITH SAP』のパートナーです
キャップジェミニ、あなたの『RISE WITH SAP』のパートナーですキャップジェミニ、あなたの『RISE WITH SAP』のパートナーです
キャップジェミニ、あなたの『RISE WITH SAP』のパートナーです
 
Property & Casualty Insurance Top Trends 2021
Property & Casualty Insurance Top Trends 2021Property & Casualty Insurance Top Trends 2021
Property & Casualty Insurance Top Trends 2021
 
Life Insurance Top Trends 2021
Life Insurance Top Trends 2021Life Insurance Top Trends 2021
Life Insurance Top Trends 2021
 
Top Trends in Commercial Banking: 2021
Top Trends in Commercial Banking: 2021Top Trends in Commercial Banking: 2021
Top Trends in Commercial Banking: 2021
 
Top Trends in Wealth Management: 2021
Top Trends in Wealth Management: 2021Top Trends in Wealth Management: 2021
Top Trends in Wealth Management: 2021
 
Top Trends in Payments: 2021
Top Trends in Payments: 2021Top Trends in Payments: 2021
Top Trends in Payments: 2021
 
Health Insurance Top Trends 2021
Health Insurance Top Trends 2021Health Insurance Top Trends 2021
Health Insurance Top Trends 2021
 
Top Trends in Retail Banking: 2021
Top Trends in Retail Banking: 2021Top Trends in Retail Banking: 2021
Top Trends in Retail Banking: 2021
 
Capgemini’s Connected Autonomous Planning
Capgemini’s Connected Autonomous PlanningCapgemini’s Connected Autonomous Planning
Capgemini’s Connected Autonomous Planning
 
Top Trends in Retail Banking: 2020
Top Trends in Retail Banking: 2020Top Trends in Retail Banking: 2020
Top Trends in Retail Banking: 2020
 
Top Trends in Life Insurance: 2020
Top Trends in Life Insurance: 2020Top Trends in Life Insurance: 2020
Top Trends in Life Insurance: 2020
 
Top Trends in Health Insurance: 2020
Top Trends in Health Insurance: 2020Top Trends in Health Insurance: 2020
Top Trends in Health Insurance: 2020
 
Top Trends in Payments: 2020
Top Trends in Payments: 2020Top Trends in Payments: 2020
Top Trends in Payments: 2020
 

Recently uploaded

Meet up Milano 14 _ Axpo Italia_ Migration from Mule3 (On-prem) to.pdf
Meet up Milano 14 _ Axpo Italia_ Migration from Mule3 (On-prem) to.pdfMeet up Milano 14 _ Axpo Italia_ Migration from Mule3 (On-prem) to.pdf
Meet up Milano 14 _ Axpo Italia_ Migration from Mule3 (On-prem) to.pdf
Florence Consulting
 
Explore-Insanony: Watch Instagram Stories Secretly
Explore-Insanony: Watch Instagram Stories SecretlyExplore-Insanony: Watch Instagram Stories Secretly
Explore-Insanony: Watch Instagram Stories Secretly
Trending Blogers
 
办理新西兰奥克兰大学毕业证学位证书范本原版一模一样
办理新西兰奥克兰大学毕业证学位证书范本原版一模一样办理新西兰奥克兰大学毕业证学位证书范本原版一模一样
办理新西兰奥克兰大学毕业证学位证书范本原版一模一样
xjq03c34
 
Should Repositories Participate in the Fediverse?
Should Repositories Participate in the Fediverse?Should Repositories Participate in the Fediverse?
Should Repositories Participate in the Fediverse?
Paul Walk
 
留学学历(UoA毕业证)奥克兰大学毕业证成绩单官方原版办理
留学学历(UoA毕业证)奥克兰大学毕业证成绩单官方原版办理留学学历(UoA毕业证)奥克兰大学毕业证成绩单官方原版办理
留学学历(UoA毕业证)奥克兰大学毕业证成绩单官方原版办理
bseovas
 
可查真实(Monash毕业证)西澳大学毕业证成绩单退学买
可查真实(Monash毕业证)西澳大学毕业证成绩单退学买可查真实(Monash毕业证)西澳大学毕业证成绩单退学买
可查真实(Monash毕业证)西澳大学毕业证成绩单退学买
cuobya
 
Design Thinking NETFLIX using all techniques.pptx
Design Thinking NETFLIX using all techniques.pptxDesign Thinking NETFLIX using all techniques.pptx
Design Thinking NETFLIX using all techniques.pptx
saathvikreddy2003
 
存档可查的(USC毕业证)南加利福尼亚大学毕业证成绩单制做办理
存档可查的(USC毕业证)南加利福尼亚大学毕业证成绩单制做办理存档可查的(USC毕业证)南加利福尼亚大学毕业证成绩单制做办理
存档可查的(USC毕业证)南加利福尼亚大学毕业证成绩单制做办理
fovkoyb
 
留学挂科(UofM毕业证)明尼苏达大学毕业证成绩单复刻办理
留学挂科(UofM毕业证)明尼苏达大学毕业证成绩单复刻办理留学挂科(UofM毕业证)明尼苏达大学毕业证成绩单复刻办理
留学挂科(UofM毕业证)明尼苏达大学毕业证成绩单复刻办理
uehowe
 
manuaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaal
manuaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaalmanuaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaal
manuaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaal
wolfsoftcompanyco
 
Search Result Showing My Post is Now Buried
Search Result Showing My Post is Now BuriedSearch Result Showing My Post is Now Buried
Search Result Showing My Post is Now Buried
Trish Parr
 
办理毕业证(UPenn毕业证)宾夕法尼亚大学毕业证成绩单快速办理
办理毕业证(UPenn毕业证)宾夕法尼亚大学毕业证成绩单快速办理办理毕业证(UPenn毕业证)宾夕法尼亚大学毕业证成绩单快速办理
办理毕业证(UPenn毕业证)宾夕法尼亚大学毕业证成绩单快速办理
uehowe
 
成绩单ps(UST毕业证)圣托马斯大学毕业证成绩单快速办理
成绩单ps(UST毕业证)圣托马斯大学毕业证成绩单快速办理成绩单ps(UST毕业证)圣托马斯大学毕业证成绩单快速办理
成绩单ps(UST毕业证)圣托马斯大学毕业证成绩单快速办理
ysasp1
 
不能毕业如何获得(USYD毕业证)悉尼大学毕业证成绩单一比一原版制作
不能毕业如何获得(USYD毕业证)悉尼大学毕业证成绩单一比一原版制作不能毕业如何获得(USYD毕业证)悉尼大学毕业证成绩单一比一原版制作
不能毕业如何获得(USYD毕业证)悉尼大学毕业证成绩单一比一原版制作
bseovas
 
重新申请毕业证书(RMIT毕业证)皇家墨尔本理工大学毕业证成绩单精仿办理
重新申请毕业证书(RMIT毕业证)皇家墨尔本理工大学毕业证成绩单精仿办理重新申请毕业证书(RMIT毕业证)皇家墨尔本理工大学毕业证成绩单精仿办理
重新申请毕业证书(RMIT毕业证)皇家墨尔本理工大学毕业证成绩单精仿办理
vmemo1
 
[HUN][hackersuli] Red Teaming alapok 2024
[HUN][hackersuli] Red Teaming alapok 2024[HUN][hackersuli] Red Teaming alapok 2024
[HUN][hackersuli] Red Teaming alapok 2024
hackersuli
 
Discover the benefits of outsourcing SEO to India
Discover the benefits of outsourcing SEO to IndiaDiscover the benefits of outsourcing SEO to India
Discover the benefits of outsourcing SEO to India
davidjhones387
 
Understanding User Behavior with Google Analytics.pdf
Understanding User Behavior with Google Analytics.pdfUnderstanding User Behavior with Google Analytics.pdf
Understanding User Behavior with Google Analytics.pdf
SEO Article Boost
 
假文凭国外(Adelaide毕业证)澳大利亚国立大学毕业证成绩单办理
假文凭国外(Adelaide毕业证)澳大利亚国立大学毕业证成绩单办理假文凭国外(Adelaide毕业证)澳大利亚国立大学毕业证成绩单办理
假文凭国外(Adelaide毕业证)澳大利亚国立大学毕业证成绩单办理
cuobya
 
国外证书(Lincoln毕业证)新西兰林肯大学毕业证成绩单不能毕业办理
国外证书(Lincoln毕业证)新西兰林肯大学毕业证成绩单不能毕业办理国外证书(Lincoln毕业证)新西兰林肯大学毕业证成绩单不能毕业办理
国外证书(Lincoln毕业证)新西兰林肯大学毕业证成绩单不能毕业办理
zoowe
 

Recently uploaded (20)

Meet up Milano 14 _ Axpo Italia_ Migration from Mule3 (On-prem) to.pdf
Meet up Milano 14 _ Axpo Italia_ Migration from Mule3 (On-prem) to.pdfMeet up Milano 14 _ Axpo Italia_ Migration from Mule3 (On-prem) to.pdf
Meet up Milano 14 _ Axpo Italia_ Migration from Mule3 (On-prem) to.pdf
 
Explore-Insanony: Watch Instagram Stories Secretly
Explore-Insanony: Watch Instagram Stories SecretlyExplore-Insanony: Watch Instagram Stories Secretly
Explore-Insanony: Watch Instagram Stories Secretly
 
办理新西兰奥克兰大学毕业证学位证书范本原版一模一样
办理新西兰奥克兰大学毕业证学位证书范本原版一模一样办理新西兰奥克兰大学毕业证学位证书范本原版一模一样
办理新西兰奥克兰大学毕业证学位证书范本原版一模一样
 
Should Repositories Participate in the Fediverse?
Should Repositories Participate in the Fediverse?Should Repositories Participate in the Fediverse?
Should Repositories Participate in the Fediverse?
 
留学学历(UoA毕业证)奥克兰大学毕业证成绩单官方原版办理
留学学历(UoA毕业证)奥克兰大学毕业证成绩单官方原版办理留学学历(UoA毕业证)奥克兰大学毕业证成绩单官方原版办理
留学学历(UoA毕业证)奥克兰大学毕业证成绩单官方原版办理
 
可查真实(Monash毕业证)西澳大学毕业证成绩单退学买
可查真实(Monash毕业证)西澳大学毕业证成绩单退学买可查真实(Monash毕业证)西澳大学毕业证成绩单退学买
可查真实(Monash毕业证)西澳大学毕业证成绩单退学买
 
Design Thinking NETFLIX using all techniques.pptx
Design Thinking NETFLIX using all techniques.pptxDesign Thinking NETFLIX using all techniques.pptx
Design Thinking NETFLIX using all techniques.pptx
 
存档可查的(USC毕业证)南加利福尼亚大学毕业证成绩单制做办理
存档可查的(USC毕业证)南加利福尼亚大学毕业证成绩单制做办理存档可查的(USC毕业证)南加利福尼亚大学毕业证成绩单制做办理
存档可查的(USC毕业证)南加利福尼亚大学毕业证成绩单制做办理
 
留学挂科(UofM毕业证)明尼苏达大学毕业证成绩单复刻办理
留学挂科(UofM毕业证)明尼苏达大学毕业证成绩单复刻办理留学挂科(UofM毕业证)明尼苏达大学毕业证成绩单复刻办理
留学挂科(UofM毕业证)明尼苏达大学毕业证成绩单复刻办理
 
manuaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaal
manuaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaalmanuaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaal
manuaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaal
 
Search Result Showing My Post is Now Buried
Search Result Showing My Post is Now BuriedSearch Result Showing My Post is Now Buried
Search Result Showing My Post is Now Buried
 
办理毕业证(UPenn毕业证)宾夕法尼亚大学毕业证成绩单快速办理
办理毕业证(UPenn毕业证)宾夕法尼亚大学毕业证成绩单快速办理办理毕业证(UPenn毕业证)宾夕法尼亚大学毕业证成绩单快速办理
办理毕业证(UPenn毕业证)宾夕法尼亚大学毕业证成绩单快速办理
 
成绩单ps(UST毕业证)圣托马斯大学毕业证成绩单快速办理
成绩单ps(UST毕业证)圣托马斯大学毕业证成绩单快速办理成绩单ps(UST毕业证)圣托马斯大学毕业证成绩单快速办理
成绩单ps(UST毕业证)圣托马斯大学毕业证成绩单快速办理
 
不能毕业如何获得(USYD毕业证)悉尼大学毕业证成绩单一比一原版制作
不能毕业如何获得(USYD毕业证)悉尼大学毕业证成绩单一比一原版制作不能毕业如何获得(USYD毕业证)悉尼大学毕业证成绩单一比一原版制作
不能毕业如何获得(USYD毕业证)悉尼大学毕业证成绩单一比一原版制作
 
重新申请毕业证书(RMIT毕业证)皇家墨尔本理工大学毕业证成绩单精仿办理
重新申请毕业证书(RMIT毕业证)皇家墨尔本理工大学毕业证成绩单精仿办理重新申请毕业证书(RMIT毕业证)皇家墨尔本理工大学毕业证成绩单精仿办理
重新申请毕业证书(RMIT毕业证)皇家墨尔本理工大学毕业证成绩单精仿办理
 
[HUN][hackersuli] Red Teaming alapok 2024
[HUN][hackersuli] Red Teaming alapok 2024[HUN][hackersuli] Red Teaming alapok 2024
[HUN][hackersuli] Red Teaming alapok 2024
 
Discover the benefits of outsourcing SEO to India
Discover the benefits of outsourcing SEO to IndiaDiscover the benefits of outsourcing SEO to India
Discover the benefits of outsourcing SEO to India
 
Understanding User Behavior with Google Analytics.pdf
Understanding User Behavior with Google Analytics.pdfUnderstanding User Behavior with Google Analytics.pdf
Understanding User Behavior with Google Analytics.pdf
 
假文凭国外(Adelaide毕业证)澳大利亚国立大学毕业证成绩单办理
假文凭国外(Adelaide毕业证)澳大利亚国立大学毕业证成绩单办理假文凭国外(Adelaide毕业证)澳大利亚国立大学毕业证成绩单办理
假文凭国外(Adelaide毕业证)澳大利亚国立大学毕业证成绩单办理
 
国外证书(Lincoln毕业证)新西兰林肯大学毕业证成绩单不能毕业办理
国外证书(Lincoln毕业证)新西兰林肯大学毕业证成绩单不能毕业办理国外证书(Lincoln毕业证)新西兰林肯大学毕业证成绩单不能毕业办理
国外证书(Lincoln毕业证)新西兰林肯大学毕业证成绩单不能毕业办理
 

Creating the Foundations for the Internet of Things

  • 1. Creating the Foundations for the Internet of Things
  • 2. Companies that manufacture and support physical ‘things’ are facing a revolution driven by improvements in connectivity, storage and processing efficiency. The objects themselves have evolved from being passive recipients of support to become active players in their own lifecycle. Previously, the only way to see if something was broken was to send someone out to check. Now, devices are able to issue alerts that they could be about to fail or need service, requiring a support call before the problem has even occurred. The term given to this revolution in connectivity is The Internet of Things. The term describes the way these new devices and objects are connected to the internet and stream information, enabling improved support and smarter decision-making. To be ready for the Internet of Things there are four broad challenges that an organization needs to address: 1. Storing large volumes of information 2. Handling high volume streams of information from devices 3. Undertaking predictive analytics based on historical data 4. Using machine learning to drive adaptive analytics to react in real time. The value comes from the analytics. Global manufacturer, and leader in the Internet of Things, General Electric touts a principle they call “The Power of One”. For example, a one percent operational improvement, powered by better use of big data, would create a $27bn reduction in system inefficiency in freight utilization. A one percent reduction in process inefficiency in healthcare would lead to $63bn in savings, and a one percent improvement in predictive diagnostics would drive a $66bn value in efficiency improvement in gas-fired power plant fleets. If one percent can have such an impact, the potential value of the Internet of Things is almost inestimable. The biggest challenge today is creating an infrastructure to deliver that value. Using big data and fast data to drive advantage 2
  • 3. To be ready for this explosion of information your company needs to be able to do two things: ingest at speed and store cheaply. If a device produces 1kb of data every second (a reasonably modest amount) this will generate 315 gigabytes of data each year. If a company has 1,000 devices this creates 320 terabytes of information each year. If you were to use traditional data warehouse technologies – which can cost anything between $30k and $80k a terabyte – this would cost $9m to $25m to store. Clearly, a different approach is required. This different approach is to utilize a big data technology like Pivotal HD which dramatically reduces the cost, so that 320 terabytes can now be stored for under $1m. This makes the return on investment much faster which helps to spur innovation and drives new services to market more quickly. The Internet of Things brings a simple but fundamental challenge: lots of devices that are constantly sending out information. the way we see itInternet of Things Fast makes Big BusinessTraditional HD CostPivotal HD Costunder $1mupto $25 m Fast ingest for now and the future The first challenge, however, is to handle very fast ingestion speeds. Traditional enterprise data warehouse (EDW) approaches have focused on the batch movement of data: large bundles of information being loaded in one go. The problem with this, when approaching the Internet of Things, is that devices are constantly running. So a batch solution can never respond to the ‘now,’ only to the past and misses a significant opportunity for adding value. This is not a new problem, however. High-performance websites have been facing this challenge for many years and have solved it by using in-memory database technologies which then ‘archive’ information once it is no longer needed for active processing. Pivotal’s Gemfire XD follows this approach, providing a lightning fast in-memory ingest and analytics engine which automatically archives information to Hadoop for later predictive analytical processing. 3
  • 4. Analytics Apps Speed Data 4 GemFire XD Pivotal HD This approach also delivers a steady stream of information which is easier to handle than attempting to load massive volumes every night hoping they will be processed in time. Analytics not reporting Once you have the foundation to handle fast data ingestion and big data storage it then becomes possible to extract value from that information. To do this you need to stop thinking about information and BI as being simply about reports and dashboards. There is some value to be had by reporting against device information but the real value comes through the application of data science. Reporting looks backwards at what has happened but data science looks forwards. Data science is about applying new types of analytics, designing new algorithms and tuning existing ones to turn these massive data sets into insight. This requires new sets of skills but the good news is that you don’t need to hire and manage PhD level mathematicians. Working together, the Pivotal and Capgemini data science teams can either design wholly new algorithms or tune existing ones to add predictive analytics on top of device data. Technologies such as MADLib help your internal teams take control of the power of advanced analytics without having to become experts themselves. The Capgemini and Pivotal teams will work with your BI and business leaders to create the right types of predictive analytics and ensure the insight created is actionable and will deliver value. Dashboards for monitoring and action Once the analytics has been done, you face the challenge of how to represent that information to your customers and operations teams. This is where the use of Pivotal’s HAWQ and SQLFire technologies are used to distill information from the advance analytics into more traditional structured data stores. This allows information to be used in the creation of dashboards and also to create new applications that are driven from the information and insight derived. This information can be combined with other critical enterprise information such as customer priority, contractual SLAs or inventory levels to create a fully integrated view of what is required and what should be done. This ability to construct applications and to integrate information back into operational systems helps drive significantly higher levels of operational effectiveness than are possible today. These dashboards and applications will help deliver pre-emptive maintenance and monitor device health. They will also provide a potential new revenue channel for companies looking to offer value-added services alongside and supplementing the devices themselves.
  • 5. 5 Internet of Things the way we see it Reacting as it happens The final stage for an organization, when looking at the Internet of Things, is how to leverage predictive analytics at the point of action. While Hadoop is cost effective it cannot react to changes in real time. This means that while Pivotal HD can predict that a device is liable to fail and that fixing it tomorrow would be more cost effective, it cannot deal with events as they happen, for instance if a device is broken due to a physical mishap. This is where the ability to handle real-time ingestion of data moves beyond merely helping to smooth out loading and towards adding the next stage of value. By pushing analytical models that are calculated based on the large history within Pivotal HD you can create a new generation of algorithms that are routinely tuned via Pivotal HD analytics and react in real time to the flow of information. By pushing analytical models that are calculated based on the large history within Pivotal HD you can create a new generation of algorithms that are routinely tuned via Pivotal HD analytics and react in real time to the flow of information. GemFire XD Pivotal HD Applications doing real-time analytics HAWQ This gives you the ability to combine heavy statistical analysis with the latest information to further optimize operations and service. For instance, one of the leading suppliers of railroad equipment is collecting and analyzing real-time sensor performance data from locomotive operations and from the train tracks
  • 6. 6 themselves to perform diagnostics and root cause analysis that prescribes predictive maintenance before a problem occurs. Agriculture and farming organizations are looking to use sensor data from tractors to identify where to best plant seeds for higher crop yields. They are measuring the moisture content of the soil, nutrient density, exposure to sun and shade, spacing between rows, and other factors to automate and improve the planting process. Where to start The first step to achieving maximum benefit from the Internet of Things is to create foundations. This means putting in place a next-generation information architecture designed to handle the Internet of Things and combine the information with traditional enterprise data sources. Capgemini and Pivotal have created the Business Data Lake (BDL) reference architecture to address the challenges of big and fast data. The BDL enables device information to be on-boarded and integrated in a way that scales separately to traditional BI requirements, minimizing costs while enabling sharing. Gemfire XD and Pivotal HD form the foundation, respectively ingesting and storing your device information and so ultimately delivering value from the data. Results at the heart of your business The Internet of Things is a growing opportunity for organizations, one that is built around the ability to analyze and react to information at two different paces. The first is at the pace of the ‘thing’ itself, to tune, to optimize and to help it react more effectively. The second is the pace of the business, to reduce costs, optimize outcomes and better assure its future. An architectural approach which addresses both of these opportunities embeds the results into the heart of a business. This turns the Internet of Things from a massive data silo into a core feature of your basic operations. SourcesIngestiontierRealtimeMicrobatchMegabatchInsights tierSQLNoSQLSQLQuery interfacesSystem monitoringSystem managementData mgmt. servicesMDMRDMAudit and policy mgmt. Workflow managementUnified operations tierUnified data management tierIn-memoryProcessing tierDistillation tierMPP databaseReal-time ingestionMicro batch ingestionBatch ingestionReal-time insightsBatchinsightsTrends and KPIsSQLMapReduceDataTuningAction tierInteractiveinsightsPredictive maintenanceSensorsUnstructured and structured dataHDFS storage
  • 7. 7 Internet of Things the way we see it
  • 8. The information contained in this document is proprietary. ©2014 Capgemini. All rights reserved. Rightshore® is a trademark belonging to Capgemini. About Capgemini With almost 140,000 people in over 40 countries, Capgemini is one of the world’s foremost providers of consulting, technology and outsourcing services. The Group reported 2013 global revenues of EUR 10.1 billion. Together with its clients, Capgemini creates and delivers business and technology solutions that fit their needs and drive the results they want. A deeply multicultural organization, Capgemini has developed its own way of working, the Collaborative Business ExperienceTM, and draws on Rightshore®, its worldwide delivery model. Find out more at www.capgemini.com/bdl and www.pivotal.io Or contact us at bim@capgemini.com MCOS_GI_MK_20141128