SlideShare a Scribd company logo
1 of 28
Download to read offline
page
VOLTDB AND HPE VERTICA:
BUILDING AN IOT ARCHITECTURE
FOR FAST + BIG DATA 
page© 2016 VoltDB
OUR SPEAKERS
2
Chris Selland
VP Business Development
Hewlett Packard Enterprise
Dennis Duckworth, Director
Product Marketing
VoltDB
page© 2016 VoltDB page
AGENDA
•  Introduction
•  What is the Internet of Things?
•  HPE Vertica and IoT
•  VoltDB and IoT
•  Demo of VoltDB and HPE Vertica
•  Q&A
3
Building an IoT
Architecture for Big &
Fast Data
Chris Selland
VP Business Development
What is the Internet of Things?
“The Internet of Things is the network of physical objects that
contains embedded technology to communicate and sense or
interact with the objects' internal state or the external
environment.”1
Consumer “things”
Personal sensing with remote
monitoring and control
1 Gartner. IT Glossary – Internet of
Things.
Industrial “things”
From individual sensors to
entire power plants
Business outcomes
through big data analytics
How can value be created from IoT data?
Up to $11 trillion per year in potential economic impact by 20251
•  Increased revenue
•  Optimized operations
•  New products and services
•  Workforce productivity
•  Reduced risks
•  Reduced operating costs
•  Optimized maintenance
•  Optimized network throughput
Smart citiesManufacturing
Consumer
Smart homes
Healthcare
Oil & gas
Aviation
Energy & utilities
Transportation
Retail
Industries
that can benefit
Insurance
Agriculture
1 McKinsey Global Institute. The Internet of Things: Mapping the Value Beyond the Hype, June 2015.
Connected devices
source of contextual data
IoT is not the future. It’s already here.
Business Outcomes
•  Understand driver behaviors and
patterns
•  To improve efficiency of the
company and drivers
Business Outcomes
•  Safety and well-being of citizens
•  Analyzing safety threats
•  Accurate identification and scene
analysis
Business Outcomes
•  Increases customer value with
equipment monitoring, event
mitigation, & energy performance
services
•  Helps customers reduce energy
& maintenance costs
7
Equipment Manufacturers Enterprises Service-based Businesses
Integrated sensor and telemetry
analytics in HP Fleet vehicles
Monitors 2000+ cameras and
performs video analytics
Analytics enhance the Trane
Intelligent Services business
Successes in IoT
HPE Vertica and IoT
8
Computing at the Edge – “shifting left” for strategic advantage
Goal
–  Processing streaming data as close
to the sensor as possible creates
new opportunities
Advantage
–  Processing data streams in real time,
before the data is stored for additional
analysis, creates advantages
–  Example: Transformer or turbine thermal
runaway, requires immediate action
Result
–  Fast action prior to data storage
prevents data obsolescence and lost
opportunities/alerts
HPE Confidential | Share under NDA 9
“Things” generate data and
need control
Edge IT, data center and cloudOperations technology
Early analytics
and compute
Deep analytics
and compute
Data is sensed,
Things controlled
Data acquired
and aggregated
The Edge
Opportunity
Accelerate insight by moving compute
from the data center to the Edge
Data flow
Control flow
Augment the data center
with processing at the edge
The Vertica Real-Time Analytics Engine
Native
High
Availability
Standard
SQL
Interface
Column
Orientation
Auto
Database
Design
Advanced
Compression
MPP
Massive
Parallel
Processing
Leverages BI, ETL,
Hadoop/MapReduce
and OLTP investments
No disk I/O bottleneck
simultaneously load &
query
Native DB-aware
clustering on low-cost
x86 Linux nodes
Built-in redundancy
that also speeds up
queries
Automatic setup,
optimization, and DB
management
Up to 90% space
reduction using 10+
algorithms
ü  50x – 1000x faster
than traditional
RDBMS
ü  Scales from TB to
PB with industry-
standard hardware
ü  Simple integration
with existing ETL
and BI solutions
ü  SQL-99+ compliant
ü  Ultimate deployment
flexibility
ü  Extended advanced
analytics
ü  24/7 Load & Query
Confidential 10
Taking IoT analytics to the next level – Integrated Machine Learning
Native Machine Learning algorithms run in
database (Vertica)
•  K-means (anomalies)
•  Linear Regression (risks, trends)
•  Logistic Regression
Train predictive analytics models in the
datacenter, and easily run at the edge
Utilizes the same hardware as the
database itself
•  Lower cost solution
•  No transfer of data required
•  Large data sets lead to more accurate
models
11
Taking IoT analytics to the next level – High Performance Messaging
Vertica Streaming Adapter for Apache
Kafka
Kafka replaces custom data ingest
solutions with a robust open-source
implementation
Enables distributed data pipelines for
high throughput and low latency ingest
into Vertica
•  Time to insight reduced from hours to
seconds (micro-batch loading)
•  Easy handling of data bursts (10m
messages per minute)
12
Taking IoT analytics to the next level – In-database Sensor Data Analytics
Powerful time series and window
functions (gap filling, interpolation) for
data quality management at the edge1
Live Aggregate Projections
(personalized billing on demand)
Log text analytics and pattern
matching (SIEM – security, intrusion
detection)
Geospatial analytics (location based
services, asset management)
13
1 HPE internal testing of Vertica on EL4000 shows it can:
-  Repair 5.7 million readings per second
-  Load, repair and analyze a reading every 282 nanoseconds
www.hpe.com/events/bdc
Big Data Conference 2016
Boston August 29- September 1
page
BUILDING AN IOT ARCHITECTURE
FOR FAST + BIG DATA 
DENNIS DUCKWORTH
DIRECTOR OF PRODUCT MARKETING
page© 2016 VoltDB
VOLTDB DOESN’T MAKE THE APPS, WE MAKE THE APPS…
16
• Real-time intelligence and context for richer interactions
• Allows unique decisions on each individual event or person
• Analyze and act on real-time/streaming data
• More efficient use of hardware
• 100X faster than traditional transactional databases
• World record performance in the cloud (YCSB)
• Millisecond response times
• Hundreds of thousands to millions of transactions per
second
• High-speed data ingestion
• Simpler apps, easier to test and maintain
• Easier to program with SQL + Java
• Seamless ecosystem integration
• Data is always consistent and correct, never lost
Smarter
Faster
Simpler
1/10
of the Resources Needed	
  
100X
Traditional Transactional DB	
  
100%
Consistent, Correct	
  
page© 2016 VoltDB
Low  Complexity  
  
Rich,  Smart  
   Value of Individual Data Item Value of Data Collection
DataValue
Data Warehouse
Hadoop, etc.NoSQL
Data in Motion Data at Rest
Fast Data Big Data
Feeds, Collectors
CEP
CEP + DB
DataInteraction
FAST DATA + BIG DATA
page© 2016 VoltDB
Streaming
Analytics
-  Filtering
-  Windowing
-  Aggregation
-  Enrichment
-  Correlations
Deep
Analytics
-  Machine Learning
-  Statistical correlations
-  Multi-dimensional analysis
-  Predictive/Prescriptive analytics
Operational
Interactions /
Transactions
-  Context-aware
-  Personal
-  Real-time
+
Big Data
FAST DATA + BIG DATA
Fast Data
page© 2016 VoltDB
CUSTOMERS USING VOLTDB FOR IOT TODAY
•  Smart Meters (over 60 million meters under
VoltDB management)
•  Smart Energy GB
•  Smart Metering in Japan (Shikoku and Hokkaido)
•  Wearables
•  Home Security
•  Equipment Service Automation
page© 2016 VoltDB
EQUIPMENT SERVICE AUTOMATION:
LEADING STORAGE EQUIPMENT VENDOR USING IOT
page© 2016 VoltDB 21
#Simplify
page© 2016 VoltDB
Proven
ü  Jepsen Tested
Simpler
ü  Fewer components and clusters needed
ü  Easier to write, test and maintain applications
Familiar
ü  SQL and Java
Glue
Code
Glue
Code
Zookeeper
“DIY” STREAMING DATA INFRASTRUCTURE VS VOLTDB
page© 2016 VoltDB
EXAMPLE: LARGE TELCO IOT PLATFORM
23
Challenges:
•  High volume and velocity of data from smart
devices
•  Complexity (multiple ingest points, apps,
databases)
•  Performance – need to automate action on
inbound data at the velocity of the feeds
Notes
•  Applications have their own database
•  Each database replicates to Cassandra
and Hadoop
•  In-memory grid used to maintain logic and
publish ‘state’ back and forth
•  Rules engine for intra-day data to trigger
actions (e.g., ‘turn lights on’)
•  PostgreSQL used for dimension data
page© 2016 VoltDB
BEFORE
24
AFTER
Results
ü  Simplified system architecture
ü  Single ingest point for high-velocity feeds of inbound data
ü  Faster time to value
page© 2016 VoltDB
BEFORE
25
OR POSSIBLY
Results
ü  Simplified system architecture
ü  Single ingest point for high-velocity feeds of inbound data
ü  Faster time to value
page© 2016 VoltDB
DEMO
26
page© 2016 VoltDB
DEMO
27
page© 2016 VoltDB
QUESTIONS?
•  Use the chat window to type in your questions
•  Download our ebook,
Architecting for the Internet of Things
(learn.voltdb.com/EbookIoT.html)
•  Try VoltDB yourself
Free trial of the Enterprise Edition:
www.voltdb.com/Download
•  Email us at: info@voltdb.com
28

More Related Content

What's hot

The Expert Guide to Fast Data
The Expert Guide to Fast Data The Expert Guide to Fast Data
The Expert Guide to Fast Data VoltDB
 
The State of Streaming Analytics: The Need for Speed and Scale
The State of Streaming Analytics: The Need for Speed and ScaleThe State of Streaming Analytics: The Need for Speed and Scale
The State of Streaming Analytics: The Need for Speed and ScaleVoltDB
 
Arguments for a Unified IoT Architecture
Arguments for a Unified IoT ArchitectureArguments for a Unified IoT Architecture
Arguments for a Unified IoT ArchitectureVoltDB
 
How to Build Real-Time Streaming Analytics with an In-memory, Scale-out SQL D...
How to Build Real-Time Streaming Analytics with an In-memory, Scale-out SQL D...How to Build Real-Time Streaming Analytics with an In-memory, Scale-out SQL D...
How to Build Real-Time Streaming Analytics with an In-memory, Scale-out SQL D...VoltDB
 
VoltDB and Flytxt Present: Building a Single Technology Platform for Real-Tim...
VoltDB and Flytxt Present: Building a Single Technology Platform for Real-Tim...VoltDB and Flytxt Present: Building a Single Technology Platform for Real-Tim...
VoltDB and Flytxt Present: Building a Single Technology Platform for Real-Tim...VoltDB
 
Stored Procedure Superpowers: A Developer’s Guide
Stored Procedure Superpowers: A Developer’s GuideStored Procedure Superpowers: A Developer’s Guide
Stored Procedure Superpowers: A Developer’s GuideVoltDB
 
Stream Processing as Game Changer for Big Data and Internet of Things by Kai ...
Stream Processing as Game Changer for Big Data and Internet of Things by Kai ...Stream Processing as Game Changer for Big Data and Internet of Things by Kai ...
Stream Processing as Game Changer for Big Data and Internet of Things by Kai ...Big Data Spain
 
End to End Supply Chain Control Tower
End to End Supply Chain Control TowerEnd to End Supply Chain Control Tower
End to End Supply Chain Control TowerDatabricks
 
Mike Stonebraker on Designing An Architecture For Real-time Event Processing
Mike Stonebraker on Designing An Architecture For Real-time Event ProcessingMike Stonebraker on Designing An Architecture For Real-time Event Processing
Mike Stonebraker on Designing An Architecture For Real-time Event ProcessingVoltDB
 
Next generation Polyglot Architectures using Neo4j by Stefan Kolmar
Next generation Polyglot Architectures using Neo4j by Stefan KolmarNext generation Polyglot Architectures using Neo4j by Stefan Kolmar
Next generation Polyglot Architectures using Neo4j by Stefan KolmarBig Data Spain
 
In-Memory Computing Webcast. Market Predictions 2017
In-Memory Computing Webcast. Market Predictions 2017In-Memory Computing Webcast. Market Predictions 2017
In-Memory Computing Webcast. Market Predictions 2017SingleStore
 
How a Media Data Platform Drives Real-time Insights & Analytics using Apache ...
How a Media Data Platform Drives Real-time Insights & Analytics using Apache ...How a Media Data Platform Drives Real-time Insights & Analytics using Apache ...
How a Media Data Platform Drives Real-time Insights & Analytics using Apache ...Databricks
 
How to Build Cloud-based Microservice Environments with Docker and VoltDB
How to Build Cloud-based Microservice Environments with Docker and VoltDBHow to Build Cloud-based Microservice Environments with Docker and VoltDB
How to Build Cloud-based Microservice Environments with Docker and VoltDBVoltDB
 
HP Discover: Real Time Insights from Big Data
HP Discover: Real Time Insights from Big DataHP Discover: Real Time Insights from Big Data
HP Discover: Real Time Insights from Big DataRob Winters
 
Architecting for Real-Time Big Data Analytics
Architecting for Real-Time Big Data AnalyticsArchitecting for Real-Time Big Data Analytics
Architecting for Real-Time Big Data AnalyticsRob Winters
 
Eat Your Data and Have It Too: Get the Blazing Performance of In-Memory Opera...
Eat Your Data and Have It Too: Get the Blazing Performance of In-Memory Opera...Eat Your Data and Have It Too: Get the Blazing Performance of In-Memory Opera...
Eat Your Data and Have It Too: Get the Blazing Performance of In-Memory Opera...VoltDB
 
Billions of Rows, Millions of Insights, Right Now
Billions of Rows, Millions of Insights, Right NowBillions of Rows, Millions of Insights, Right Now
Billions of Rows, Millions of Insights, Right NowRob Winters
 
Big Data at a Gaming Company: Spil Games
Big Data at a Gaming Company: Spil GamesBig Data at a Gaming Company: Spil Games
Big Data at a Gaming Company: Spil GamesRob Winters
 
Data Mesh in Practice: How Europe’s Leading Online Platform for Fashion Goes ...
Data Mesh in Practice: How Europe’s Leading Online Platform for Fashion Goes ...Data Mesh in Practice: How Europe’s Leading Online Platform for Fashion Goes ...
Data Mesh in Practice: How Europe’s Leading Online Platform for Fashion Goes ...Databricks
 
Migration and Coexistence between Relational and NoSQL Databases by Manuel H...
 Migration and Coexistence between Relational and NoSQL Databases by Manuel H... Migration and Coexistence between Relational and NoSQL Databases by Manuel H...
Migration and Coexistence between Relational and NoSQL Databases by Manuel H...Big Data Spain
 

What's hot (20)

The Expert Guide to Fast Data
The Expert Guide to Fast Data The Expert Guide to Fast Data
The Expert Guide to Fast Data
 
The State of Streaming Analytics: The Need for Speed and Scale
The State of Streaming Analytics: The Need for Speed and ScaleThe State of Streaming Analytics: The Need for Speed and Scale
The State of Streaming Analytics: The Need for Speed and Scale
 
Arguments for a Unified IoT Architecture
Arguments for a Unified IoT ArchitectureArguments for a Unified IoT Architecture
Arguments for a Unified IoT Architecture
 
How to Build Real-Time Streaming Analytics with an In-memory, Scale-out SQL D...
How to Build Real-Time Streaming Analytics with an In-memory, Scale-out SQL D...How to Build Real-Time Streaming Analytics with an In-memory, Scale-out SQL D...
How to Build Real-Time Streaming Analytics with an In-memory, Scale-out SQL D...
 
VoltDB and Flytxt Present: Building a Single Technology Platform for Real-Tim...
VoltDB and Flytxt Present: Building a Single Technology Platform for Real-Tim...VoltDB and Flytxt Present: Building a Single Technology Platform for Real-Tim...
VoltDB and Flytxt Present: Building a Single Technology Platform for Real-Tim...
 
Stored Procedure Superpowers: A Developer’s Guide
Stored Procedure Superpowers: A Developer’s GuideStored Procedure Superpowers: A Developer’s Guide
Stored Procedure Superpowers: A Developer’s Guide
 
Stream Processing as Game Changer for Big Data and Internet of Things by Kai ...
Stream Processing as Game Changer for Big Data and Internet of Things by Kai ...Stream Processing as Game Changer for Big Data and Internet of Things by Kai ...
Stream Processing as Game Changer for Big Data and Internet of Things by Kai ...
 
End to End Supply Chain Control Tower
End to End Supply Chain Control TowerEnd to End Supply Chain Control Tower
End to End Supply Chain Control Tower
 
Mike Stonebraker on Designing An Architecture For Real-time Event Processing
Mike Stonebraker on Designing An Architecture For Real-time Event ProcessingMike Stonebraker on Designing An Architecture For Real-time Event Processing
Mike Stonebraker on Designing An Architecture For Real-time Event Processing
 
Next generation Polyglot Architectures using Neo4j by Stefan Kolmar
Next generation Polyglot Architectures using Neo4j by Stefan KolmarNext generation Polyglot Architectures using Neo4j by Stefan Kolmar
Next generation Polyglot Architectures using Neo4j by Stefan Kolmar
 
In-Memory Computing Webcast. Market Predictions 2017
In-Memory Computing Webcast. Market Predictions 2017In-Memory Computing Webcast. Market Predictions 2017
In-Memory Computing Webcast. Market Predictions 2017
 
How a Media Data Platform Drives Real-time Insights & Analytics using Apache ...
How a Media Data Platform Drives Real-time Insights & Analytics using Apache ...How a Media Data Platform Drives Real-time Insights & Analytics using Apache ...
How a Media Data Platform Drives Real-time Insights & Analytics using Apache ...
 
How to Build Cloud-based Microservice Environments with Docker and VoltDB
How to Build Cloud-based Microservice Environments with Docker and VoltDBHow to Build Cloud-based Microservice Environments with Docker and VoltDB
How to Build Cloud-based Microservice Environments with Docker and VoltDB
 
HP Discover: Real Time Insights from Big Data
HP Discover: Real Time Insights from Big DataHP Discover: Real Time Insights from Big Data
HP Discover: Real Time Insights from Big Data
 
Architecting for Real-Time Big Data Analytics
Architecting for Real-Time Big Data AnalyticsArchitecting for Real-Time Big Data Analytics
Architecting for Real-Time Big Data Analytics
 
Eat Your Data and Have It Too: Get the Blazing Performance of In-Memory Opera...
Eat Your Data and Have It Too: Get the Blazing Performance of In-Memory Opera...Eat Your Data and Have It Too: Get the Blazing Performance of In-Memory Opera...
Eat Your Data and Have It Too: Get the Blazing Performance of In-Memory Opera...
 
Billions of Rows, Millions of Insights, Right Now
Billions of Rows, Millions of Insights, Right NowBillions of Rows, Millions of Insights, Right Now
Billions of Rows, Millions of Insights, Right Now
 
Big Data at a Gaming Company: Spil Games
Big Data at a Gaming Company: Spil GamesBig Data at a Gaming Company: Spil Games
Big Data at a Gaming Company: Spil Games
 
Data Mesh in Practice: How Europe’s Leading Online Platform for Fashion Goes ...
Data Mesh in Practice: How Europe’s Leading Online Platform for Fashion Goes ...Data Mesh in Practice: How Europe’s Leading Online Platform for Fashion Goes ...
Data Mesh in Practice: How Europe’s Leading Online Platform for Fashion Goes ...
 
Migration and Coexistence between Relational and NoSQL Databases by Manuel H...
 Migration and Coexistence between Relational and NoSQL Databases by Manuel H... Migration and Coexistence between Relational and NoSQL Databases by Manuel H...
Migration and Coexistence between Relational and NoSQL Databases by Manuel H...
 

Viewers also liked

Vertica And Spark: Connecting Computation And Data
Vertica And Spark: Connecting Computation And DataVertica And Spark: Connecting Computation And Data
Vertica And Spark: Connecting Computation And DataSpark Summit
 
Moving Beyond Batch: Transactional Databases for Real-time Data
Moving Beyond Batch: Transactional Databases for Real-time DataMoving Beyond Batch: Transactional Databases for Real-time Data
Moving Beyond Batch: Transactional Databases for Real-time DataVoltDB
 
VoltDB : A Technical Overview
VoltDB : A Technical OverviewVoltDB : A Technical Overview
VoltDB : A Technical OverviewTim Callaghan
 
Hortonworks and HP Vertica Webinar
Hortonworks and HP Vertica WebinarHortonworks and HP Vertica Webinar
Hortonworks and HP Vertica WebinarHortonworks
 
Understanding the Operational Database Infrastructure for IoT and Fast Data
Understanding the Operational Database Infrastructure for IoT and Fast DataUnderstanding the Operational Database Infrastructure for IoT and Fast Data
Understanding the Operational Database Infrastructure for IoT and Fast DataVoltDB
 
Understanding the Top Four Use Cases for IoT
Understanding the Top Four Use Cases for IoTUnderstanding the Top Four Use Cases for IoT
Understanding the Top Four Use Cases for IoTVoltDB
 
Introduction to Vertica (Architecture & More)
Introduction to Vertica (Architecture & More)Introduction to Vertica (Architecture & More)
Introduction to Vertica (Architecture & More)LivePerson
 
MySQL Alta Performance & Alta Disponibilidade
MySQL Alta Performance & Alta DisponibilidadeMySQL Alta Performance & Alta Disponibilidade
MySQL Alta Performance & Alta DisponibilidadeMySQL Brasil
 
HPBigData2015 PSTL kafka spark vertica
HPBigData2015 PSTL kafka spark verticaHPBigData2015 PSTL kafka spark vertica
HPBigData2015 PSTL kafka spark verticaJack Gudenkauf
 
Event Driven Streaming Analytics - Demostration on Architecture of IoT
Event Driven Streaming Analytics - Demostration on Architecture of IoTEvent Driven Streaming Analytics - Demostration on Architecture of IoT
Event Driven Streaming Analytics - Demostration on Architecture of IoTLei Xu
 
End-to-end Machine Learning Pipelines with HP Vertica and Distributed R
End-to-end Machine Learning Pipelines with HP Vertica and Distributed REnd-to-end Machine Learning Pipelines with HP Vertica and Distributed R
End-to-end Machine Learning Pipelines with HP Vertica and Distributed RJorge Martinez de Salinas
 
Acting on Real-time Behavior: How Peak Games Won Transactions
Acting on Real-time Behavior: How Peak Games Won TransactionsActing on Real-time Behavior: How Peak Games Won Transactions
Acting on Real-time Behavior: How Peak Games Won TransactionsVoltDB
 
Bridging Structured and Unstructred Data with Apache Hadoop and Vertica
Bridging Structured and Unstructred Data with Apache Hadoop and VerticaBridging Structured and Unstructred Data with Apache Hadoop and Vertica
Bridging Structured and Unstructred Data with Apache Hadoop and VerticaSteve Watt
 
Kyle Kingsbury Talks about the Jepsen Test: What VoltDB Learned About Data Ac...
Kyle Kingsbury Talks about the Jepsen Test: What VoltDB Learned About Data Ac...Kyle Kingsbury Talks about the Jepsen Test: What VoltDB Learned About Data Ac...
Kyle Kingsbury Talks about the Jepsen Test: What VoltDB Learned About Data Ac...VoltDB
 
Vertica loading best practices
Vertica loading best practicesVertica loading best practices
Vertica loading best practicesZvika Gutkin
 
Big data, Behavioral Change and IOT Architecture
Big data, Behavioral Change and IOT ArchitectureBig data, Behavioral Change and IOT Architecture
Big data, Behavioral Change and IOT ArchitectureYves Caseau
 
MongoDB IoT City Tour EINDHOVEN: Industry 4.0 and the Internet of Things: Inm...
MongoDB IoT City Tour EINDHOVEN: Industry 4.0 and the Internet of Things: Inm...MongoDB IoT City Tour EINDHOVEN: Industry 4.0 and the Internet of Things: Inm...
MongoDB IoT City Tour EINDHOVEN: Industry 4.0 and the Internet of Things: Inm...MongoDB
 
DOAN DuyHai – Cassandra: real world best use-cases and worst anti-patterns - ...
DOAN DuyHai – Cassandra: real world best use-cases and worst anti-patterns - ...DOAN DuyHai – Cassandra: real world best use-cases and worst anti-patterns - ...
DOAN DuyHai – Cassandra: real world best use-cases and worst anti-patterns - ...NoSQLmatters
 

Viewers also liked (19)

Vertica And Spark: Connecting Computation And Data
Vertica And Spark: Connecting Computation And DataVertica And Spark: Connecting Computation And Data
Vertica And Spark: Connecting Computation And Data
 
Moving Beyond Batch: Transactional Databases for Real-time Data
Moving Beyond Batch: Transactional Databases for Real-time DataMoving Beyond Batch: Transactional Databases for Real-time Data
Moving Beyond Batch: Transactional Databases for Real-time Data
 
VoltDB : A Technical Overview
VoltDB : A Technical OverviewVoltDB : A Technical Overview
VoltDB : A Technical Overview
 
Hortonworks and HP Vertica Webinar
Hortonworks and HP Vertica WebinarHortonworks and HP Vertica Webinar
Hortonworks and HP Vertica Webinar
 
Understanding the Operational Database Infrastructure for IoT and Fast Data
Understanding the Operational Database Infrastructure for IoT and Fast DataUnderstanding the Operational Database Infrastructure for IoT and Fast Data
Understanding the Operational Database Infrastructure for IoT and Fast Data
 
Understanding the Top Four Use Cases for IoT
Understanding the Top Four Use Cases for IoTUnderstanding the Top Four Use Cases for IoT
Understanding the Top Four Use Cases for IoT
 
Introduction to Vertica (Architecture & More)
Introduction to Vertica (Architecture & More)Introduction to Vertica (Architecture & More)
Introduction to Vertica (Architecture & More)
 
MySQL Alta Performance & Alta Disponibilidade
MySQL Alta Performance & Alta DisponibilidadeMySQL Alta Performance & Alta Disponibilidade
MySQL Alta Performance & Alta Disponibilidade
 
HPBigData2015 PSTL kafka spark vertica
HPBigData2015 PSTL kafka spark verticaHPBigData2015 PSTL kafka spark vertica
HPBigData2015 PSTL kafka spark vertica
 
Event Driven Streaming Analytics - Demostration on Architecture of IoT
Event Driven Streaming Analytics - Demostration on Architecture of IoTEvent Driven Streaming Analytics - Demostration on Architecture of IoT
Event Driven Streaming Analytics - Demostration on Architecture of IoT
 
End-to-end Machine Learning Pipelines with HP Vertica and Distributed R
End-to-end Machine Learning Pipelines with HP Vertica and Distributed REnd-to-end Machine Learning Pipelines with HP Vertica and Distributed R
End-to-end Machine Learning Pipelines with HP Vertica and Distributed R
 
Acting on Real-time Behavior: How Peak Games Won Transactions
Acting on Real-time Behavior: How Peak Games Won TransactionsActing on Real-time Behavior: How Peak Games Won Transactions
Acting on Real-time Behavior: How Peak Games Won Transactions
 
Bridging Structured and Unstructred Data with Apache Hadoop and Vertica
Bridging Structured and Unstructred Data with Apache Hadoop and VerticaBridging Structured and Unstructred Data with Apache Hadoop and Vertica
Bridging Structured and Unstructred Data with Apache Hadoop and Vertica
 
Kyle Kingsbury Talks about the Jepsen Test: What VoltDB Learned About Data Ac...
Kyle Kingsbury Talks about the Jepsen Test: What VoltDB Learned About Data Ac...Kyle Kingsbury Talks about the Jepsen Test: What VoltDB Learned About Data Ac...
Kyle Kingsbury Talks about the Jepsen Test: What VoltDB Learned About Data Ac...
 
Vertica loading best practices
Vertica loading best practicesVertica loading best practices
Vertica loading best practices
 
Big data, Behavioral Change and IOT Architecture
Big data, Behavioral Change and IOT ArchitectureBig data, Behavioral Change and IOT Architecture
Big data, Behavioral Change and IOT Architecture
 
MongoDB IoT City Tour EINDHOVEN: Industry 4.0 and the Internet of Things: Inm...
MongoDB IoT City Tour EINDHOVEN: Industry 4.0 and the Internet of Things: Inm...MongoDB IoT City Tour EINDHOVEN: Industry 4.0 and the Internet of Things: Inm...
MongoDB IoT City Tour EINDHOVEN: Industry 4.0 and the Internet of Things: Inm...
 
DOAN DuyHai – Cassandra: real world best use-cases and worst anti-patterns - ...
DOAN DuyHai – Cassandra: real world best use-cases and worst anti-patterns - ...DOAN DuyHai – Cassandra: real world best use-cases and worst anti-patterns - ...
DOAN DuyHai – Cassandra: real world best use-cases and worst anti-patterns - ...
 
Vertica
VerticaVertica
Vertica
 

Similar to VoltDB and HPE Vertica Present: Building an IoT Architecture for Fast + Big Data

Cloud Experience: Data-driven Applications Made Simple and Fast
Cloud Experience: Data-driven Applications Made Simple and FastCloud Experience: Data-driven Applications Made Simple and Fast
Cloud Experience: Data-driven Applications Made Simple and FastDatabricks
 
Data Virtualization: An Introduction
Data Virtualization: An IntroductionData Virtualization: An Introduction
Data Virtualization: An IntroductionDenodo
 
Bridging the Last Mile: Getting Data to the People Who Need It
Bridging the Last Mile: Getting Data to the People Who Need ItBridging the Last Mile: Getting Data to the People Who Need It
Bridging the Last Mile: Getting Data to the People Who Need ItDenodo
 
Operational information processing: lightning-fast, delightfully simple
Operational information processing: lightning-fast, delightfully simpleOperational information processing: lightning-fast, delightfully simple
Operational information processing: lightning-fast, delightfully simpleXylos
 
Data Virtualization. An Introduction (ASEAN)
Data Virtualization. An Introduction (ASEAN)Data Virtualization. An Introduction (ASEAN)
Data Virtualization. An Introduction (ASEAN)Denodo
 
Evolution from EDA to Data Mesh: Data in Motion
Evolution from EDA to Data Mesh: Data in MotionEvolution from EDA to Data Mesh: Data in Motion
Evolution from EDA to Data Mesh: Data in Motionconfluent
 
Data Virtualization: An Introduction
Data Virtualization: An IntroductionData Virtualization: An Introduction
Data Virtualization: An IntroductionDenodo
 
Flash session -streaming--ses1243-lon
Flash session -streaming--ses1243-lonFlash session -streaming--ses1243-lon
Flash session -streaming--ses1243-lonJeffrey T. Pollock
 
Denodo DataFest 2016: The Role of Data Virtualization in IoT Integration
Denodo DataFest 2016: The Role of Data Virtualization in IoT IntegrationDenodo DataFest 2016: The Role of Data Virtualization in IoT Integration
Denodo DataFest 2016: The Role of Data Virtualization in IoT IntegrationDenodo
 
IoT Architecture - are traditional architectures good enough?
IoT Architecture - are traditional architectures good enough?IoT Architecture - are traditional architectures good enough?
IoT Architecture - are traditional architectures good enough?Guido Schmutz
 
Akmal Chaudhri - How to Build Streaming Data Applications: Evaluating the Top...
Akmal Chaudhri - How to Build Streaming Data Applications: Evaluating the Top...Akmal Chaudhri - How to Build Streaming Data Applications: Evaluating the Top...
Akmal Chaudhri - How to Build Streaming Data Applications: Evaluating the Top...NoSQLmatters
 
Dell Digital Transformation Through AI and Data Analytics Webinar
Dell Digital Transformation Through AI and  Data Analytics WebinarDell Digital Transformation Through AI and  Data Analytics Webinar
Dell Digital Transformation Through AI and Data Analytics WebinarBill Wong
 
Internet of Things (IoT) - in the cloud or rather on-premises?
Internet of Things (IoT) - in the cloud or rather on-premises?Internet of Things (IoT) - in the cloud or rather on-premises?
Internet of Things (IoT) - in the cloud or rather on-premises?Guido Schmutz
 
High-performance database technology for rock-solid IoT solutions
High-performance database technology for rock-solid IoT solutionsHigh-performance database technology for rock-solid IoT solutions
High-performance database technology for rock-solid IoT solutionsClusterpoint
 
Real-Time Analytics with Confluent and MemSQL
Real-Time Analytics with Confluent and MemSQLReal-Time Analytics with Confluent and MemSQL
Real-Time Analytics with Confluent and MemSQLSingleStore
 
Bridging the Last Mile: Getting Data to the People Who Need It (APAC)
Bridging the Last Mile: Getting Data to the People Who Need It (APAC)Bridging the Last Mile: Getting Data to the People Who Need It (APAC)
Bridging the Last Mile: Getting Data to the People Who Need It (APAC)Denodo
 
Digital Business Transformation in the Streaming Era
Digital Business Transformation in the Streaming EraDigital Business Transformation in the Streaming Era
Digital Business Transformation in the Streaming EraAttunity
 
IoT Slam Keynote: Harnessing the Flood of Data with Heterogeneous Computing a...
IoT Slam Keynote: Harnessing the Flood of Data with Heterogeneous Computing a...IoT Slam Keynote: Harnessing the Flood of Data with Heterogeneous Computing a...
IoT Slam Keynote: Harnessing the Flood of Data with Heterogeneous Computing a...Ryft
 
How to Swiftly Operationalize the Data Lake for Advanced Analytics Using a Lo...
How to Swiftly Operationalize the Data Lake for Advanced Analytics Using a Lo...How to Swiftly Operationalize the Data Lake for Advanced Analytics Using a Lo...
How to Swiftly Operationalize the Data Lake for Advanced Analytics Using a Lo...Denodo
 
Introduction to Modern Data Virtualization 2021 (APAC)
Introduction to Modern Data Virtualization 2021 (APAC)Introduction to Modern Data Virtualization 2021 (APAC)
Introduction to Modern Data Virtualization 2021 (APAC)Denodo
 

Similar to VoltDB and HPE Vertica Present: Building an IoT Architecture for Fast + Big Data (20)

Cloud Experience: Data-driven Applications Made Simple and Fast
Cloud Experience: Data-driven Applications Made Simple and FastCloud Experience: Data-driven Applications Made Simple and Fast
Cloud Experience: Data-driven Applications Made Simple and Fast
 
Data Virtualization: An Introduction
Data Virtualization: An IntroductionData Virtualization: An Introduction
Data Virtualization: An Introduction
 
Bridging the Last Mile: Getting Data to the People Who Need It
Bridging the Last Mile: Getting Data to the People Who Need ItBridging the Last Mile: Getting Data to the People Who Need It
Bridging the Last Mile: Getting Data to the People Who Need It
 
Operational information processing: lightning-fast, delightfully simple
Operational information processing: lightning-fast, delightfully simpleOperational information processing: lightning-fast, delightfully simple
Operational information processing: lightning-fast, delightfully simple
 
Data Virtualization. An Introduction (ASEAN)
Data Virtualization. An Introduction (ASEAN)Data Virtualization. An Introduction (ASEAN)
Data Virtualization. An Introduction (ASEAN)
 
Evolution from EDA to Data Mesh: Data in Motion
Evolution from EDA to Data Mesh: Data in MotionEvolution from EDA to Data Mesh: Data in Motion
Evolution from EDA to Data Mesh: Data in Motion
 
Data Virtualization: An Introduction
Data Virtualization: An IntroductionData Virtualization: An Introduction
Data Virtualization: An Introduction
 
Flash session -streaming--ses1243-lon
Flash session -streaming--ses1243-lonFlash session -streaming--ses1243-lon
Flash session -streaming--ses1243-lon
 
Denodo DataFest 2016: The Role of Data Virtualization in IoT Integration
Denodo DataFest 2016: The Role of Data Virtualization in IoT IntegrationDenodo DataFest 2016: The Role of Data Virtualization in IoT Integration
Denodo DataFest 2016: The Role of Data Virtualization in IoT Integration
 
IoT Architecture - are traditional architectures good enough?
IoT Architecture - are traditional architectures good enough?IoT Architecture - are traditional architectures good enough?
IoT Architecture - are traditional architectures good enough?
 
Akmal Chaudhri - How to Build Streaming Data Applications: Evaluating the Top...
Akmal Chaudhri - How to Build Streaming Data Applications: Evaluating the Top...Akmal Chaudhri - How to Build Streaming Data Applications: Evaluating the Top...
Akmal Chaudhri - How to Build Streaming Data Applications: Evaluating the Top...
 
Dell Digital Transformation Through AI and Data Analytics Webinar
Dell Digital Transformation Through AI and  Data Analytics WebinarDell Digital Transformation Through AI and  Data Analytics Webinar
Dell Digital Transformation Through AI and Data Analytics Webinar
 
Internet of Things (IoT) - in the cloud or rather on-premises?
Internet of Things (IoT) - in the cloud or rather on-premises?Internet of Things (IoT) - in the cloud or rather on-premises?
Internet of Things (IoT) - in the cloud or rather on-premises?
 
High-performance database technology for rock-solid IoT solutions
High-performance database technology for rock-solid IoT solutionsHigh-performance database technology for rock-solid IoT solutions
High-performance database technology for rock-solid IoT solutions
 
Real-Time Analytics with Confluent and MemSQL
Real-Time Analytics with Confluent and MemSQLReal-Time Analytics with Confluent and MemSQL
Real-Time Analytics with Confluent and MemSQL
 
Bridging the Last Mile: Getting Data to the People Who Need It (APAC)
Bridging the Last Mile: Getting Data to the People Who Need It (APAC)Bridging the Last Mile: Getting Data to the People Who Need It (APAC)
Bridging the Last Mile: Getting Data to the People Who Need It (APAC)
 
Digital Business Transformation in the Streaming Era
Digital Business Transformation in the Streaming EraDigital Business Transformation in the Streaming Era
Digital Business Transformation in the Streaming Era
 
IoT Slam Keynote: Harnessing the Flood of Data with Heterogeneous Computing a...
IoT Slam Keynote: Harnessing the Flood of Data with Heterogeneous Computing a...IoT Slam Keynote: Harnessing the Flood of Data with Heterogeneous Computing a...
IoT Slam Keynote: Harnessing the Flood of Data with Heterogeneous Computing a...
 
How to Swiftly Operationalize the Data Lake for Advanced Analytics Using a Lo...
How to Swiftly Operationalize the Data Lake for Advanced Analytics Using a Lo...How to Swiftly Operationalize the Data Lake for Advanced Analytics Using a Lo...
How to Swiftly Operationalize the Data Lake for Advanced Analytics Using a Lo...
 
Introduction to Modern Data Virtualization 2021 (APAC)
Introduction to Modern Data Virtualization 2021 (APAC)Introduction to Modern Data Virtualization 2021 (APAC)
Introduction to Modern Data Virtualization 2021 (APAC)
 

More from VoltDB

TripleLift: Preparing for a New Programmatic Ad-Tech World
TripleLift: Preparing for a New Programmatic Ad-Tech WorldTripleLift: Preparing for a New Programmatic Ad-Tech World
TripleLift: Preparing for a New Programmatic Ad-Tech WorldVoltDB
 
Why you really want SQL in a Real-Time Enterprise Environment
Why you really want SQL in a Real-Time Enterprise EnvironmentWhy you really want SQL in a Real-Time Enterprise Environment
Why you really want SQL in a Real-Time Enterprise EnvironmentVoltDB
 
How First to Value Beats First to Market: Case Studies of Fast Data Success
How First to Value Beats First to Market: Case Studies of Fast Data SuccessHow First to Value Beats First to Market: Case Studies of Fast Data Success
How First to Value Beats First to Market: Case Studies of Fast Data SuccessVoltDB
 
Lessons Learned: The Impact of Fast Data for Personalization
Lessons Learned: The Impact of Fast Data for PersonalizationLessons Learned: The Impact of Fast Data for Personalization
Lessons Learned: The Impact of Fast Data for PersonalizationVoltDB
 
Fast Data for Competitive Advantage: 4 Steps to Expand your Window of Opportu...
Fast Data for Competitive Advantage: 4 Steps to Expand your Window of Opportu...Fast Data for Competitive Advantage: 4 Steps to Expand your Window of Opportu...
Fast Data for Competitive Advantage: 4 Steps to Expand your Window of Opportu...VoltDB
 
The Two Generals Problem
The Two Generals ProblemThe Two Generals Problem
The Two Generals ProblemVoltDB
 
The 10 MS Rule: Getting to 'Yes' with Fast Data & Hadoop
The 10 MS Rule: Getting to 'Yes' with Fast Data & HadoopThe 10 MS Rule: Getting to 'Yes' with Fast Data & Hadoop
The 10 MS Rule: Getting to 'Yes' with Fast Data & HadoopVoltDB
 
Fast Data: Achieving Real-Time Data Analysis Across the Financial Data Continuum
Fast Data: Achieving Real-Time Data Analysis Across the Financial Data ContinuumFast Data: Achieving Real-Time Data Analysis Across the Financial Data Continuum
Fast Data: Achieving Real-Time Data Analysis Across the Financial Data ContinuumVoltDB
 

More from VoltDB (8)

TripleLift: Preparing for a New Programmatic Ad-Tech World
TripleLift: Preparing for a New Programmatic Ad-Tech WorldTripleLift: Preparing for a New Programmatic Ad-Tech World
TripleLift: Preparing for a New Programmatic Ad-Tech World
 
Why you really want SQL in a Real-Time Enterprise Environment
Why you really want SQL in a Real-Time Enterprise EnvironmentWhy you really want SQL in a Real-Time Enterprise Environment
Why you really want SQL in a Real-Time Enterprise Environment
 
How First to Value Beats First to Market: Case Studies of Fast Data Success
How First to Value Beats First to Market: Case Studies of Fast Data SuccessHow First to Value Beats First to Market: Case Studies of Fast Data Success
How First to Value Beats First to Market: Case Studies of Fast Data Success
 
Lessons Learned: The Impact of Fast Data for Personalization
Lessons Learned: The Impact of Fast Data for PersonalizationLessons Learned: The Impact of Fast Data for Personalization
Lessons Learned: The Impact of Fast Data for Personalization
 
Fast Data for Competitive Advantage: 4 Steps to Expand your Window of Opportu...
Fast Data for Competitive Advantage: 4 Steps to Expand your Window of Opportu...Fast Data for Competitive Advantage: 4 Steps to Expand your Window of Opportu...
Fast Data for Competitive Advantage: 4 Steps to Expand your Window of Opportu...
 
The Two Generals Problem
The Two Generals ProblemThe Two Generals Problem
The Two Generals Problem
 
The 10 MS Rule: Getting to 'Yes' with Fast Data & Hadoop
The 10 MS Rule: Getting to 'Yes' with Fast Data & HadoopThe 10 MS Rule: Getting to 'Yes' with Fast Data & Hadoop
The 10 MS Rule: Getting to 'Yes' with Fast Data & Hadoop
 
Fast Data: Achieving Real-Time Data Analysis Across the Financial Data Continuum
Fast Data: Achieving Real-Time Data Analysis Across the Financial Data ContinuumFast Data: Achieving Real-Time Data Analysis Across the Financial Data Continuum
Fast Data: Achieving Real-Time Data Analysis Across the Financial Data Continuum
 

Recently uploaded

Adobe Marketo Engage Deep Dives: Using Webhooks to Transfer Data
Adobe Marketo Engage Deep Dives: Using Webhooks to Transfer DataAdobe Marketo Engage Deep Dives: Using Webhooks to Transfer Data
Adobe Marketo Engage Deep Dives: Using Webhooks to Transfer DataBradBedford3
 
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...Christina Lin
 
Project Based Learning (A.I).pptx detail explanation
Project Based Learning (A.I).pptx detail explanationProject Based Learning (A.I).pptx detail explanation
Project Based Learning (A.I).pptx detail explanationkaushalgiri8080
 
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...kellynguyen01
 
cybersecurity notes for mca students for learning
cybersecurity notes for mca students for learningcybersecurity notes for mca students for learning
cybersecurity notes for mca students for learningVitsRangannavar
 
Asset Management Software - Infographic
Asset Management Software - InfographicAsset Management Software - Infographic
Asset Management Software - InfographicHr365.us smith
 
Unit 1.1 Excite Part 1, class 9, cbse...
Unit 1.1 Excite Part 1, class 9, cbse...Unit 1.1 Excite Part 1, class 9, cbse...
Unit 1.1 Excite Part 1, class 9, cbse...aditisharan08
 
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time ApplicationsUnveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time ApplicationsAlberto González Trastoy
 
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...MyIntelliSource, Inc.
 
EY_Graph Database Powered Sustainability
EY_Graph Database Powered SustainabilityEY_Graph Database Powered Sustainability
EY_Graph Database Powered SustainabilityNeo4j
 
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdfLearn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdfkalichargn70th171
 
Professional Resume Template for Software Developers
Professional Resume Template for Software DevelopersProfessional Resume Template for Software Developers
Professional Resume Template for Software DevelopersVinodh Ram
 
Hand gesture recognition PROJECT PPT.pptx
Hand gesture recognition PROJECT PPT.pptxHand gesture recognition PROJECT PPT.pptx
Hand gesture recognition PROJECT PPT.pptxbodapatigopi8531
 
Engage Usergroup 2024 - The Good The Bad_The Ugly
Engage Usergroup 2024 - The Good The Bad_The UglyEngage Usergroup 2024 - The Good The Bad_The Ugly
Engage Usergroup 2024 - The Good The Bad_The UglyFrank van der Linden
 
Advancing Engineering with AI through the Next Generation of Strategic Projec...
Advancing Engineering with AI through the Next Generation of Strategic Projec...Advancing Engineering with AI through the Next Generation of Strategic Projec...
Advancing Engineering with AI through the Next Generation of Strategic Projec...OnePlan Solutions
 
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...gurkirankumar98700
 
Der Spagat zwischen BIAS und FAIRNESS (2024)
Der Spagat zwischen BIAS und FAIRNESS (2024)Der Spagat zwischen BIAS und FAIRNESS (2024)
Der Spagat zwischen BIAS und FAIRNESS (2024)OPEN KNOWLEDGE GmbH
 
BATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASE
BATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASEBATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASE
BATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASEOrtus Solutions, Corp
 
Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideBuilding Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideChristina Lin
 

Recently uploaded (20)

Adobe Marketo Engage Deep Dives: Using Webhooks to Transfer Data
Adobe Marketo Engage Deep Dives: Using Webhooks to Transfer DataAdobe Marketo Engage Deep Dives: Using Webhooks to Transfer Data
Adobe Marketo Engage Deep Dives: Using Webhooks to Transfer Data
 
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
 
Project Based Learning (A.I).pptx detail explanation
Project Based Learning (A.I).pptx detail explanationProject Based Learning (A.I).pptx detail explanation
Project Based Learning (A.I).pptx detail explanation
 
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
 
cybersecurity notes for mca students for learning
cybersecurity notes for mca students for learningcybersecurity notes for mca students for learning
cybersecurity notes for mca students for learning
 
Asset Management Software - Infographic
Asset Management Software - InfographicAsset Management Software - Infographic
Asset Management Software - Infographic
 
Unit 1.1 Excite Part 1, class 9, cbse...
Unit 1.1 Excite Part 1, class 9, cbse...Unit 1.1 Excite Part 1, class 9, cbse...
Unit 1.1 Excite Part 1, class 9, cbse...
 
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time ApplicationsUnveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
 
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...
 
EY_Graph Database Powered Sustainability
EY_Graph Database Powered SustainabilityEY_Graph Database Powered Sustainability
EY_Graph Database Powered Sustainability
 
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdfLearn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
 
Professional Resume Template for Software Developers
Professional Resume Template for Software DevelopersProfessional Resume Template for Software Developers
Professional Resume Template for Software Developers
 
Hand gesture recognition PROJECT PPT.pptx
Hand gesture recognition PROJECT PPT.pptxHand gesture recognition PROJECT PPT.pptx
Hand gesture recognition PROJECT PPT.pptx
 
Engage Usergroup 2024 - The Good The Bad_The Ugly
Engage Usergroup 2024 - The Good The Bad_The UglyEngage Usergroup 2024 - The Good The Bad_The Ugly
Engage Usergroup 2024 - The Good The Bad_The Ugly
 
Call Girls In Mukherjee Nagar 📱 9999965857 🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SE...
Call Girls In Mukherjee Nagar 📱  9999965857  🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SE...Call Girls In Mukherjee Nagar 📱  9999965857  🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SE...
Call Girls In Mukherjee Nagar 📱 9999965857 🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SE...
 
Advancing Engineering with AI through the Next Generation of Strategic Projec...
Advancing Engineering with AI through the Next Generation of Strategic Projec...Advancing Engineering with AI through the Next Generation of Strategic Projec...
Advancing Engineering with AI through the Next Generation of Strategic Projec...
 
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
 
Der Spagat zwischen BIAS und FAIRNESS (2024)
Der Spagat zwischen BIAS und FAIRNESS (2024)Der Spagat zwischen BIAS und FAIRNESS (2024)
Der Spagat zwischen BIAS und FAIRNESS (2024)
 
BATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASE
BATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASEBATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASE
BATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASE
 
Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideBuilding Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
 

VoltDB and HPE Vertica Present: Building an IoT Architecture for Fast + Big Data

  • 1. page VOLTDB AND HPE VERTICA: BUILDING AN IOT ARCHITECTURE FOR FAST + BIG DATA 
  • 2. page© 2016 VoltDB OUR SPEAKERS 2 Chris Selland VP Business Development Hewlett Packard Enterprise Dennis Duckworth, Director Product Marketing VoltDB
  • 3. page© 2016 VoltDB page AGENDA •  Introduction •  What is the Internet of Things? •  HPE Vertica and IoT •  VoltDB and IoT •  Demo of VoltDB and HPE Vertica •  Q&A 3
  • 4. Building an IoT Architecture for Big & Fast Data Chris Selland VP Business Development
  • 5. What is the Internet of Things? “The Internet of Things is the network of physical objects that contains embedded technology to communicate and sense or interact with the objects' internal state or the external environment.”1 Consumer “things” Personal sensing with remote monitoring and control 1 Gartner. IT Glossary – Internet of Things. Industrial “things” From individual sensors to entire power plants
  • 6. Business outcomes through big data analytics How can value be created from IoT data? Up to $11 trillion per year in potential economic impact by 20251 •  Increased revenue •  Optimized operations •  New products and services •  Workforce productivity •  Reduced risks •  Reduced operating costs •  Optimized maintenance •  Optimized network throughput Smart citiesManufacturing Consumer Smart homes Healthcare Oil & gas Aviation Energy & utilities Transportation Retail Industries that can benefit Insurance Agriculture 1 McKinsey Global Institute. The Internet of Things: Mapping the Value Beyond the Hype, June 2015. Connected devices source of contextual data
  • 7. IoT is not the future. It’s already here. Business Outcomes •  Understand driver behaviors and patterns •  To improve efficiency of the company and drivers Business Outcomes •  Safety and well-being of citizens •  Analyzing safety threats •  Accurate identification and scene analysis Business Outcomes •  Increases customer value with equipment monitoring, event mitigation, & energy performance services •  Helps customers reduce energy & maintenance costs 7 Equipment Manufacturers Enterprises Service-based Businesses Integrated sensor and telemetry analytics in HP Fleet vehicles Monitors 2000+ cameras and performs video analytics Analytics enhance the Trane Intelligent Services business Successes in IoT
  • 9. Computing at the Edge – “shifting left” for strategic advantage Goal –  Processing streaming data as close to the sensor as possible creates new opportunities Advantage –  Processing data streams in real time, before the data is stored for additional analysis, creates advantages –  Example: Transformer or turbine thermal runaway, requires immediate action Result –  Fast action prior to data storage prevents data obsolescence and lost opportunities/alerts HPE Confidential | Share under NDA 9 “Things” generate data and need control Edge IT, data center and cloudOperations technology Early analytics and compute Deep analytics and compute Data is sensed, Things controlled Data acquired and aggregated The Edge Opportunity Accelerate insight by moving compute from the data center to the Edge Data flow Control flow Augment the data center with processing at the edge
  • 10. The Vertica Real-Time Analytics Engine Native High Availability Standard SQL Interface Column Orientation Auto Database Design Advanced Compression MPP Massive Parallel Processing Leverages BI, ETL, Hadoop/MapReduce and OLTP investments No disk I/O bottleneck simultaneously load & query Native DB-aware clustering on low-cost x86 Linux nodes Built-in redundancy that also speeds up queries Automatic setup, optimization, and DB management Up to 90% space reduction using 10+ algorithms ü  50x – 1000x faster than traditional RDBMS ü  Scales from TB to PB with industry- standard hardware ü  Simple integration with existing ETL and BI solutions ü  SQL-99+ compliant ü  Ultimate deployment flexibility ü  Extended advanced analytics ü  24/7 Load & Query Confidential 10
  • 11. Taking IoT analytics to the next level – Integrated Machine Learning Native Machine Learning algorithms run in database (Vertica) •  K-means (anomalies) •  Linear Regression (risks, trends) •  Logistic Regression Train predictive analytics models in the datacenter, and easily run at the edge Utilizes the same hardware as the database itself •  Lower cost solution •  No transfer of data required •  Large data sets lead to more accurate models 11
  • 12. Taking IoT analytics to the next level – High Performance Messaging Vertica Streaming Adapter for Apache Kafka Kafka replaces custom data ingest solutions with a robust open-source implementation Enables distributed data pipelines for high throughput and low latency ingest into Vertica •  Time to insight reduced from hours to seconds (micro-batch loading) •  Easy handling of data bursts (10m messages per minute) 12
  • 13. Taking IoT analytics to the next level – In-database Sensor Data Analytics Powerful time series and window functions (gap filling, interpolation) for data quality management at the edge1 Live Aggregate Projections (personalized billing on demand) Log text analytics and pattern matching (SIEM – security, intrusion detection) Geospatial analytics (location based services, asset management) 13 1 HPE internal testing of Vertica on EL4000 shows it can: -  Repair 5.7 million readings per second -  Load, repair and analyze a reading every 282 nanoseconds
  • 14. www.hpe.com/events/bdc Big Data Conference 2016 Boston August 29- September 1
  • 15. page BUILDING AN IOT ARCHITECTURE FOR FAST + BIG DATA  DENNIS DUCKWORTH DIRECTOR OF PRODUCT MARKETING
  • 16. page© 2016 VoltDB VOLTDB DOESN’T MAKE THE APPS, WE MAKE THE APPS… 16 • Real-time intelligence and context for richer interactions • Allows unique decisions on each individual event or person • Analyze and act on real-time/streaming data • More efficient use of hardware • 100X faster than traditional transactional databases • World record performance in the cloud (YCSB) • Millisecond response times • Hundreds of thousands to millions of transactions per second • High-speed data ingestion • Simpler apps, easier to test and maintain • Easier to program with SQL + Java • Seamless ecosystem integration • Data is always consistent and correct, never lost Smarter Faster Simpler 1/10 of the Resources Needed   100X Traditional Transactional DB   100% Consistent, Correct  
  • 17. page© 2016 VoltDB Low  Complexity     Rich,  Smart     Value of Individual Data Item Value of Data Collection DataValue Data Warehouse Hadoop, etc.NoSQL Data in Motion Data at Rest Fast Data Big Data Feeds, Collectors CEP CEP + DB DataInteraction FAST DATA + BIG DATA
  • 18. page© 2016 VoltDB Streaming Analytics -  Filtering -  Windowing -  Aggregation -  Enrichment -  Correlations Deep Analytics -  Machine Learning -  Statistical correlations -  Multi-dimensional analysis -  Predictive/Prescriptive analytics Operational Interactions / Transactions -  Context-aware -  Personal -  Real-time + Big Data FAST DATA + BIG DATA Fast Data
  • 19. page© 2016 VoltDB CUSTOMERS USING VOLTDB FOR IOT TODAY •  Smart Meters (over 60 million meters under VoltDB management) •  Smart Energy GB •  Smart Metering in Japan (Shikoku and Hokkaido) •  Wearables •  Home Security •  Equipment Service Automation
  • 20. page© 2016 VoltDB EQUIPMENT SERVICE AUTOMATION: LEADING STORAGE EQUIPMENT VENDOR USING IOT
  • 21. page© 2016 VoltDB 21 #Simplify
  • 22. page© 2016 VoltDB Proven ü  Jepsen Tested Simpler ü  Fewer components and clusters needed ü  Easier to write, test and maintain applications Familiar ü  SQL and Java Glue Code Glue Code Zookeeper “DIY” STREAMING DATA INFRASTRUCTURE VS VOLTDB
  • 23. page© 2016 VoltDB EXAMPLE: LARGE TELCO IOT PLATFORM 23 Challenges: •  High volume and velocity of data from smart devices •  Complexity (multiple ingest points, apps, databases) •  Performance – need to automate action on inbound data at the velocity of the feeds Notes •  Applications have their own database •  Each database replicates to Cassandra and Hadoop •  In-memory grid used to maintain logic and publish ‘state’ back and forth •  Rules engine for intra-day data to trigger actions (e.g., ‘turn lights on’) •  PostgreSQL used for dimension data
  • 24. page© 2016 VoltDB BEFORE 24 AFTER Results ü  Simplified system architecture ü  Single ingest point for high-velocity feeds of inbound data ü  Faster time to value
  • 25. page© 2016 VoltDB BEFORE 25 OR POSSIBLY Results ü  Simplified system architecture ü  Single ingest point for high-velocity feeds of inbound data ü  Faster time to value
  • 28. page© 2016 VoltDB QUESTIONS? •  Use the chat window to type in your questions •  Download our ebook, Architecting for the Internet of Things (learn.voltdb.com/EbookIoT.html) •  Try VoltDB yourself Free trial of the Enterprise Edition: www.voltdb.com/Download •  Email us at: info@voltdb.com 28