SlideShare a Scribd company logo
1 of 21
BIG DATA COMES IN SMALL PACKAGES
How the Internet of Things Will Change Big Data’s Future
Daniel Austin
GRIN Technologies, Inc.
The Connected Life Company
daniel.austin@grintech.net
NoSQL Now!
August 21st, 2014
V1.1
ABOUT GRIN TECHNOLOGIES, INC.
• Founded July 4th 2014
• “The Connected Life Company”
• Developing Systemsware at the Intersection of Big Data and the Internet of Things
• Smart People Working Hard to Solve Real Problems
• Coming in Q3 2015: The Connected Life Server ™
• A Platform for Connecting People, Places, and Things
Soft launching today at NoSQL Now!
FOUR BIG IDEAS FOR TODAY’S TALK
1. No “Internet of Things”, only disjoint Networks of Things
2. The IoT is an “iceberg” Big Data problem
3. Things are dumb, systems are smart
4. The “Witnesses” principle
WHY THERE WILL BE NO “INTERNET OF THINGS”
• No clients; no servers
• No network that connects them all
• No protocols that make sense
• Intermittent, Transient, Low Value, Connectionless
Many of Our Current Assumptions About the Internet Simply Don’t Apply!
INSTEAD, DISJOINT NETWORKS OF THINGS
• Disjoint – for Security and Privacy
• Functional and Context-Specific
• Mesh-based Peering Architectures
Peer 1
Peer 2
Peer3
Peer 4
Peer 1
Peer 2
Peer3
Peer 4
Public
Internet
Gateway Gateway
LAYER 8 HYPOTHESIS
• You are a Node on the Internet!
• The Internet Connects People, Not
Computers
• Humans are Machines that Turn
Data into Information
THE CONVERGENCE OF THE IOT AND BIG DATA
It’s not an accident that these
technologies are coming together at
the same time; the IoT wasn’t possible
before we had solutions to Big Data
problems.
Things
Big Data
Big Metadata
METADATA EXPLOSION
• “Big Metadata” is a bigger problem
than Big Data
• Austin’s Law: “The Amount of Data
to be Crunched Will Always Exceed
the Computing Power Available.”
• What are these companies’ data
retention policies?
ARE YOU A BIG DATA PROBLEM?
• Each person will generate roughly 25 petabytes of data over the course of a lifetime
• Users have little control over collection and storage
• Email, documents, receipts, bills (!), your car, music, books…
• Pervasive computing multiplies the problem
• Majority of data valueless out of context
• Security & privacy risks may outweigh the benefits ?!
LET’S TALK LIGHT BULBS
• Invented in 1879 by Edison and Swan
• Many others before had failed
• One of humanity’s most important inventions
• More than 400 distinct types are manufactured
• Streets, Airplanes, Neon (Still 82%
Incandescent!)
• The Eiffel Tower uses 20,376 light bulbs
• Many Lighting Systems Are Extremely Complex!
• Not a simple on/off state machine
• Critical for many life-and-death situations
• Unsustainable and unmanageable at scale
• Arrogant, disposable “dumb” design
• 2013: First light bulb on the Internet
IMAGINING THE IOLB
What If…
Every light bulb was connected to the IoT?
What Would the Architecture Look Like?
Could We Manage the Data Usefully?
Could We Build it?
LIGHT BULBS ARE DUMB; SYSTEMS ARE SMART
• We can’t design the IoLB by only changing the light bulbs; it’s a system
• It’s necessary for the system to evolve, not just the bulbs
• Bulbs will change to meet new conditions, become smarter
• Sockets, power lines, power generators and coal mines
• Every part of the system will evolve at a different rate
• While building the IoT, we will need to consider how to build smart systems
that help ordinary users, requiring compromise (and patience)
SYSTEMS THINKING AND LIGHT BULB ARCHITECTURE
WHICH COMES FIRST? THE SOCKET OR THE BULB?
• Problem: Do we want smart light bulbs or smart sockets?
• Light bulbs are easy to change, sockets are not
• But in an ideal world, most of the architectural ‘smarts’ of the IoLB
would be in the socket
• This is a classic architectural trade-off
• It’s too expensive to upgrade every part of the
system at the same time!
• Our light bulbs will be smarter than their sockets
• For some time; this will have wider implications
• For the IoLB (and IoT)
THE IOLB AND BIG DATA
12x10^9 light bulbs x (365 state changes/day) x 2 x 22 bytes = Big Data
A more realistic estimate would be 3 orders of magnitude larger! Plus the history, maintenance, etc.
SECURITY AND PRIVACY
ON THE IOT
• Security Is Protection from Harm
• Privacy is Filtering Data Based on Context
• The Separation of the Self from the Group
• Persona v. Identity
THE “WITNESSES” PRINCIPLE
• Cellphones are “things”, so are security cameras…
• “When There’s a Witness to Every Act…”
By 2020 everyone, everything and
everywhere will be connected in real
time. More than 50 billion connected
devices will be used in the
Networked Society.
Source: http://www.ericsson.com/thinkingahead/networked_society
IN A WORLD OF
TEN BILLION PEOPLE
AND THEIR THINGS…
• Everyone will be connected – to each other
• Privacy will disappear
• Security (and civility) will increase
• Witnesses are a good thing ™
A SPECIES AND ITS DATA: THE LONG VIEW
• We can’t build to scale exponentially.
Period.
• We are all part of the network
• The purpose of evolution is
computation
Will humanity merge with it’s data?
The Age of Big
Metadata
The Age of
Big Data
THANKS!
“When everyone’s life is connected, that’s when the
Singularity will happen.”
Daniel Austin
GRIN Technologies, Inc.
The Connected Life Company
daniel.austin@grintech.net
http://www.grintech.net
@daniel_b_Austin
@GRINTechInc

More Related Content

What's hot

Energy and The Internet of Things
Energy and The Internet of ThingsEnergy and The Internet of Things
Energy and The Internet of ThingsEenovators Limited
 
Living Online: Anytime, Anywhere, Any Device- NFAIS 2012
Living Online: Anytime, Anywhere, Any Device- NFAIS 2012Living Online: Anytime, Anywhere, Any Device- NFAIS 2012
Living Online: Anytime, Anywhere, Any Device- NFAIS 2012hratner
 
The Digital Revolution Keeps on Giving (and Takig)
The Digital Revolution Keeps on Giving (and Takig)The Digital Revolution Keeps on Giving (and Takig)
The Digital Revolution Keeps on Giving (and Takig)Robin Raskin
 
Designing for an internet of things
Designing for an internet of thingsDesigning for an internet of things
Designing for an internet of thingsTimo Arnall
 
Internet of things
Internet of thingsInternet of things
Internet of thingsAnnie Thomas
 
Location: Trends, Ethics & Diversity
Location: Trends, Ethics & DiversityLocation: Trends, Ethics & Diversity
Location: Trends, Ethics & DiversityPLACE
 
Alexandra Deschamps-Sonsino - The next 5 years of the internet of things
Alexandra Deschamps-Sonsino - The next 5 years of the internet of thingsAlexandra Deschamps-Sonsino - The next 5 years of the internet of things
Alexandra Deschamps-Sonsino - The next 5 years of the internet of thingsMobile Monday Amsterdam
 
Design beyond the glowing rectangle - EuroIA2010
Design beyond the glowing rectangle - EuroIA2010Design beyond the glowing rectangle - EuroIA2010
Design beyond the glowing rectangle - EuroIA2010Claire Rowland
 
A Quick Guide for Internet of Things - Apptunix
A Quick Guide for Internet of Things - ApptunixA Quick Guide for Internet of Things - Apptunix
A Quick Guide for Internet of Things - ApptunixApptunix
 

What's hot (20)

Energy and The Internet of Things
Energy and The Internet of ThingsEnergy and The Internet of Things
Energy and The Internet of Things
 
Widetag @ QU-ID
Widetag @ QU-IDWidetag @ QU-ID
Widetag @ QU-ID
 
Living Online: Anytime, Anywhere, Any Device- NFAIS 2012
Living Online: Anytime, Anywhere, Any Device- NFAIS 2012Living Online: Anytime, Anywhere, Any Device- NFAIS 2012
Living Online: Anytime, Anywhere, Any Device- NFAIS 2012
 
Io t an insight
Io t an insightIo t an insight
Io t an insight
 
Ete 107
Ete 107Ete 107
Ete 107
 
The Digital Revolution Keeps on Giving (and Takig)
The Digital Revolution Keeps on Giving (and Takig)The Digital Revolution Keeps on Giving (and Takig)
The Digital Revolution Keeps on Giving (and Takig)
 
Computer
ComputerComputer
Computer
 
Designing for an internet of things
Designing for an internet of thingsDesigning for an internet of things
Designing for an internet of things
 
Internet of things
Internet of thingsInternet of things
Internet of things
 
Technology Then And Now
Technology Then And NowTechnology Then And Now
Technology Then And Now
 
Sss14green Iotic Labs
Sss14green Iotic LabsSss14green Iotic Labs
Sss14green Iotic Labs
 
Location: Trends, Ethics & Diversity
Location: Trends, Ethics & DiversityLocation: Trends, Ethics & Diversity
Location: Trends, Ethics & Diversity
 
Iot chap i
Iot chap iIot chap i
Iot chap i
 
Alexandra Deschamps-Sonsino - The next 5 years of the internet of things
Alexandra Deschamps-Sonsino - The next 5 years of the internet of thingsAlexandra Deschamps-Sonsino - The next 5 years of the internet of things
Alexandra Deschamps-Sonsino - The next 5 years of the internet of things
 
Social impact of computers
Social impact of computersSocial impact of computers
Social impact of computers
 
Design beyond the glowing rectangle - EuroIA2010
Design beyond the glowing rectangle - EuroIA2010Design beyond the glowing rectangle - EuroIA2010
Design beyond the glowing rectangle - EuroIA2010
 
Designing chocolate, not aspirin
Designing chocolate, not aspirinDesigning chocolate, not aspirin
Designing chocolate, not aspirin
 
A Quick Guide for Internet of Things - Apptunix
A Quick Guide for Internet of Things - ApptunixA Quick Guide for Internet of Things - Apptunix
A Quick Guide for Internet of Things - Apptunix
 
The road is wider than long
The road is wider than longThe road is wider than long
The road is wider than long
 
Shubham hatzade
Shubham hatzadeShubham hatzade
Shubham hatzade
 

Viewers also liked

Next generation web protocols
Next generation web protocolsNext generation web protocols
Next generation web protocolsDaniel Austin
 
Web Performance BootCamp 2013
Web Performance BootCamp 2013Web Performance BootCamp 2013
Web Performance BootCamp 2013Daniel Austin
 
Performance: How Fast is Fast Enough?
Performance: How Fast is Fast Enough?Performance: How Fast is Fast Enough?
Performance: How Fast is Fast Enough?Daniel Austin
 
Big Data and the Future of Money 2014
Big Data and the Future of Money 2014Big Data and the Future of Money 2014
Big Data and the Future of Money 2014Daniel Austin
 
JavaOne 2013 CON7370: Java Interprocess Communication Challenges in Low-Laten...
JavaOne 2013 CON7370: Java Interprocess Communication Challenges in Low-Laten...JavaOne 2013 CON7370: Java Interprocess Communication Challenges in Low-Laten...
JavaOne 2013 CON7370: Java Interprocess Communication Challenges in Low-Laten...0xdaryl
 
Always Offline: Delay-Tolerant Networking for the Internet of Things
Always Offline: Delay-Tolerant Networking for the Internet of ThingsAlways Offline: Delay-Tolerant Networking for the Internet of Things
Always Offline: Delay-Tolerant Networking for the Internet of ThingsDaniel Austin
 

Viewers also liked (6)

Next generation web protocols
Next generation web protocolsNext generation web protocols
Next generation web protocols
 
Web Performance BootCamp 2013
Web Performance BootCamp 2013Web Performance BootCamp 2013
Web Performance BootCamp 2013
 
Performance: How Fast is Fast Enough?
Performance: How Fast is Fast Enough?Performance: How Fast is Fast Enough?
Performance: How Fast is Fast Enough?
 
Big Data and the Future of Money 2014
Big Data and the Future of Money 2014Big Data and the Future of Money 2014
Big Data and the Future of Money 2014
 
JavaOne 2013 CON7370: Java Interprocess Communication Challenges in Low-Laten...
JavaOne 2013 CON7370: Java Interprocess Communication Challenges in Low-Laten...JavaOne 2013 CON7370: Java Interprocess Communication Challenges in Low-Laten...
JavaOne 2013 CON7370: Java Interprocess Communication Challenges in Low-Laten...
 
Always Offline: Delay-Tolerant Networking for the Internet of Things
Always Offline: Delay-Tolerant Networking for the Internet of ThingsAlways Offline: Delay-Tolerant Networking for the Internet of Things
Always Offline: Delay-Tolerant Networking for the Internet of Things
 

Similar to BIG DATA AND IOT WILL MERGE

Recent developments in data analytics and big data
Recent developments in data analytics and big dataRecent developments in data analytics and big data
Recent developments in data analytics and big dataDez Blanchfield
 
Speaking at John Carrol University on the Internet of Things
Speaking at John Carrol University on the Internet of ThingsSpeaking at John Carrol University on the Internet of Things
Speaking at John Carrol University on the Internet of ThingsJustin Grammens
 
Internet of Things in Logistics
Internet of Things in LogisticsInternet of Things in Logistics
Internet of Things in LogisticsJeff Risley
 
Internet of things and nanothings workshop may 2014
Internet of things and nanothings workshop may 2014Internet of things and nanothings workshop may 2014
Internet of things and nanothings workshop may 2014Marios Kyriazis
 
Some thoughts on IoT, HKNOG 4.0
Some thoughts on IoT, HKNOG 4.0Some thoughts on IoT, HKNOG 4.0
Some thoughts on IoT, HKNOG 4.0APNIC
 
Internet of Things - IoT
Internet of Things - IoTInternet of Things - IoT
Internet of Things - IoTFarjad Noor
 
What hope for privacy in an IoT world?
What hope for privacy in an IoT world? What hope for privacy in an IoT world?
What hope for privacy in an IoT world? kotahinet
 
SGNOG 5: Some thoughts on IoT
SGNOG 5: Some thoughts on IoTSGNOG 5: Some thoughts on IoT
SGNOG 5: Some thoughts on IoTAPNIC
 
Internet of Things, Connected Infrastructure & The Modern Supply Chain
Internet of Things, Connected Infrastructure & The Modern Supply ChainInternet of Things, Connected Infrastructure & The Modern Supply Chain
Internet of Things, Connected Infrastructure & The Modern Supply ChainJeff Risley
 
AusNOG 2017: Some thoughts on IoT
AusNOG 2017: Some thoughts on IoTAusNOG 2017: Some thoughts on IoT
AusNOG 2017: Some thoughts on IoTAPNIC
 
Internet of things
Internet of thingsInternet of things
Internet of thingsSanoj Kumar
 
IoT Development - Opportunities and Challenges
IoT Development - Opportunities and ChallengesIoT Development - Opportunities and Challenges
IoT Development - Opportunities and ChallengesAsim Rais Siddiqui
 
IOT Internet of things New Version 2017
IOT Internet of things New Version 2017IOT Internet of things New Version 2017
IOT Internet of things New Version 2017Ajith Kumar Ravi
 
Internet of Things: Its Applications Future and Problems
Internet of Things: Its Applications Future and ProblemsInternet of Things: Its Applications Future and Problems
Internet of Things: Its Applications Future and ProblemsRiten Debnath
 

Similar to BIG DATA AND IOT WILL MERGE (20)

Recent developments in data analytics and big data
Recent developments in data analytics and big dataRecent developments in data analytics and big data
Recent developments in data analytics and big data
 
Internet of things
Internet of thingsInternet of things
Internet of things
 
Internet of things
Internet of thingsInternet of things
Internet of things
 
Speaking at John Carrol University on the Internet of Things
Speaking at John Carrol University on the Internet of ThingsSpeaking at John Carrol University on the Internet of Things
Speaking at John Carrol University on the Internet of Things
 
Internet of Things in Logistics
Internet of Things in LogisticsInternet of Things in Logistics
Internet of Things in Logistics
 
Internet of things and nanothings workshop may 2014
Internet of things and nanothings workshop may 2014Internet of things and nanothings workshop may 2014
Internet of things and nanothings workshop may 2014
 
The Dawn of a new era: Internet of Things
The Dawn of a new era: Internet of ThingsThe Dawn of a new era: Internet of Things
The Dawn of a new era: Internet of Things
 
New technology
New technologyNew technology
New technology
 
Some thoughts on IoT, HKNOG 4.0
Some thoughts on IoT, HKNOG 4.0Some thoughts on IoT, HKNOG 4.0
Some thoughts on IoT, HKNOG 4.0
 
IOT.pptx
IOT.pptxIOT.pptx
IOT.pptx
 
What is IoT?
What is IoT? What is IoT?
What is IoT?
 
Internet of Things - IoT
Internet of Things - IoTInternet of Things - IoT
Internet of Things - IoT
 
What hope for privacy in an IoT world?
What hope for privacy in an IoT world? What hope for privacy in an IoT world?
What hope for privacy in an IoT world?
 
SGNOG 5: Some thoughts on IoT
SGNOG 5: Some thoughts on IoTSGNOG 5: Some thoughts on IoT
SGNOG 5: Some thoughts on IoT
 
Internet of Things, Connected Infrastructure & The Modern Supply Chain
Internet of Things, Connected Infrastructure & The Modern Supply ChainInternet of Things, Connected Infrastructure & The Modern Supply Chain
Internet of Things, Connected Infrastructure & The Modern Supply Chain
 
AusNOG 2017: Some thoughts on IoT
AusNOG 2017: Some thoughts on IoTAusNOG 2017: Some thoughts on IoT
AusNOG 2017: Some thoughts on IoT
 
Internet of things
Internet of thingsInternet of things
Internet of things
 
IoT Development - Opportunities and Challenges
IoT Development - Opportunities and ChallengesIoT Development - Opportunities and Challenges
IoT Development - Opportunities and Challenges
 
IOT Internet of things New Version 2017
IOT Internet of things New Version 2017IOT Internet of things New Version 2017
IOT Internet of things New Version 2017
 
Internet of Things: Its Applications Future and Problems
Internet of Things: Its Applications Future and ProblemsInternet of Things: Its Applications Future and Problems
Internet of Things: Its Applications Future and Problems
 

More from Daniel Austin

Designing Delay-tolerant Data Services for the Network of Things
Designing Delay-tolerant Data Services for the Network of ThingsDesigning Delay-tolerant Data Services for the Network of Things
Designing Delay-tolerant Data Services for the Network of ThingsDaniel Austin
 
Web Performance Bootcamp 2014
Web Performance Bootcamp 2014Web Performance Bootcamp 2014
Web Performance Bootcamp 2014Daniel Austin
 
HTML5, HTTP2, and You 1.1
HTML5, HTTP2, and You 1.1HTML5, HTTP2, and You 1.1
HTML5, HTTP2, and You 1.1Daniel Austin
 
Managing Performance Globally with MySQL
Managing Performance Globally with MySQLManaging Performance Globally with MySQL
Managing Performance Globally with MySQLDaniel Austin
 
Perspectives on the Evolution of HTML
Perspectives on the Evolution of HTMLPerspectives on the Evolution of HTML
Perspectives on the Evolution of HTMLDaniel Austin
 
The Fastest Possible Search Algorithm: Grover's Search and the World of Quant...
The Fastest Possible Search Algorithm: Grover's Search and the World of Quant...The Fastest Possible Search Algorithm: Grover's Search and the World of Quant...
The Fastest Possible Search Algorithm: Grover's Search and the World of Quant...Daniel Austin
 
Quantum Computing in a Nutshell: Grover's Search and the World of Quantum Com...
Quantum Computing in a Nutshell: Grover's Search and the World of Quantum Com...Quantum Computing in a Nutshell: Grover's Search and the World of Quantum Com...
Quantum Computing in a Nutshell: Grover's Search and the World of Quantum Com...Daniel Austin
 
Reconceiving the Web as a Distributed (NoSQL) Data System
Reconceiving the Web as a Distributed (NoSQL) Data SystemReconceiving the Web as a Distributed (NoSQL) Data System
Reconceiving the Web as a Distributed (NoSQL) Data SystemDaniel Austin
 
Big data and the Future of Money (World Big Data Congress 2013)
Big data and the Future of Money (World Big Data Congress 2013)Big data and the Future of Money (World Big Data Congress 2013)
Big data and the Future of Money (World Big Data Congress 2013)Daniel Austin
 
Big Data is a Big Scam Most of the Time! (MySQL Connect Keynote 2012)
Big Data is a Big Scam Most of the Time! (MySQL Connect Keynote 2012)Big Data is a Big Scam Most of the Time! (MySQL Connect Keynote 2012)
Big Data is a Big Scam Most of the Time! (MySQL Connect Keynote 2012)Daniel Austin
 
Performance analysisclass
Performance analysisclassPerformance analysisclass
Performance analysisclassDaniel Austin
 
Yes sql08 inmemorydb
Yes sql08 inmemorydbYes sql08 inmemorydb
Yes sql08 inmemorydbDaniel Austin
 
The Fastest Possible Search Algorithm
The Fastest Possible Search AlgorithmThe Fastest Possible Search Algorithm
The Fastest Possible Search AlgorithmDaniel Austin
 
A Global In-memory Data System for MySQL
A Global In-memory Data System for MySQLA Global In-memory Data System for MySQL
A Global In-memory Data System for MySQLDaniel Austin
 
Notes on a High-Performance JSON Protocol
Notes on a High-Performance JSON ProtocolNotes on a High-Performance JSON Protocol
Notes on a High-Performance JSON ProtocolDaniel Austin
 
Wrestling Large Data Volumes to the Ground
Wrestling Large Data Volumes to the GroundWrestling Large Data Volumes to the Ground
Wrestling Large Data Volumes to the GroundDaniel Austin
 

More from Daniel Austin (16)

Designing Delay-tolerant Data Services for the Network of Things
Designing Delay-tolerant Data Services for the Network of ThingsDesigning Delay-tolerant Data Services for the Network of Things
Designing Delay-tolerant Data Services for the Network of Things
 
Web Performance Bootcamp 2014
Web Performance Bootcamp 2014Web Performance Bootcamp 2014
Web Performance Bootcamp 2014
 
HTML5, HTTP2, and You 1.1
HTML5, HTTP2, and You 1.1HTML5, HTTP2, and You 1.1
HTML5, HTTP2, and You 1.1
 
Managing Performance Globally with MySQL
Managing Performance Globally with MySQLManaging Performance Globally with MySQL
Managing Performance Globally with MySQL
 
Perspectives on the Evolution of HTML
Perspectives on the Evolution of HTMLPerspectives on the Evolution of HTML
Perspectives on the Evolution of HTML
 
The Fastest Possible Search Algorithm: Grover's Search and the World of Quant...
The Fastest Possible Search Algorithm: Grover's Search and the World of Quant...The Fastest Possible Search Algorithm: Grover's Search and the World of Quant...
The Fastest Possible Search Algorithm: Grover's Search and the World of Quant...
 
Quantum Computing in a Nutshell: Grover's Search and the World of Quantum Com...
Quantum Computing in a Nutshell: Grover's Search and the World of Quantum Com...Quantum Computing in a Nutshell: Grover's Search and the World of Quantum Com...
Quantum Computing in a Nutshell: Grover's Search and the World of Quantum Com...
 
Reconceiving the Web as a Distributed (NoSQL) Data System
Reconceiving the Web as a Distributed (NoSQL) Data SystemReconceiving the Web as a Distributed (NoSQL) Data System
Reconceiving the Web as a Distributed (NoSQL) Data System
 
Big data and the Future of Money (World Big Data Congress 2013)
Big data and the Future of Money (World Big Data Congress 2013)Big data and the Future of Money (World Big Data Congress 2013)
Big data and the Future of Money (World Big Data Congress 2013)
 
Big Data is a Big Scam Most of the Time! (MySQL Connect Keynote 2012)
Big Data is a Big Scam Most of the Time! (MySQL Connect Keynote 2012)Big Data is a Big Scam Most of the Time! (MySQL Connect Keynote 2012)
Big Data is a Big Scam Most of the Time! (MySQL Connect Keynote 2012)
 
Performance analysisclass
Performance analysisclassPerformance analysisclass
Performance analysisclass
 
Yes sql08 inmemorydb
Yes sql08 inmemorydbYes sql08 inmemorydb
Yes sql08 inmemorydb
 
The Fastest Possible Search Algorithm
The Fastest Possible Search AlgorithmThe Fastest Possible Search Algorithm
The Fastest Possible Search Algorithm
 
A Global In-memory Data System for MySQL
A Global In-memory Data System for MySQLA Global In-memory Data System for MySQL
A Global In-memory Data System for MySQL
 
Notes on a High-Performance JSON Protocol
Notes on a High-Performance JSON ProtocolNotes on a High-Performance JSON Protocol
Notes on a High-Performance JSON Protocol
 
Wrestling Large Data Volumes to the Ground
Wrestling Large Data Volumes to the GroundWrestling Large Data Volumes to the Ground
Wrestling Large Data Volumes to the Ground
 

Recently uploaded

Call Girls Service Chandigarh Lucky ❤️ 7710465962 Independent Call Girls In C...
Call Girls Service Chandigarh Lucky ❤️ 7710465962 Independent Call Girls In C...Call Girls Service Chandigarh Lucky ❤️ 7710465962 Independent Call Girls In C...
Call Girls Service Chandigarh Lucky ❤️ 7710465962 Independent Call Girls In C...Sheetaleventcompany
 
₹5.5k {Cash Payment}New Friends Colony Call Girls In [Delhi NIHARIKA] 🔝|97111...
₹5.5k {Cash Payment}New Friends Colony Call Girls In [Delhi NIHARIKA] 🔝|97111...₹5.5k {Cash Payment}New Friends Colony Call Girls In [Delhi NIHARIKA] 🔝|97111...
₹5.5k {Cash Payment}New Friends Colony Call Girls In [Delhi NIHARIKA] 🔝|97111...Diya Sharma
 
'Future Evolution of the Internet' delivered by Geoff Huston at Everything Op...
'Future Evolution of the Internet' delivered by Geoff Huston at Everything Op...'Future Evolution of the Internet' delivered by Geoff Huston at Everything Op...
'Future Evolution of the Internet' delivered by Geoff Huston at Everything Op...APNIC
 
AlbaniaDreamin24 - How to easily use an API with Flows
AlbaniaDreamin24 - How to easily use an API with FlowsAlbaniaDreamin24 - How to easily use an API with Flows
AlbaniaDreamin24 - How to easily use an API with FlowsThierry TROUIN ☁
 
VIP Kolkata Call Girls Salt Lake 8250192130 Available With Room
VIP Kolkata Call Girls Salt Lake 8250192130 Available With RoomVIP Kolkata Call Girls Salt Lake 8250192130 Available With Room
VIP Kolkata Call Girls Salt Lake 8250192130 Available With Roomgirls4nights
 
Networking in the Penumbra presented by Geoff Huston at NZNOG
Networking in the Penumbra presented by Geoff Huston at NZNOGNetworking in the Penumbra presented by Geoff Huston at NZNOG
Networking in the Penumbra presented by Geoff Huston at NZNOGAPNIC
 
Call Girls In Sukhdev Vihar Delhi 💯Call Us 🔝8264348440🔝
Call Girls In Sukhdev Vihar Delhi 💯Call Us 🔝8264348440🔝Call Girls In Sukhdev Vihar Delhi 💯Call Us 🔝8264348440🔝
Call Girls In Sukhdev Vihar Delhi 💯Call Us 🔝8264348440🔝soniya singh
 
FULL ENJOY Call Girls In Mayur Vihar Delhi Contact Us 8377087607
FULL ENJOY Call Girls In Mayur Vihar Delhi Contact Us 8377087607FULL ENJOY Call Girls In Mayur Vihar Delhi Contact Us 8377087607
FULL ENJOY Call Girls In Mayur Vihar Delhi Contact Us 8377087607dollysharma2066
 
Call Girls Dubai Prolapsed O525547819 Call Girls In Dubai Princes$
Call Girls Dubai Prolapsed O525547819 Call Girls In Dubai Princes$Call Girls Dubai Prolapsed O525547819 Call Girls In Dubai Princes$
Call Girls Dubai Prolapsed O525547819 Call Girls In Dubai Princes$kojalkojal131
 
VIP 7001035870 Find & Meet Hyderabad Call Girls Dilsukhnagar high-profile Cal...
VIP 7001035870 Find & Meet Hyderabad Call Girls Dilsukhnagar high-profile Cal...VIP 7001035870 Find & Meet Hyderabad Call Girls Dilsukhnagar high-profile Cal...
VIP 7001035870 Find & Meet Hyderabad Call Girls Dilsukhnagar high-profile Cal...aditipandeya
 
Low Rate Young Call Girls in Sector 63 Mamura Noida ✔️☆9289244007✔️☆ Female E...
Low Rate Young Call Girls in Sector 63 Mamura Noida ✔️☆9289244007✔️☆ Female E...Low Rate Young Call Girls in Sector 63 Mamura Noida ✔️☆9289244007✔️☆ Female E...
Low Rate Young Call Girls in Sector 63 Mamura Noida ✔️☆9289244007✔️☆ Female E...SofiyaSharma5
 
How is AI changing journalism? (v. April 2024)
How is AI changing journalism? (v. April 2024)How is AI changing journalism? (v. April 2024)
How is AI changing journalism? (v. April 2024)Damian Radcliffe
 
Call Girls In Saket Delhi 💯Call Us 🔝8264348440🔝
Call Girls In Saket Delhi 💯Call Us 🔝8264348440🔝Call Girls In Saket Delhi 💯Call Us 🔝8264348440🔝
Call Girls In Saket Delhi 💯Call Us 🔝8264348440🔝soniya singh
 
Delhi Call Girls Rohini 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls Rohini 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip CallDelhi Call Girls Rohini 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls Rohini 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Callshivangimorya083
 
VIP Kolkata Call Girl Salt Lake 👉 8250192130 Available With Room
VIP Kolkata Call Girl Salt Lake 👉 8250192130  Available With RoomVIP Kolkata Call Girl Salt Lake 👉 8250192130  Available With Room
VIP Kolkata Call Girl Salt Lake 👉 8250192130 Available With Roomishabajaj13
 
Hot Service (+9316020077 ) Goa Call Girls Real Photos and Genuine Service
Hot Service (+9316020077 ) Goa  Call Girls Real Photos and Genuine ServiceHot Service (+9316020077 ) Goa  Call Girls Real Photos and Genuine Service
Hot Service (+9316020077 ) Goa Call Girls Real Photos and Genuine Servicesexy call girls service in goa
 
Radiant Call girls in Dubai O56338O268 Dubai Call girls
Radiant Call girls in Dubai O56338O268 Dubai Call girlsRadiant Call girls in Dubai O56338O268 Dubai Call girls
Radiant Call girls in Dubai O56338O268 Dubai Call girlsstephieert
 

Recently uploaded (20)

Call Girls Service Chandigarh Lucky ❤️ 7710465962 Independent Call Girls In C...
Call Girls Service Chandigarh Lucky ❤️ 7710465962 Independent Call Girls In C...Call Girls Service Chandigarh Lucky ❤️ 7710465962 Independent Call Girls In C...
Call Girls Service Chandigarh Lucky ❤️ 7710465962 Independent Call Girls In C...
 
₹5.5k {Cash Payment}New Friends Colony Call Girls In [Delhi NIHARIKA] 🔝|97111...
₹5.5k {Cash Payment}New Friends Colony Call Girls In [Delhi NIHARIKA] 🔝|97111...₹5.5k {Cash Payment}New Friends Colony Call Girls In [Delhi NIHARIKA] 🔝|97111...
₹5.5k {Cash Payment}New Friends Colony Call Girls In [Delhi NIHARIKA] 🔝|97111...
 
'Future Evolution of the Internet' delivered by Geoff Huston at Everything Op...
'Future Evolution of the Internet' delivered by Geoff Huston at Everything Op...'Future Evolution of the Internet' delivered by Geoff Huston at Everything Op...
'Future Evolution of the Internet' delivered by Geoff Huston at Everything Op...
 
Rohini Sector 26 Call Girls Delhi 9999965857 @Sabina Saikh No Advance
Rohini Sector 26 Call Girls Delhi 9999965857 @Sabina Saikh No AdvanceRohini Sector 26 Call Girls Delhi 9999965857 @Sabina Saikh No Advance
Rohini Sector 26 Call Girls Delhi 9999965857 @Sabina Saikh No Advance
 
AlbaniaDreamin24 - How to easily use an API with Flows
AlbaniaDreamin24 - How to easily use an API with FlowsAlbaniaDreamin24 - How to easily use an API with Flows
AlbaniaDreamin24 - How to easily use an API with Flows
 
VIP Kolkata Call Girls Salt Lake 8250192130 Available With Room
VIP Kolkata Call Girls Salt Lake 8250192130 Available With RoomVIP Kolkata Call Girls Salt Lake 8250192130 Available With Room
VIP Kolkata Call Girls Salt Lake 8250192130 Available With Room
 
Networking in the Penumbra presented by Geoff Huston at NZNOG
Networking in the Penumbra presented by Geoff Huston at NZNOGNetworking in the Penumbra presented by Geoff Huston at NZNOG
Networking in the Penumbra presented by Geoff Huston at NZNOG
 
Call Girls In South Ex 📱 9999965857 🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SERVICE
Call Girls In South Ex 📱  9999965857  🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SERVICECall Girls In South Ex 📱  9999965857  🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SERVICE
Call Girls In South Ex 📱 9999965857 🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SERVICE
 
Call Girls In Sukhdev Vihar Delhi 💯Call Us 🔝8264348440🔝
Call Girls In Sukhdev Vihar Delhi 💯Call Us 🔝8264348440🔝Call Girls In Sukhdev Vihar Delhi 💯Call Us 🔝8264348440🔝
Call Girls In Sukhdev Vihar Delhi 💯Call Us 🔝8264348440🔝
 
FULL ENJOY Call Girls In Mayur Vihar Delhi Contact Us 8377087607
FULL ENJOY Call Girls In Mayur Vihar Delhi Contact Us 8377087607FULL ENJOY Call Girls In Mayur Vihar Delhi Contact Us 8377087607
FULL ENJOY Call Girls In Mayur Vihar Delhi Contact Us 8377087607
 
Dwarka Sector 26 Call Girls | Delhi | 9999965857 🫦 Vanshika Verma More Our Se...
Dwarka Sector 26 Call Girls | Delhi | 9999965857 🫦 Vanshika Verma More Our Se...Dwarka Sector 26 Call Girls | Delhi | 9999965857 🫦 Vanshika Verma More Our Se...
Dwarka Sector 26 Call Girls | Delhi | 9999965857 🫦 Vanshika Verma More Our Se...
 
Call Girls Dubai Prolapsed O525547819 Call Girls In Dubai Princes$
Call Girls Dubai Prolapsed O525547819 Call Girls In Dubai Princes$Call Girls Dubai Prolapsed O525547819 Call Girls In Dubai Princes$
Call Girls Dubai Prolapsed O525547819 Call Girls In Dubai Princes$
 
VIP 7001035870 Find & Meet Hyderabad Call Girls Dilsukhnagar high-profile Cal...
VIP 7001035870 Find & Meet Hyderabad Call Girls Dilsukhnagar high-profile Cal...VIP 7001035870 Find & Meet Hyderabad Call Girls Dilsukhnagar high-profile Cal...
VIP 7001035870 Find & Meet Hyderabad Call Girls Dilsukhnagar high-profile Cal...
 
Low Rate Young Call Girls in Sector 63 Mamura Noida ✔️☆9289244007✔️☆ Female E...
Low Rate Young Call Girls in Sector 63 Mamura Noida ✔️☆9289244007✔️☆ Female E...Low Rate Young Call Girls in Sector 63 Mamura Noida ✔️☆9289244007✔️☆ Female E...
Low Rate Young Call Girls in Sector 63 Mamura Noida ✔️☆9289244007✔️☆ Female E...
 
How is AI changing journalism? (v. April 2024)
How is AI changing journalism? (v. April 2024)How is AI changing journalism? (v. April 2024)
How is AI changing journalism? (v. April 2024)
 
Call Girls In Saket Delhi 💯Call Us 🔝8264348440🔝
Call Girls In Saket Delhi 💯Call Us 🔝8264348440🔝Call Girls In Saket Delhi 💯Call Us 🔝8264348440🔝
Call Girls In Saket Delhi 💯Call Us 🔝8264348440🔝
 
Delhi Call Girls Rohini 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls Rohini 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip CallDelhi Call Girls Rohini 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls Rohini 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
 
VIP Kolkata Call Girl Salt Lake 👉 8250192130 Available With Room
VIP Kolkata Call Girl Salt Lake 👉 8250192130  Available With RoomVIP Kolkata Call Girl Salt Lake 👉 8250192130  Available With Room
VIP Kolkata Call Girl Salt Lake 👉 8250192130 Available With Room
 
Hot Service (+9316020077 ) Goa Call Girls Real Photos and Genuine Service
Hot Service (+9316020077 ) Goa  Call Girls Real Photos and Genuine ServiceHot Service (+9316020077 ) Goa  Call Girls Real Photos and Genuine Service
Hot Service (+9316020077 ) Goa Call Girls Real Photos and Genuine Service
 
Radiant Call girls in Dubai O56338O268 Dubai Call girls
Radiant Call girls in Dubai O56338O268 Dubai Call girlsRadiant Call girls in Dubai O56338O268 Dubai Call girls
Radiant Call girls in Dubai O56338O268 Dubai Call girls
 

BIG DATA AND IOT WILL MERGE

  • 1. BIG DATA COMES IN SMALL PACKAGES How the Internet of Things Will Change Big Data’s Future Daniel Austin GRIN Technologies, Inc. The Connected Life Company daniel.austin@grintech.net NoSQL Now! August 21st, 2014 V1.1
  • 2. ABOUT GRIN TECHNOLOGIES, INC. • Founded July 4th 2014 • “The Connected Life Company” • Developing Systemsware at the Intersection of Big Data and the Internet of Things • Smart People Working Hard to Solve Real Problems • Coming in Q3 2015: The Connected Life Server ™ • A Platform for Connecting People, Places, and Things Soft launching today at NoSQL Now!
  • 3. FOUR BIG IDEAS FOR TODAY’S TALK 1. No “Internet of Things”, only disjoint Networks of Things 2. The IoT is an “iceberg” Big Data problem 3. Things are dumb, systems are smart 4. The “Witnesses” principle
  • 4. WHY THERE WILL BE NO “INTERNET OF THINGS” • No clients; no servers • No network that connects them all • No protocols that make sense • Intermittent, Transient, Low Value, Connectionless Many of Our Current Assumptions About the Internet Simply Don’t Apply!
  • 5. INSTEAD, DISJOINT NETWORKS OF THINGS • Disjoint – for Security and Privacy • Functional and Context-Specific • Mesh-based Peering Architectures Peer 1 Peer 2 Peer3 Peer 4 Peer 1 Peer 2 Peer3 Peer 4 Public Internet Gateway Gateway
  • 6. LAYER 8 HYPOTHESIS • You are a Node on the Internet! • The Internet Connects People, Not Computers • Humans are Machines that Turn Data into Information
  • 7. THE CONVERGENCE OF THE IOT AND BIG DATA It’s not an accident that these technologies are coming together at the same time; the IoT wasn’t possible before we had solutions to Big Data problems. Things Big Data Big Metadata
  • 8. METADATA EXPLOSION • “Big Metadata” is a bigger problem than Big Data • Austin’s Law: “The Amount of Data to be Crunched Will Always Exceed the Computing Power Available.” • What are these companies’ data retention policies?
  • 9. ARE YOU A BIG DATA PROBLEM? • Each person will generate roughly 25 petabytes of data over the course of a lifetime • Users have little control over collection and storage • Email, documents, receipts, bills (!), your car, music, books… • Pervasive computing multiplies the problem • Majority of data valueless out of context • Security & privacy risks may outweigh the benefits ?!
  • 10. LET’S TALK LIGHT BULBS • Invented in 1879 by Edison and Swan • Many others before had failed • One of humanity’s most important inventions • More than 400 distinct types are manufactured • Streets, Airplanes, Neon (Still 82% Incandescent!) • The Eiffel Tower uses 20,376 light bulbs • Many Lighting Systems Are Extremely Complex! • Not a simple on/off state machine • Critical for many life-and-death situations • Unsustainable and unmanageable at scale • Arrogant, disposable “dumb” design • 2013: First light bulb on the Internet
  • 11. IMAGINING THE IOLB What If… Every light bulb was connected to the IoT? What Would the Architecture Look Like? Could We Manage the Data Usefully? Could We Build it?
  • 12. LIGHT BULBS ARE DUMB; SYSTEMS ARE SMART • We can’t design the IoLB by only changing the light bulbs; it’s a system • It’s necessary for the system to evolve, not just the bulbs • Bulbs will change to meet new conditions, become smarter • Sockets, power lines, power generators and coal mines • Every part of the system will evolve at a different rate • While building the IoT, we will need to consider how to build smart systems that help ordinary users, requiring compromise (and patience)
  • 13. SYSTEMS THINKING AND LIGHT BULB ARCHITECTURE
  • 14. WHICH COMES FIRST? THE SOCKET OR THE BULB? • Problem: Do we want smart light bulbs or smart sockets? • Light bulbs are easy to change, sockets are not • But in an ideal world, most of the architectural ‘smarts’ of the IoLB would be in the socket • This is a classic architectural trade-off • It’s too expensive to upgrade every part of the system at the same time! • Our light bulbs will be smarter than their sockets • For some time; this will have wider implications • For the IoLB (and IoT)
  • 15. THE IOLB AND BIG DATA 12x10^9 light bulbs x (365 state changes/day) x 2 x 22 bytes = Big Data A more realistic estimate would be 3 orders of magnitude larger! Plus the history, maintenance, etc.
  • 16. SECURITY AND PRIVACY ON THE IOT • Security Is Protection from Harm • Privacy is Filtering Data Based on Context • The Separation of the Self from the Group • Persona v. Identity
  • 17. THE “WITNESSES” PRINCIPLE • Cellphones are “things”, so are security cameras… • “When There’s a Witness to Every Act…”
  • 18. By 2020 everyone, everything and everywhere will be connected in real time. More than 50 billion connected devices will be used in the Networked Society. Source: http://www.ericsson.com/thinkingahead/networked_society
  • 19. IN A WORLD OF TEN BILLION PEOPLE AND THEIR THINGS… • Everyone will be connected – to each other • Privacy will disappear • Security (and civility) will increase • Witnesses are a good thing ™
  • 20. A SPECIES AND ITS DATA: THE LONG VIEW • We can’t build to scale exponentially. Period. • We are all part of the network • The purpose of evolution is computation Will humanity merge with it’s data? The Age of Big Metadata The Age of Big Data
  • 21. THANKS! “When everyone’s life is connected, that’s when the Singularity will happen.” Daniel Austin GRIN Technologies, Inc. The Connected Life Company daniel.austin@grintech.net http://www.grintech.net @daniel_b_Austin @GRINTechInc

Editor's Notes

  1. Kurt Vonnegut: No Cat, No Cradle – of course we call it a cat’s cradle!
  2. Health and school records