Standards and Open Source for Big Data, Cloud, and IoT

Open Source and
Standards Activities for
Big Data, Cloud, and IoT
Caveat: This is a rough ﬁrst cut and will be revised extensively!
Friday, February 10, 17

Key Points on IoT Standards and Open Source - Initial Thoughts
• Standards will be necessary to ensure interoperability (e.g. data, commands,
networking) across heterogeneous IoT systems
• There are some emerging standards (e.g. MQTT, CoAP) but there are many gaps and
diverse group efforts that will have to be resolved
• Open source can make a major contribution but it is not playing a central role yet
comparable to the Apache Big Data software.

Outline of Presentation
• IoT Standards
• IoT Open Source
• Reference Links for Open Source and Standards for IoT, Cloud, and Big Data

IoT Standards

Fractured CPS Standards
From http://tinyurl.com/gv38c78

From http://www.slideshare.net/honbozhou/uniﬁed-middleware-for-internet-of-things
Internet of Things Standards Matrix

From https://www.iab.org/wp-content/IAB-uploads/2016/03/IAB_Semantic_Workshop_2016_ETRI.pdf
Framework for Uniﬁed Data Store from Korean ETRI

From http://www.cs.berkeley.edu/~culler/talks/Culler-CWSN.pptx
and http://postscapes.com/internet-of-things-protocols
Open Standards Reference Model

From http://www.slideshare.net/MichaelKoster/ietf91-ad-hoccoaplwm2mipso-4157527
An Internet of Things Standards Stack

From http://www.slideshare.net/OpenMobileAlliance/oma-lwm2m-workshop-michael-koster-ipso-alliance-objects
IPSO Alliance Smart Objects

From http://www.slideshare.net/michaeljohnkoster/iot-toolkit-and-the-smart-object-api-architecture-for-interoperability
IoT 2 and Smart Objects API

From http://www.slideshare.net/michaeljohnkoster/iot-toolkit-and-the-smart-object-api-architecture-for-interoperability
IoT 2.0 - Interoperability

From http://ontolog.cim3.net/ﬁle/work/OntologySummit2015/2015-04-13_14_OntologySummit2015_Symposium/Standard-for-IoT_WilliamMiller_2015-04-14.pdf
IEEE Standards

From http://www.slideshare.net/kamiWeb/the-web-of-things-enabling-the-physical-world-to-the-web?next_slideshow=1
Web of Things Basic Ingredients

From http://dms.konkuk.ac.kr/ProjectDsc_WoT
TwoViews of Web of Things M2M Service Platform

IoT Standards Maturity from IERC
From http://www.internet-of-things-research.eu/pdf/Building_the_Hyperconnected_Society_IERC_2015_Cluster_eBook_978-87-93237-98-8_P_Web.pdf

Sensor Web Enablement from OGC
From www.opengeospatial.org/ogc/markets-technologies/swe

SensorML from OGC
From http://www.opengeospatial.org/standards/sensorml
The primary focus of the Sensor Model Language (SensorML) is to provide a robust and
semantically-tied means of defining processes and processing components associated
with the measurement and post-measurement transformation of observations.This
includes sensors and actuators as well as computational processes applied pre- and post-
measurement.The main objective is to enable interoperability, first at the syntactic level
and later at the semantic level (by using ontologies and semantic mediation), so that
sensors and processes can be better understood by machines, utilized automatically in
complex workflows, and easily shared between intelligent sensor web nodes.

OPC Universal Architecture (UA)
From https://opcfoundation.org/about/opc-technologies/opc-ua/
OPC is the interoperability standard for the secure and reliable exchange of data in the industrial automation space
and in other industries. It is platform independent and ensures the seamless ﬂow of information among devices
from multiple vendors. The OPC Foundation is responsible for the development and maintenance of this standard.
With the introduction of service-oriented architectures in manufacturing systems came new challenges in security
and data modeling. The OPC Foundation developed the OPC UA speciﬁcations to address these needs and at the
same time provided a feature-rich technology open-platform architecture that was future-proof, scalable and
extensible.

Open Interconnect Consortium (OIC) Core Framework Spec
From http://openconnectivity.org/wp-content/uploads/2016/01/OIC_Speciﬁcation_Overview_201501131.pdf

OIC Core Framework Basic Operation
From http://openconnectivity.org/wp-content/uploads/2016/01/OIC_Speciﬁcation_Overview_201501131.pdf

From http://openconnectivity.org/
New Open Connectivity Foundation incorporating OIC
Billions of connected devices (devices, phones, computers and sensors) should be able to
communicate with one another regardless of manufacturer, operating system, chipset or physical
transport. The Open Connectivity Foundation (OCF) is creating a specification
and sponsoring an open source project to make this possible. OCF will unlock the massive
opportunity in the IoT market, accelerate industry innovation and help developers and companies
create solutions that map to a single open specification. OCF will help ensure secure
interoperability for consumers, business, and industry.
The OCF unifies the entirety of the former Open Interconnect Consortium (OIC) with leading
companies at all levels – silicon, software, platform, and finished-goods – dedicated to providing
this key interoperability element of an IoT solution. The OCF sponsors the IoTivity open source
project which includes a reference implementation of our specification available under the
Apache 2.0 license. The OCF also includes all the activities formerly sponsored by UPnP Forum.

From https://code.google.com/p/uniboard/wiki/Telnet_Server_implementation
uIP Protocol Stack for Networked Embedded Systems

From http://www.slideshare.net/MichaelKoster/ietf91-ad-hoccoaplwm2mipso-4157527
OMA Light Weight M2M Reference Architecture

From http://bytecontinnum.com/2015/08/rest-for-wot-with-coap/
Web Access to Devices using CoAP Proxy

From https://openwsn.atlassian.net/wiki/display/OW/Overview+Slides
CoAP Applications on OpenWSN from Berkeley

From https://openwsn.atlassian.net/wiki/display/OW/Overview+Slides
6LoWPAN to Internet Integration

From www.slideshare.net/asobimat/rpl-dodag
Routing Algorithm for Low Power and Lossy Networks (RPL)

From http://www.slideshare.net/BryanBoyd/mqtt-austin-api
MQTT support Publish-and-Subscribe Messaging

From http://www.slideshare.net/MichaelKoster/rest-ap-is-for-iot
MQTT Observer Connects REST Resource to MQTT Topic

Data Distribution Service (DDS) for Internet of Things
From http://blog.omg.org/2014/12/omgs-data-distribution-service-the-internet-of-things-fabric.htm

PPMP Proposed Communication Protocol Standard from Bosch
From http://www.bosch-presse.de/pressportal/de/en/ppmp-a-new-common-language-for-machines-65538.html

Interaction Flow Modeling Language (IFML)
From https://en.wikipedia.org/wiki/Interaction_Flow_Modeling_Language

OneM2M in Standardization Landscape
From http://www.slideshare.net/motive_alu/alcatel-lucent-motive-team-motivation-2013-onem2m-global-standards

Open Group IoT Working Group
From www.dmtf.org/sites/default/ﬁles/6 TOG! Chirs Ford! Open Paltform 3 Beijing 20150602_0.pdf

Industrial Internet Interoperability Coalition’s (IIIC) IIoT Landscape
From http://www.iiconsortium.org/pdf/IIC_I3C_Overview_Aug_2016.pdf
The Industrial Internet Interoperability Coalition (IIIC) is an organization formed by the Industrial Internet of Things (IIoT) Consortium

IIC’s Interoperability Cluster Structure
From http://www.iiconsortium.org/pdf/IIC_I3C_Overview_Aug_2016.pdf
The Industrial Internet Interoperability Coalition (IIIC) is an organization formed by the Industrial Internet of Things (IIoT) Consortium

W3C Semantic Sensor Network Ontology Top Level
From https://www.w3.org/2005/Incubator/ssn/ssnx/ssn
DUL = DOLCE+DnS Ultralite ontology (http://ontologydesignpatterns.org/wiki/Ontology:DOLCE+DnS_Ultralite)

IoT Open Source

Open Source for IoT
From http://postscapes.com/internet-of-things-software-guide
RIOT - RIOT OS is an operating system for Internet of Things (IoT) devices. It is based on a microkernel and
designed for: energy efficiency, hardware independent development, a high degree of modularity.
Thingsquare Mist -Thingsquare Mist brings resilient wireless mesh networking and true Internet-connectivity
to the Internet of Things.The Thingsquare Mist open source firmware is exceptionally lightweight, battle-
proven, and works with multiple microcontrollers with a range of radios.
Saphire OS - Sapphire is a full stack, open source, low power wireless platform from the hardware pin up to
the web and beyond. Sapphire combines flexible low cost hardware, a lightweight but powerful embedded
operating system, and network connectivity tools to help you connect anything to everything.
Nimbits - Nimbits is a collection of software for recording time series data to the cloud.When your systems
send new numeric, json, or xml data into a Nimbits Data Point using the REST web services, new values can
trigger cascading calculations, alerts, statistics and more. Use Nimbits Server as a backend to your
applications, generating charts and data visualisations with javascript using the public cloud, or download and
build your own infrastructure.
Thingspeak - ThingSpeak is an open source “Internet of Things” application and API to store and retrieve data
from things using HTTP over the Internet or via a Local Area Network.With ThingSpeak, you can create
sensor logging applications, location tracking applications, and a social network of things with status updates.
AllJoyn - An open source project which provides a universal software framework and core set of system
services that enable interoperability among connected products and software applications across
manufacturers to create dynamic proximal networks so that products – for the home, automotive and the
enterprise – can interact in new, exciting and useful ways that will engage and delight users.

Open Source for IoT continued
From http://postscapes.com/internet-of-things-software-guide
OpenAlerts - openAlerts is free, open source software to remotely monitor and control sensors over IP networks.With
openAlerts you can configure, control and monitor sensors from a web browser, receive e-mail and text message alerts, and
trigger control commands based on sensor conditions.
IoT Toolkit - The IoT Toolkit is an Open Source project to develop a set of tools for building multi-protocol Internet of
Things Gateways and Service gateways that enable horizontal co-operation between multiple different protocols and
cloud services.The project consists of the Smart Object API, gateway service, and related tools:
The Thing System -Your life and your house went from one computer to an Internet of things. From tablets to lightbulbs,
from sensors to media boxes, everybody gets their own Internet.Today, you have to fight your things.They don't talk to each
other, the apps don't work, it's a tower of babel. Our solution — the Thing System — is open source.We'll talk to anything,
you can hack the system, it has an open API.With the Thing System, you can finally take control of your things.
Nitrogen - Nitrogen is a platform for building connected devices and the applications that use them. Nitrogen provides the
authentication, authorization, event logging, device provisioning, discovery services, and real time message passing framework
so that you can focus on your device and application.All with a consistent development platform that leverages the ubiquity
of Javascript.
Argot - "Argot is a software toolkit that allows developers to quickly build the languages required to make the IoT a reality.
It uses the concept of a compact extensible metadata dictionary that can be embedded on the smallest of devices."
dat - dat is a new initiative that seeks to increase the traction of the open data movement by providing better tools for
collaboration:
• automatic sync and updates of entire data sets (or subsets)
• data sets can be very large (billions of items) or updated frequently (real time data)
• sync and transformation plugin API to connect dat to any existing database or format
• built with automated + decentralized workflows in mind

IoTivity Open Source Framework from OIC
From https://www.iotivity.org/documentation/architecture-overview

Goals for IoTivity Open Source Framework from OIC
Common solution
Define a communication and interoperability solution across multiple product markets such
as Consumer, Enterprise, Industrial,Automotive, and Health, and across operating systems,
platforms, communication modes, transports and use cases.
Established protocols
Reuse existing and establish new common communication protocols for discovery and
connectivity across multiple transports.
Common approaches
Apply common approaches for security and identity.
Defined commonalities
Define common profiles, object models, and developer application programming interfaces
(APIs).
Interoperability
Promote device and application interoperability across markets and use cases.
Innovation opportunities
Provide opportunities for innovation and allow for differentiation.
Necessary connectivity
Connect everything from the smallest wearable to the largest smart car.

Building Blocks for IoTivity Open Source Framework from OIC
1. Discovery
IoTivity discovery supports multiple discovery mechanisms for devices and
resources in proximity and remotely.
2. Data transmission
IoTivity data transmission supports information exchange and control based
on a messaging and streaming model.
3. Data Management
IoTivity data management supports the collection, storage and analysis of data
from various resources.
4. Device management
IoTivity device management supports conﬁguration, provisioning and
diagnostics of devices.

Eclipse Foundation’s Open Source Projects for IoT
From http://iot.eclipse.org/projects

Eclipse Foundation’s Open Source Projects for IoT continued
From http://iot.eclipse.org/projects

Open Source IoT (OSIOT)
From http://www.networkworld.com/article/2224803/software/the-open-source-internet-of-things-has-some-big-aspirations.html

From http://tinyurl.com/zaxabvb
OpenIoT Architecture

Reference Links on Standards
and Open Source Software

Standardization-Related Groups and Consortia
• NIST Cloud, Big Data, and CPS Public Working Groups
http://www.nist.gov/itl/cloud/ and http://bigdatawg.nist.gov and http://www.cpspwg.org/
• Industrial Internet Consortium and Cloud Standards Customer Council and OMG DDS
http://www.iiconsortium.org/ and http:// www.cloud-council.org/ and http://portals.omg.org/dds/
• Open Fog Alliance
http://www.openfogconsortium.org/
• IETF (CoAP and 6LoWPAN)
http://coap.technology/ and https://en.wikipedia.org/wiki/6LoWPAN
• OASIS MQTT
https://www.oasis-open.org/committees/mqtt/charter.php
• ITU-T IoT Study Group + Big Data and Cloud Requirements and Capabilities
http://www.itu.int/en/ITU-T/studygroups/2013-2016/20/Pages/default.aspx
https://www.itu.int/rec/dologin_pub.asp?lang=e&id=T-REC-Y.3600-201511-I!!PDF-E&type=items
• ISO (Reference Architecture under development) and Big Data Standardizations
http://www.iso.org/iso/internet_of_things_report-jtc1.pdf
http://www.iso.org/iso/big_data_report-jtc1.pdf
• IEEE IoT
http://iot.ieee.org/
http://standards.ieee.org/develop/project/1451-99.html
• W3C Web of Things an Semantic Sensor Network
https://www.w3.org/WoT/
https://www.w3.org/2005/Incubator/ssn/wiki/Main_Page
• IoT Semantic Interoperability Workshop hosted by Internet Architecture Board
https://www.iab.org/activities/workshops/iotsi/

• Open Interconnect Consortium (OIC) with IoTivity open software
http://openconnectivity.org/wp-content/uploads/2016/01/OIC_Speciﬁcation_Overview_201501131.pdf
https://www.iotivity.org/
• New Open Connectivity Foundation (OCF) incorporating OIC software
http://openconnectivity.org
• OneM2M
http://www.onem2m.org/
• Open Mobile Alliance (LWM2M) and Light Weight M2M v1.0 Enabler Packages
http://openmobilealliance.org/about-oma/work-program/m2m-enablers/
http://technical.openmobilealliance.org/Technical/technical-information/release-program/current-releases/oma-lightweightm2m-v1-0
• Open Web Application Security Project (OWASP) IoT Projects
https://www.owasp.org/index.php/OWASP_Internet_of_Things_Project
• IoT European Research Cluster(IERC)
http://www.internet-of-things-research.eu
ETSI Internet of Things
http://www.etsi.org/technologies-clusters/technologies/internet-of-things
• Open Group IoT Working Group
http://www.opengroup.org/getinvolved/workgroups/iot
• Open Group IoT Platform 3.0, Open Data Format, Open Messaging Interface
https://www2.opengroup.org/ogsys/catalog/S152
https://www2.opengroup.org/ogsys/catalog/C14A
https://www2.opengroup.org/ogsys/catalog/C14B
Standardization-Related Groups and Consortia continued

• Fiware Technologies
http://www.europeanpioneers.eu/en/ﬁware-technologies.html
• Weightless for LPWAN
http://www.weightless.org/
• AllSeen Alliance (AllJoyN)
https://allseenalliance.org/framework
• Thread
http://www.threadgroup.org/
• Zigbee Alliance
http://www.zigbee.org/
• XMPP-IoT and Sensei IoT Semantic Web 3.0 Standard for IoT
http://www.xmpp-iot.org/ and http://www.sensei-iot.org/
• Extended Environment Markup Language (EEML)
http://www.eeml.org
• Internet of Things Consortium (IOTC) - Multivendor Discussion Group on IoT issues
http://iofthings.org/iotc/
• IoT Standards and Protocols List from Postscapes
http://www.postscapes.com/internet-of-things-protocols/
• Trans-Atlantic Modelling and Simulation for CPS Project
http://www.tams4cps.eu

• IPSO Alliance (Smart Objects)
http://www.ipso-alliance.org/
https://www.iab.org/wp-content/IAB-uploads/2016/03/ipso-paper.pdf
• IoT European Research Cluster(IERC)
http://www.internet-of-things-research.eu
• OGC SensorThings API, SensorML, and Sensor Web Enablement
http://www.opengeospatial.org/projects/groups/sensorthings
http://www.opengeospatial.org/standards/sensorml
www.opengeospatial.org/ogc/markets-technologies/swe
• WS02 IoT
http://wso2.com/iot
• Open Networking Users Group
https://opennetworkingusergroup.com/about/
• IoT-i
http://www.surrey.ac.uk/ics/research/internet-of-things/projects/completed/iot-i/
• Near Field Communications (NFC)
http://nearﬁeldcommunication.org/technology.html
• Wi-Fi Alliance
http://www.wi-ﬁ.org/who-we-are
• ITU Joint Coordination Activity on Internet of Things and Smart Cities and Communities(JCA-IoT and SC&C)
http://www.itu.int/en/ITU-T/jca/iot/Pages/default.aspx

• Bluetooth, Bluetooth Gateway, and Bluetooth Low Energy
https://www.bluetooth.com/
https://www.bluetooth.com/news/pressreleases/2016/02/10/bluetooth-sig-announces-architecture-to-connect-billions-of-devices-to-the-iot
https://www.bluetooth.com/what-is-bluetooth-technology/how-it-works/low-energy
• Industrie du Futur from France
http://tinyurl.com/zo8mt6s
• Industrial Value Chain Initiative (IVI) from Japan
https://www.iv-i.org/en/whats.html
• Industrial Data Space (IDS) from Germany
www.industrialdataspace.org/en/
• Alliance for the Internet of Things Innovation (AIOTI) from Europe
http://www.aioti.org/
• GlobalPlatform Root of Trust and Requirements for IoT
https://www.globalplatform.org/mediapressview.asp?id=1269
• Asia IoT Association (AIoTA)from Taiwan
http://www.businesswire.com/news/home/20160417005088/en/AIoTA-Established-Partnership-IIC-Promote-%E2%80%9CInternet-Things%E2%80%9D
•

• Open Source vs Open Standards
blogs.cisco.com/news/open-standards-open-source-open-loop
• Enhanced Apache Big Data Stack and Apache CloudStack
http://www.slideshare.net/Foxsden/hpcabds-the-case-for-an-integrating-apache-big-data-stack-with-hpc
• OpenStack Cloud
https://www.openstack.org/
• Open Nebula Cloud
http://opennebula.org/
• Open Cloud Computing Interface (OCCI)
http://occi-wg.org/
• Open Source IoT
http://osiot.org/projects/
• Cloud Foundry
http://docs.cloudfoundry.org/
• Docker Containers and Kubernetes container management and also combined use
https://www.docker.com/what-docker
https://www.digitalocean.com/community/tutorials/an-introduction-to-kubernetes
http://www.infoq.com/articles/scaling-docker-with-kubernetes
• Contiki Open Source OS for IoT
http://www.contiki-os.org/
• IoT to Web Open Source Approaches
http://www.slideshare.net/CharalamposDoukas/enabling-iot-devices-to-talk-web-the-community-approach
Open Source Groups Related to Cloud, Big Data, and IoT

• Open.Sen.Se
http://open.sen.se/
• DeviceHive Iot Toolkit and Cloud
http://devicehive.com/
• 67 Open Source Tools for IoT
http://techbeacon.com/67-open-source-tools-resources-iot
• 50 Open Source Tools for Big Data
http://www.datamation.com/data-center/50-top-open-source-tools-for-big-data-1.html
• 51 Open Source Tools for IoT
www.datamation.com/mobile-wireless/51-open-source-tools-for-the-internet-of-things-1.html
• IoTGo
http://iotgo.iteadstudio.com/about
• Kaa IoT Project
http://www.kaaproject.org/overview/
• Open Container Initiative
https://www.opencontainers.org/
• Apache Arrow Cross-system Columnar Storage
https://arrow.apache.org/
Zetta
http://www.zettajs.org/

• Open Source IoT (OSIoT)
http://osiot.org/about
• Open Daylight Project for Software Deﬁned Networking
https://www.opendaylight.org/
• Open Networking Foundation (ONF) and OpenFlow
https://www.opennetworking.org/about/onf-overview
https://www.opennetworking.org/sdn-resources/openﬂow
• Robot Operating System
http://www.ros.org/
• SensorWare
http://sensorware.sourceforge.net/
• OpenRemote Middleware for IoT
http://www.openremote.com/
• Open Source Tools from Postscapes
http://www.postscapes.com/internet-of-things-award/open-source/

• OpenIoT and OpenIoT Summit
www.openiot.eu
http://events.linuxfoundation.org/events/openiot-summit-europe
• Eclipse Mosquitto
https://mosquitto.org/
• Eclipse Kura, Paho, Ponte, Concierge, Mihini, and Mihini/M3DA
http://wiki.eclipse.org/Kura
https://eclipse.org/paho/
http://www.eclipse.org/ponte/
http://www.eclipse.org/concierge/
https://wiki.eclipse.org/Mihini
https://wiki.eclipse.org/Mihini/M3DA_Speciﬁcation

• Indian IoT Center of Excellence
www.nasscom.in/initiatives/coe-iot
• NIST Cyber-Physical Systems Working Group
http://www.nist.gov/cps/
• NSF Cyber-Physiscal Systems Program
http://www.nsf.gov/funding/pgm_summ.jsp?pims_id=503286
• Korean IoT Master Plan
http://www.kiot.or.kr/uploadFiles/board/KOREA-IoT%20Master%20Plan.pdf
• “Innovation in Manufacturing Industry 3.0” from Korea
https://www.rvo.nl/sites/default/ﬁles/2015/10/Smart%20Industry%20in%20Korea.pdf
• Singapore Smart Nation Vision
https://www.ida.gov.sg/Tech-Scene-News/Smart-Nation-Vision
Governmental IoT and CPS Initiatives

Standards and Open Source for Big Data, Cloud, and IoT

More Related Content

What's hot

Similar to Standards and Open Source for Big Data, Cloud, and IoT

Recently uploaded

Standards and Open Source for Big Data, Cloud, and IoT