Research and Testbeds in Cyber-Physical Systems

Research and Testbeds in
Cyber-Physical Systems
Bob Marcus
Co-Chair NIST Big Data PWG
robert.marcus@et-strategies.com
Caveat: This is a rough ﬁrst cut and will be revised extensively!
Tuesday, October 18, 16

Key Points on CPS Research and Testbeds- Initial Thoughts
• IoT and CPS are an active area of research including topics such as Semantic
Interoperability, Cognitive Processing, IoT to Cloud Architectures, Security and Privacy
Support, and System of System Design Tools.
• This research is still at an early stage but will probably accelerate as the challenges of
large-scale CPS become increasingly visible
• Testbeds play a valuable role in evaluating new technology for CPS
• Collaborative research and testbed initiatives are necessary to address the many issues
in creating robust CPS systems (e.g. Smart City).

Outline of Research and Testbeds
• Research
• NSF Research
• Testbeds
• Industrial Internet Consortium Testbeds

Research

ICT 30 Research Projects from EU
From http://tinyurl.com/hvckvfn

Research Needs from IERC
From www.internet-of-things-research.eu/pdf/IERC_Cluster_Book_2014_Ch.3_SRIA_WEB.pdf

Research Needs from IERC continued
From www.internet-of-things-research.eu/pdf/IERC_Cluster_Book_2014_Ch.3_SRIA_WEB.pdf

Promising CPS Research Directions from Edward Lee
From citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.84.8011&rep=rep1&type=pdf
• Putting “time” into programming languages.
• Rethinking the OS/programming language split
• Rethink the hardware/software split
• Memory hierarchy with predictability.
• Memory management with predictability
• Predictable, controllable deep pipelines
• Predictable, controllable, understandable concurrency
• Concurrent components
• Networks with timing
• Computational dynamical systems theory

IoTCloud Architecure from Indiana University
From grids.ucs.indiana.edu/ptliupages/publications/intelligent_iot_cloud_controller.pdf
ROS = Robot Operating System
See ros.org

IoTCloud++ Architecure from Indiana University
From grids.ucs.indiana.edu/ptliupages/publications/intelligent_iot_cloud_controller.pdf
ROS = Robot Operating System
See ros.org

Intelligent Knowledge as a Service (iKaaS) Project
From http://www.slideshare.net/DrIngAbdurRahimBiswa/internet-of-things-iot-is-a-king-big-data-is-a-queen-and-cloud-is-a-palace

NSF CPS Research Projects

Research Areas from US National Science Foundation
From http://ontolog.cim3.net/ﬁle/work/OntologySummit2015/2015-04-13_14_OntologySummit2015_Symposium/CPS-IOT--KeithMarzullo_2015-04-13.pptx

Some Examples of NSF Research Projects
• Foundations Of Resilient CybEr-physical Systems (FORCES)
• Monitoring Techniques for Safety Critical Cyber-Physical Systems
• Computationally Aware Cyber-Physical Systems
• Security and Privacy-Aware Cyber-Physical Systems
• Thermal-Aware Management of Cyber-Physical Systems
From http://tinyurl.com/hjl6tlz

Foundations Of Resilient CybEr-physical Systems from NSF
From https://www.cps-forces.org/about.htm
The NSF project Foundations Of Resilient CybEr-physical Systems (FORCES) focuses on the resilient
design of large-scale networked CPS systems that directly interface with humans. FORCES aims to
provide comprehensive tools that allow the CPS designers and operators to combine resilient control
(RC) algorithms with economic incentive (EI) schemes.
The project is developing RC tools to withstand a wide-range of attacks and faults; learning and control
algorithms which integrate human actions with spatio-temporal and hybrid dynamics of networked CPS
systems; and model-based design to assure semantically consistent representations across all branches of
the project. Operations of networked CPS systems naturally depend on the systemic social institutions
and the individual deployment choices of the humans who use and operate them.The presence of
incomplete and asymmetric information among these actors leads to a gap between the individually and
socially optimal equilibrium resiliency levels.The project is developing EI schemes to reduce this gap.The
core contributions of the FORCES team, which includes experts in control systems, game theory, and
mechanism design, are the foundations for the co-design of RC and EI schemes and technological tools
for implementing them.
Resilient CPS infrastructure is a critical National Asset. FORCES is contributing to the development of
new Science of CPS by being the ﬁrst project that integrates networked control with game theoretic
tools and economic incentives of human decision makers for resilient CPS design and operation.The
FORCES integrated co-design philosophy is being validated on two CPS domains: electric power
distribution and consumption, and transportation networks.These design prototypes are being tested in
real world scenarios.The teams research efforts are being complemented by educational offerings on
resilient CPS targeted to a large and diverse audience.

Monitoring Techniques for Safety Critical CPS from NSF
From http://robotics.ece.uic.edu/index.php/research/fail-safe-robots/cps-project
CPS now is a new emerging research area that include a wide range of related disciplines with different
approaches, methods, tools and experimental platforms.This project is looking into one of the branch in
this broad area: Monitoring.
The growing complexity of modern engineered systems,and their increased reliance on computation,
calls for novel approaches to guaranteeing their correct functioning.This is especially important for
automotive systems where a failure can have catastrophic consequences.
One way to ensure correctness of a complex system is to thoroughly test and/or verify it.While testing
can increase confidence in a component, it can not guarantee correctness.Verification, on the other
hand, can guarantee correctness, but it is simply not feasible, for example, for a car with advanced engine
controls and numerous networked microprocessors. In other cases, the component might have been
verified for correctness on a model which was not accurate. And more importantly, even if a component
is found to be defective through verification,we may still want to use it if the incorrect behavior only
occurs rarely.
Runtime monitoring of the behavior of a component is an approach that can complement testing and
verification. It can provide another layer of safety to the operation of the system.The monitor observes
the inputs and outputs of the component and checks whether the behavior of the system is consistent
with the expected behavior. Monitors can be especially useful if a fail-safe shut down procedures can be
developed, which is true for abroad class of systems.We propose that monitor design be separate from
the system design and be performed after the design of the system by a different set of designers.The
fundamental advantage of monitors is that they are in principle easy to design and implement, and they
do not fundamentally constrain the design of a component. Such two layer approach ensures that
incorrect behaviors, due to potential faulty component designs, are detected by the monitor and are
acted upon.

Computationally Aware Cyber-Physical Systems from NSF
From http://nsf.gov/awardsearch/showAward?AWD_ID=1544396
The objective of this work is to generate new fundamental science that enables the operation of cyber-physical
systems through complex environments. Predicting how a system will behave in the future requires more
computing power if that system is complex. Navigating through environments with many obstacles could require
signiﬁcant computing time, which may delay the issue of decisions that have to be made by the on-board
algorithms. Fortunately, systems do not always need the most accurate model to predict their behavior.This
project develops new theory for deciding between the best model to use when making a decision in real time.The
approach involves switching between different predictive models of the system, depending on the computational
burden of the associated controller, and the accuracy that the predictive model provides.These tools will pave the
way for more kinds of aircraft to navigate closely and safely with one another through the National Air Space
(NAS), including Unmanned Air Systems (UAS).
The results from this project will enable more accurate and faster trajectory synthesis for controllers with
nonlinear plants, or nonlinear constraints that encode obstacles.The approach utilizes hybrid control to switch
between models whose accuracy is normalized by their computational burden of predictive control methods.This
synergistic approach enables computationally-aware cyber-physical systems (CPSs), in which model accuracy can
be jointly considered with computational requirements.The project advances the knowledge on modeling,
analysis, and design of CPSs that utilize predictive methods for trajectory synthesis under constraints in real-time
cyber-physical systems.
The results will include methods for the design of algorithms that adapt to the computational limitations of
autonomous and semi-autonomous systems while satisfying stringent timing and safety requirements.With these
methods come new tools to account for computational capabilities in real-time, and new hybrid feedback
algorithms and prediction schemes that exploit computational capabilities to arrive at more accurate predictions
within the time constraints.The algorithms will be modeled in terms of hybrid dynamical systems, to guarantee
dynamical properties of interest.The problem space will draw from models of UAS in the NAS.

Security and Privacy-Aware Cyber-Physical Systems from NFS
From http://nsf.gov/awardsearch/showAward?AWD_ID=1505799
Security and privacy concerns in the increasingly interconnected world are receiving much attention from the research
community, policymakers, and general public. However, much of the recent and on-going efforts concentrate on security of
general-purpose computation and on privacy in communication and social interactions.The advent of cyber-physical systems
(e.g., safety-critical IoT), which aim at tight integration between distributed computational intelligence, communication
networks, physical world, and human actors, opens new horizons for intelligent systems with advanced capabilities.These
systems may reduce number of accidents and increase throughput of transportation networks, improve patient safety,
mitigate caregiver errors, enable personalized treatments, and allow older adults to age in their places.At the same time,
cyber-physical systems introduce new challenges and concerns about safety, security, and privacy.The proposed project will
lead to safer, more secure and privacy preserving CPS.As our lives depend more and more on these systems, specifically in
automotive, medical, and Internet-of-Things domains, results obtained in this project will have a direct impact on the society
at large.The study of emerging legal and ethical aspects of large-scale CPS deployments will inform future policy decision-
making.The educational and outreach aspects of this project will help us build a workforce that is better prepared to address
the security and privacy needs of the ever-more connected and technologically oriented society.
Cyber-physical systems (CPS) involve tight integration of computational nodes, connected by one or more communication
networks, the physical environment of these nodes, and human users of the system, who interact with both the
computational part of the system and the physical environment.Attacks on a CPS system may affect all of its components:
computational nodes and communication networks are subject to malicious intrusions, and physical environment may be
maliciously altered. CPS-specific security challenges arise from two perspectives. On the one hand, conventional information
security approaches can be used to prevent intrusions, but attackers can still affect the system via the physical environment.
Resource constraints, inherent in many CPS domains, may prevent heavy-duty security approaches from being deployed.This
proposal will develop a framework in which the mix of prevention, detection and recovery, and robust techniques work
together to improve the security and privacy of CPS. Specific research products will include techniques providing: 1)
accountability-based detection and bounded-time recovery from malicious attacks to CPS, complemented by novel preventive
techniques based on lightweight cryptography; 2) security-aware control design based on attack resilient state estimator and
sensor fusions; 3) privacy of data collected and used by CPS based on differential privacy; and, 4) evidence-based framework
for CPS security and privacy assurance, taking into account the operating context of the system and human factors. Case
studies will be performed in applications with autonomous features of vehicles, internal and external vehicle networks,
medical device interoperability, and smart connected medical home.

Thermal-Aware Management of Cyber-Physical Systems from NSF
From http://www.nsf.gov/awardsearch/showAward?AWD_ID=1329831
Processors in cyber-physical systems are increasingly being used in applications where they must operate
in harsh ambient conditions and a computational workload which can lead to high chip temperatures.
Examples include cars, robots, aircraft and spacecraft. High operating temperatures accelerate the aging of
the chips, thus increasing transient and permanent failure rates. Current ways to deal with this mostly
turn off the processor core or drastically slow it down when some part of it is seen to exceed a given
temperature threshold. However, this pass/fail approach ignores the fact that (a) processors experience
accelerated aging due to high temperatures, even if these are below the threshold, and (b) while deadlines
are a constraint for real-time tasks to keep the controlled plant in the allowed state space, the actual
controller response times that will increase if the voltage or frequency is lowered (to cool down the chip)
are what determine the controlled plant performance. Existing approaches also fail to exploit the tradeoff
between controller reliability (affected by its temperature history) and the performance of the plant.This
project addresses these issues. Load-shaping algorithms are being devised to manage thermal stresses
while ensuring appropriate levels of control quality. Such actions include task migration, changing
execution speed, selecting an alternative algorithm or software implementation of control functions, and
terminating prematurely optional portions of iterative tasks.Validation platforms for this project include
automobiles and unmanned aerial vehicles.These platforms have been chosen based on both their
importance to society and the signiﬁcant technical challenges they pose.
With CPS becoming ever more important in our lives and businesses, this project which will make CPS
controllers more reliable and/or economical has broad potential social and economic impacts.
Collaboration with General Motors promotes transition of the new technology to industry.The project
includes activities to introduce students to thermal control in computing, in courses spanning high-
school, undergraduate and graduate curricula.

Internet of Bio-Nano Things (IoBNT): Cells as Devices
From hwww2.ece.gatech.edu/research/labs/bwn/papers/2015/j3.pdf

Internet of Nano-Things
From citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.637.3319&rep=rep1&type=pdf

Testbeds

NIST Smart Grid and CPS Testbed
From www.nist.gov/smartgrid/upload/Smart-Grid-Testbed-Update.pdf

Public IoT Testbeds
From https://hal.inria.fr/inria-00630092/document

IoT Testbeds with Interesting Features

Typical IoT Testbed Architectures

CloudMesh: Cloud Testbeds as A Service (CTaaS
From http://cloudmesh.github.io/cloudmesh.html

Federated Interoperable Semantic IoT Testbeds(FIESTA-IoT)
From http://ﬁesta-iot.eu/ﬁesta-testbeds/

Korean KETI Project for FIESTA-IoT
From http://jseungsong.weebly.com/research.html
EU Horizon 2020: FIESTA project
Period: 2015.02 ~ 2018.01 (36 months)
Members: KETI (together with Sejong University), NEC Europe Ltd., Fraunhofer,
University of Surrey, etc.
Project coordinator: Prof. Song JaeSeung (Korea side)
FIESTA will be validated and evaluated based on the interconnection of four
testbeds (in Spain, UK, France and Korea), as well as based on the execution of
novel experiments in the areas of mobile crowd-sensing, IoT applications
portability, and dynamic intelligent discovery of IoT resources. In order to achieve
global outreach and maximum impact, FIESTA will integrate an additional testbed
and experiments from Korea, while it will also collaborate with IoT experts from
USA.The participation of a Korean partner (based its own funding) will maximize
FIESTA’s value for EC money. Moreover, the project will take advantage of open
calls processes towards attracting third-parties that will engage in the integration
of their platforms within FIESTA or in the conduction of added-value experiments.
As part of its sustainability strategy, FIESTA will establish a global market
conﬁdence programme for IoT interoperability, which will enable innovative
platform providers and solution integrators to ensure/certify the openness and
interoperability of their developments.

SmartSantander Testbed in Spain
From http://www.smartsantander.eu/

Network Architecture for Smart Campus Testbed in UK
From http://www.smartsantander.eu/downloads/Presentations/gws13.pdf

4G/LTE Core/IMS/M2M Testbed in France
From http://www.etsi.org/plugtests/COAP2/Presentations/04_Com4Innov-ETSI%20CoAP.pdf

Lab of Things from Microsoft Research
From http://www.lab-of-things.com/

Home OS and HomeStore from Microsoft Research
From http://www.zdnet.com/article/microsofts-homestore-home-automation-with-an-iphone-inspired-twist/
and http://research.microsoft.com/pubs/136890/hotnets2010-homeos.pdf

Industrial Internet Consortium Testbeds

Testbeds from Industrial Internet Consortium (IIC)
From http://www.iiconsortium.org/test-beds.htm

Asset Efficiency Testbed from IIC
From http://www.iiconsortium.org/asset-efficiency.htm
Many industries have assets that are critical to their business processes.Availability and
efficiency of these assets directly impact service and business. Using predictive analytics, the
Asset Efficiency Testbed aims to collect real-time asset information efficiently and
accurately and run analytics to make the right decisions in terms of operations, maintenance,
overhaul and asset replacement. Infosys, a member of the Industrial Internet Consortium, is
leading this project, with contribution from Consortium members Bosch, GE, IBM, Intel,
National Instruments and PTC.
Asset Efficiency is a vertical testbed, making it possible for the testbed to be applied to multiple
solutions.The testbed will launch in two phases. In the first phase, the testbed will be created
for a moving solution, in this case, aircraft landing gear.The focus of this phase will be on the
creation of stack and the integration of technologies. In the second phase, the testbed will
address fixed assets, like chillers, with the goals of finalizing the architecture and opening up the
interfaces.
The Asset Efficiency Testbed monitors, controls and optimizes the assets holistically taking into
consideration operational, energy, maintenance, service, and information efficiency and enhance
their performance utilization.The Asset Efficiency Testbed offers numerous benefits including:
Condition Monitoring that helps in determining an optimal maintenance schedule, the reduction
in downtime thus improving overall productivity of assets, reduction in capital and operational
expenditures, and efficient energy utilization.

Condition Monitoring and Predictive MaintenanceTestbed from IIC
From http://www.iiconsortium.org/cm-pm.htm
Many industries have assets that are critical to their business processes.Availability and
The Condition Monitoring and Predictive Maintenance Testbed (CM/PM) will
demonstrate the value and benefits of continuously monitoring industrial equipment to detect
early signs of performance degradation or failure. CM/PM will also use modern analytical
technologies to allow organizations to not only detect problems but proactively recommend
actions for operations and maintenance personnel to correct the problem.
Condition Monitoring (CM) is the use of sensors in equipment to gather data and enable
users to centrally monitor the data in real-time. Predictive Maintenance (PM) applies
analytical models and rules against the data to proactively predict an impending issue; then deliver
recommendations to operations, maintenance and IT departments to address the issue.These
capabilities enable new ways to monitor the operation of the equipment - such as turbines and
generators - and processes and to adopt proactive maintenance and repair procedures rather than
fixed schedule-based procedures, potentially saving money on maintenance and repair, and saving
cost and lost productivity of downtime caused by equipment failures. Furthermore, combining
sensor data from multiple pieces of equipment and/or multiple processes can provide deeper
insight into the overall impact of faulty or sub-optimal equipment, allowing organizations to identify
and resolve problems before they impact operations and improve the quality and efficiency of
industrial processes.
Through this testbed, the testbed leaders IBM and National Instruments will explore the
application of a variety of analytics technologies for condition monitoring and predictive
maintenance.The testbed application will initially be deployed to a power plant facility where
performance and progress will be reported on, additional energy equipment will be added and new
models will be developed. It will then be expanded to adjacent, as yet to be determined, industries.

Connected Care Testbed from IIC
From http://www.iiconsortium.org/connected-care.htm
A substantial opportunity exists here to reduce the cost of chronic health management for
patients.Advances in technology minimization and integration, networking access of medical
devices and preponderance of personal smart devices make IoT technology particularly well
suited to address this problem.
The Testbed will provide an ecosystem of tools that can provide:
• Improved patient health and reduced hospital readmissions
• Provide patient, family and caregivers involvement and access to patient health
• Enable patients to live at home while under managed care
• Enable health care providers to improve patient adherence to prescribed treatments

Edge Intelligence Testbed from IIC
From http://www.iiconsortium.org/edge-intelligence.htm
Many emerging industrial IoT applications require coordinated, real-time analytics at the "edge",
using algorithms that require a scale of computation and data volume/velocity previously seen
only in the data center. Frequently, the networks connecting these machines do not provide
sufficient capability, bandwidth, reliability, or cost structure to enable analytics-based control or
coordination algorithms to run in a separate location from the machines.
Industrial Internet Consortium members Hewlett-Packard and Real-Time Innovation have
joined together on the Edge Intelligence Testbed. The primary objective of the Edge
Intelligence Testbed is to significantly accelerate the development of edge architectures and
algorithms by removing the barriers that many developers face: access to a wide variety of
advanced compute hardware and software configurable to directly resemble state-of-the-art edge
systems at very low cost to the tester/developer.

Factory Automation (FA) PaaS Testbed from IIC
From http://www.iiconsortium.org/fa-paas.htm
This testbed facilitates development of FA applications by providing a service-based
platform with pre-integrated environment across factory automation (OT) and IT
platform (IT).
It includes IoT data processing platform that processes Big Data, IoT head end system,
and IoT gateway that securely connects the service platform layer with FA environment,
and FA edge device that provides functions unique to FA applications, and which also
enable communications with FA devices in the ﬁeld of factories. In addition, the advantage
of IoT platform tested in this testbed is interoperability between FA environment, IoT
gateways and IoT data processing platform and accelerates application development for
next-generation factory by making available of integrated environment between FA
environment and service platform layer.

Factory OperationsVisibility & Intelligence (FOVI)Testbed from IIC
From http://www.iiconsortium.org/fovi.htm
The Factory OperationsVisibility & Intelligence (FOVI) Testbed makes it possible to simulate a
factory environment in order to visualize results that can then be used to determine how the
process can be optimized.
The work on FOVI stems from two separate OperationsVisibility and Intelligence applications
in two factories in Japan: one for notebook computers and another for network appliances.
Both use cases have a lot in common with respect to processing data, analytics, and visualization
technologies. Ideally they should use a common software foundation while their future evolution
requires a more open architecture.
Work on the testbed will be led by Industrial Internet Consortium member Fujitsu Limited
with Industrial Internet Consortium founding member, Cisco, collaborating on the in-factory
testbed edge infrastructure.

High Speed Network Testbed from IIC
From http://www.iiconsortium.org/high-speed-network.htm
The High-Speed Network Infrastructure testbed will introduce high-speed ﬁber optic lines to
support Industrial Internet initiatives.The network will transfer data at 100 gigabits per second
to support seamless machine-2-machines communications and data transfer across connected
control systems, big infrastructure products, and manufacturing plants.
The 100 gigabit capability extends to the wireless edge, allowing the testbed leaders to provide
more data and analytical results to mobile users through advanced communication techniques.
Industrial Internet Consortium founder, GE, is leading efforts by installing the networking lines at
its Global Research Center. Cisco - also a founder of the Consortium - contributed its
expertise to the project by providing the infrastructure needed to give the network its national
reach. Industrial Internet Consortium members Accenture and Bayshore Networks are
currently demonstrating the application of the High-Speed Network Infrastructure for power
generation.

Industrial Digital Thread Testbed from IIC
From http://www.iiconsortium.org/industrial-digital-thread.htm
The Industrial Digital Thread (IDT) testbed drives efficiency, speed, and flexibility
through digitization and automation of manufacturing processes and procedures. Beginning at
design, the seamless digital integration of design systems into manufacturing, leveraging the
model-based enterprise, helps to enable virtual manufacturing before even one physical part is
created. Sensor enabled automation, manufacturing processes, procedures, and machine data will
enable optimization in operations and supply chain. Once the manufacturing process is
complete, the digital ‘birth certificate’ (as built-signature) can then be compared to the as-
designed engineering intention.This provides the opportunity for powerful big data analytics to
enable service teams and field engineers to have better awareness, insights, and practical actions
to improve the servicing and maintenance of critical assets.
The Industrial Digital Thread is a complex and comprehensive concept and it will be
implemented in multiple phases. Phase 1 focuses on assembling the software stack, establishing
the architecture and connectivity, and addressing one use case around premature wear. In
subsequent phases, this testbed will be able to support multiple use cases in design,
manufacturing, services and supply-chain optimization.At this time, additional members will be
invited to join.

International Future Industrial Internet Testbed from IIC
From http://www.iiconsortium.org/infinite.htm
The goal of the International Future Industrial Internet Testbed (INFINITE) is to develop
software-defined infrastructures to drive the growth of Industrial Internet products and
services. INFINITE uses Big Data to not only create completely virtual domains with Software-
Defined Networking, but it also makes it possible for multiple virtual domains to securely run
via one physical network - thus making it ideal for use in mission critical systems. Even more
interesting, INFINITE makes it possible to connect to these virtual domains through mobile
networks.
Industrial Internet Consortium member, EMC Corporation, is leading the INFINITE testbed.
Also contributing their expertise to this project is Industrial Internet Consortium member
Cork Institute of Technology as well asVodafone, the Irish Government Networks,Asavie and
Cork Internet Exchange.
The testbed will unfold in two phases in Ireland. In Phase One, three geographically dispersed
data centers will be interconnected into a reconfigured EMC network. In Phase Two, INFINITE
will be applied to a use case called "Bluelight". Bluelight will allow ambulances to securely
connect to a hospital's system and relay information while in route, so hospital staff are
prepared to take over the care of the patient once the ambulance arrives.
The INFINITE testbed is open to any Industrial Internet Consortium member as well as
interested nonmembers companies who have a concept for an IoT-enabled solution that
requires mobile communication and a dynamic configuration environment.

Intelligent Urban Water Supply
From http://www.iiconsortium.org/intelligent-urban-water-supply.htm
The testbed will deploy IoT gateways to securely connect the water supply asset (e.g. pressurizing
pumps) to the cloud service platform where advanced analytics will be applied to the operational
data communicated from the assets. The operational insight obtained from the analytics will be
used to drive the water supply domain applications to monitor and provide advanced maintenance
capability, monitor water quality, detect water leakages, reduce energy consumption of
pressurizing pumps and ensure equitable water distributions to the points of consumption during
water peak usage hours and water supply shortages.

Microgrid Testbed from IIC
From http://www.iiconsortium.org/microgrid.htm
The goal of the Microgrid Communication and Control Testbed is to prove the viability of a
real-time, secure databus to faciliate machine-to-machine, machine-to-control center, and
machine-to-cloud data communications. It will combine distributed, edge-located processing and
control applications with intelligent analytics. It will run in real-world power applications and
interface with practical equipment.
Three Industrial Internet Consortium member organizations will be lending their expertise to
this project: Real-Time Innovations (RTI) is providing the real-time databus software using their
DDS standard based RTI Connext communication platform for IIoT; National Instruments is
providing the intelligent nodes for edge control and analytics based on their CompactRIO and
Grid Automation Systems; and Cisco is providing network equipment and security expertise
using their Connected Grid Router.They will also be collaborating with Duke Energy and the
Standard Grid Interoperability Panel (SGIP) to ensure a coordinated, accepted architecture.
The testbed is unfolding in three phases. In April 2015, Phase One commenced as a proof-of-
concept that ensures basic security and performance. Phase Two - slated for 2016 - will
demonstrate the scalability of the Microgrid Communication and Control Framework in a
simulated environment.The ﬁnal phase will demonstrate the testbed in a real-world situation.
The ﬁrst two phases will take place in Westminster, California at Southern California Edison's
Controls Lab

Precision Crop Management Testbed from IIC
From http://www.iiconsortium.org/precision-crop-management.htm
The Testbed will explore the ability of IoT technology to improve Crop
Management, through increased production (yield), lower operational costs
plus smarter applications of chemicals and fertilizers.The Testbed will focus
on improving crop yield through the analysis of real-time data from a variety
of environmental sensors and other sources of truth located in commercial
crop ﬁelds or throughout the enterprise.

Security Claims Evaluation Testbed from IIC
From http://www.iiconsortium.org/security-claims.htm
The primary objective of the Security Claims Evaluation Testbed is to provide an
open and easily conﬁgurable cybersecurity platform for evaluation of endpoint, gateway, and
other networked components’ security capabilities.The testbed will enable participants to
connect their equipment to a system of other endpoints, gateways, etc. to evaluate the
security capabilities of their equipment, interoperability to other devices, and verify the
critical areas of their architecture pattern are secured as outlined in the Industrial Internet
Consortium Reference Architecture.
Industrial Internet Consortium members and non-members have the ability to connect
their equipment to the testbed to evaluate the security of their devices within two
different scenarios; individually on a device level as well as with a system of other
endpoints, gateways, etc.This includes exploration of methodology and collection of
evidence to demonstrate the system operational security processes supporting the key
characteristics of the system relative to evaluation of the participant’s claims.Additionally,
the testbed enables the evaluation of the critical areas of an architecture pattern that need
to be secured as outlined in the Industrial Internet Consortium Reference Architecture.
The testbed will be rolled out in three stages.The ﬁrst being initial deployment in a lab
environment, second in a micro-factory environment and third phase as determined by the
growth of the testbed.The security testbed phased release approach provides a unique
learning opportunity to evaluate security vulnerabilities at a device level and system level
prior to large scale deployment across many key applications driving the Industrial Internet
of Things (IIoT) / Industry 4.0.

Sensor to Cloud Connectivity Testbed from IIC
From http://www.iiconsortium.org/press-room/10-12-16.htm
The objective of sensor-to-the-cloud connectivity is to make sensor data available to
information technology (IT) systems in near real time, enabling advanced analytics.This is of
particular interest to operators of existing manufacturing facilities, as it provides them with
opportunities to increase efficiencies, e.g. through reductions in energy consumption. Unlike
new deployments, where the appropriate connectivity may be designed in from the
beginning, smart solutions are required for these "brownfield" installations in order to enable
easy integration at both the operational technology (OT) and the IT level to reduce
downtime and save costs.
The Smart Manufacturing Connectivity for Brownfield Sensors Testbed will:
• Introduce a retrofit hardware solution (the "Y-Gateway") that makes use of existing
physical connectivity
• Extract sensor data from the automation system without impacting operations
• Deliver the sensor data to SAP's IT platform through a secure OT/IT communication
based on OPC UA (IEC 62541)
• Define and implement a common device model based on an available open standard to
allow for the easy integration of an IO-Link sensor with IT, enabling the remote
configuration of the sensor

Smart Airline Baggage Management Testbed from IIC
From http://www.iiconsortium.org/baggage-management.htm
GE Digital will be contributing the Predix® Cloud platform – already used extensively
in the airline business – to host the platform side of the testbed. Oracle will provide
their airline applications built on the Oracle Airline Data Model (OADM). M2Mi will
provide the M2M and IoT device management, connectivity, data handling and instream
analytics to connect edge devices such as smart luggage, airport baggage trucks,
scanners and beacons to the platform applications.The M2Mi IoT platform will run on
GE Predix and the Oracle Cloud and will also provide policy management and
enforcement, security and encryption to deliver the critical infrastructure to pass data
and alerts to and between the GE and Oracle hosted applications.
The testbed will use a range of Bluetooth, Cellular and WiFi baggage tracking devices.
These will be deployed in smart luggage, permanent and reusable bag tags, airport
luggage carts and across the baggage ecosystem. Phase 1 of the testbed project will:
• Provide a Cloud-based ecosystem to provide connectivity to assets like bags and
passenger and airport/airline equipment.
• Provide end-to-end visibility of bags to the airline, as it is checked-in, dropped and
travels via the baggage carousel, bag trolley, aircraft, connecting airport to the
destination bag-pickup.
• Enable airlines to provide near-real-time view of their bag status to the customers.

Smart Manufacturing Connectivity Testbed from IIC
From http://www.iiconsortium.org/smart-connectivity.htm
This testbed is essentially about implementing a sensor’s virtual representation at
platform tier level by
1. A hardware component that establishes a separate OT/IT communication to deliver
sensor data to the IT systems and to receive configuration data.
2. The implementation of a common device model based on an open standard that
enables the control and manipulation of the physical device from within the IT
systems.
This testbed uses open standards for the OT/IT communication, the sensor devices and
the common device model:
• IO-Link is standardized as IEC 61131-9:2013 Programmable controllers - Part 9:
Single-drop digital communication interface for small sensors and actuators (SDCI).
• OPC UA is standardized within the IEC 62541 OPC Unified Architecture series.
• The IO Device Description (IODD) is based on ISO 15745-1:2003 Industrial
automation systems and integration – Open systems application integration
framework – Part 1: Generic reference description
As IO-Link is also based on the IODD, there is a consistent device description from the
IT to the sensor level – supported through the semantics-independent data transfer
provided by OPC UA – that allows for the easy configuration of a sensor and the
interoperability with a large range of devices and analytic services.

Smart Energy Management Testbed from IIC
From http://www.iiconsortium.org/energy-management.htm
he World Economic Forum has identiﬁed ‘rising energy costs’ as the sixth highest
economic risk. It is a bigger risk in Asia. Ever-increasing population,
overconsumption and poor infrastructure result in increases in energy demand.
Organizations need to be cognizant of this fact and ensure that they keep their
energy costs in control through optimal utilization of energy.The primary of
objective of the Smart Energy Management Testbed is to monitor, visualize, analyze
and optimize the consumption of energy within the organization. It could be a city,
large campuses of private organizations or large infrastructure utilities like airports
or shopping malls. Infosys, a member of the Industrial Internet Consortium, is
leading this testbed, with contributions from consortium members, PTC and
Schneider Electric.
The testbed will be developed from the context of the smart city initiative. It will
have a platform on which additional testbeds such as lighting management,
environment management, security, etc. can be developed.The ﬁrst phase will cover
nine commercial buildings in the Infosys Campus in Mysore, India, and chiller plants
for those buildings. In the next phase, it will have additional facilities like residential
buildings, a data center and the stadium.

Time Sensitive Networks Testbed from IIC
From http://www.iiconsortium.org/time-sensitive-networks.htm
Support of fast control applications means the network needs to support communications with low
latency and low jitter and to provide mechanisms for distributed coordination or time synchronization.
Typically these requirements have resulted in non-standard network infrastructure or unconnected
standard networks where devices and data are not accessible throughout the infrastructure.
The goal of this testbed is to display the value of new Ethernet standards referred to as Time-Sensitive
Networks in a Manufacturing ecosystem of applications. TSN enables a standard, single, open network
infrastructure supporting multi-vendor interoperability and integration. The technology will be used to
support real-time control and synchronization of high performance machines over a single, standard
Ethernet network.
This testbed proposes to be an early implementation of TSN. As such, it will show the value of the
technology as well as some of the challenges in implementations from a number vendors. This testbed
will not only document some of the value, but will provide feedback to the relevant standards
organizations on areas of further clarification or improvement.
The testbed will display the following:
• Combine different critical and best-effort traffic flows on a single network based on IEEE 802.1 Time
Sensitive Networking
• Demonstrate the real-time capability and vendor interoperability using standard, converged Ethernet
• Evaluate security value of TSN and provide feedback on the secure-ability of initial TSN functions
• Show ability for IIoT to incorporate high performance and latency sensitive applications
• Provide integration points for smart edge-cloud control systems into IIoT infrastructure & application

Track and Trace Testbed from IIC
From http://www.iiconsortium.org/track-and-trace.htm
The Track and Trace testbed brings the Industrial Internet onto the factory floor.The goal is to
manage handheld power tools in manufacturing and maintenance environments.This
"management" involves efficiently tracking and tracing the usage of these tools to ensure their
proper use, prevent their misuse and collect data on their usage and status.
Today's factories are highly sophisticated and require exacting work - down to the precise
amount of force used to tighten a screw.The tools in Track and Trace will be able to determine
its precise location and use and, therefore, will be able to determine the force and work needed
to complete a task. In addition, if a tool recognizes that it is being misused, it will promptly
power down to avoid accident or injury. Finally, over the two-year project, the testbed
participants will look to fine-tune the localization of tools to 30 centimeters, and ideally down
to five centimeters. Currently, the accuracy is approximately one meter - a gap large enough to
allow mistakes.These features of Track and Trace will contribute to the safety and quality of the
goods produced, as well as increase productivity in manufacturing.
Over the two-year project, four Industrial Internet Consortium members will be lending their
expertise to the testbed. Bosch is supplying the necessary software; Cisco is taking care of the
precision location identification feature; National Instruments will interconnect the power
tools; and TechMahindra is responsible for the application programming.

Smart Water Management Testbed from IIC
From http://www.iiconsortium.org/water-management.htm
The growing water shortage is now regarded as the most crucial global
challenge, affecting both developing and developed nations (World Economic
Forum:The Global Risks Report 2015). Growing water shortages have been
driven by a rapid increase in the global population, accelerating climate
change, growing industrialization in developing countries, and aging
infrastructure.
Cities and large organizations are increasingly struggling to meet growing
demands for water and will have to take measures for reducing the water
losses.The focus of this testbed is reducing water losses through the
implementation of IoT technologies across the water infrastructure. It could
be a city, large campuses of private organizations or large infrastructure
utilities like airports or shopping malls. Infosys, a member of the Industrial
Internet Consortium, is leading this testbed, with contribution from
consortium members GE, EMC, Sierra Wireless and others.
The testbed will be developed from the context of smart city initiative. It will
have a platform on which additional testbeds like lighting management,
environment management, security, etc. can be developed.

References
Inventory of all Bob Marcus CPS Slides on Slideshare
http://www.slideshare.net/bobmarcus/inventory-of-my-cps-slide-sets

References
European Research Cluster on the Internet of Things (IERC)
http://www.internet-of-things-research.eu/
Industrial Internet of things (IIC) Testbeds
http://www.iiconsortium.org/test-beds.htm
DARPA META, CyPhy, and Adaptive Vehicle Make
http://cps-vo.org/group/avm/meta and http://cps-vo.org/group/avm/meta-overview and http://cps-vo.org/group/avm
Designing a Digital Future: Federally Funded R&D in Networking and Information Technology
https://www.whitehouse.gov/sites/default/ﬁles/microsites/ostp/pcast-nitrd-report-2010.pdf
Current and Planned Research at the Digital Science Center at Indiana University
http://grids.ucs.indiana.edu/ptliupages/publications/intelligent_iot_cloud_controller.pdf
Medical Device Cyber-Physical Systems from the University f Pennsylvania
https://rtg.cis.upenn.edu/MDCPS/
Cyber-Physical Systems: Are the Computing Foundations Adequate?
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.84.8011&rep=rep1&type=pdf
Internet of Nano-Things (IoNT)
citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.637.3319&rep=rep1&type=pdf
Internet of Bio-NanoThings(IoNBT)
http://www2.ece.gatech.edu/research/labs/bwn/papers/2015/j3.pdf

References continued
Networked Embedded Systems Technology (NEST)
http://www.isis.vanderbilt.edu/projects/nest
Cyber-Physical Systems Engineering (CPSE) Lab Platforms in Europe
http://www.cpse-labs.eu/platforms.php
Core Research and Innovation Areas in Cyber-Physical System of Systems (CPSoS)
http://www.cpsos.eu/wp-content/uploads/2014/12/CPSoS-Initial-Research-and-Innovation-Priorities-Document-Nov.-2014.pdf
NIST Cyber-Physical Systems Testbed Workshop
http://www.nist.gov/cps/upload/CPSTestbedWorkshopAgenda-2.pdf
NSF Cyber-Physical Systems Home Page
https://www.nsf.gov/funding/pgm_summ.jsp?pims_id=503286
European Digital Agenda for Cyber-Physical Systems
https://ec.europa.eu/digital-agenda/en/cyberphysical-systems-0

References continued
SMART-ACTION Consortia for International IoT Roadmapping in Europe
https://www.smart-action.eu/about/
Fog Research Overview from Princeton
http://www.princeton.edu/~chiangm/FogResearchOverview.pdf
IoT European Platforms Initiative
http://iot-epi.eu/
The Alliance for IoT Innovation (AIOTI)
https://ec.europa.eu/digital-single-market/en/alliance-internet-things-innovation-aioti
NSF CPS Research Awards
http://www.nsf.gov/news/news_summ.jsp?cntn_id=189476&WT.mc_
U.S. National Science Foundation Cyber-Physical Systems Home Page and Projects
https://www.nsf.gov/funding/pgm_summ.jsp?pims_id=503286
https://www.cps-forces.org/about.htm and http://robotics.ece.uic.edu/index.php/research/fail-safe-robots/cps-project
http://nsf.gov/awardsearch/showAward?AWD_ID=1544396 and http://nsf.gov/awardsearch/showAward?AWD_ID=1505799
http://www.nsf.gov/awardsearch/showAward?AWD_ID=1329831
Cyber-Physical Virtual Organization (CPS-VO) supported by NSF
http://cps-vo.org/
National Academies Workshop: Reﬁning the Concept of Scientiﬁc Inference when Working with Big Data
http://sites.nationalacademies.org/DEPS/BMSA/DEPS_171738

Research and Testbeds in Cyber-Physical Systems

More Related Content

What's hot

Viewers also liked

Similar to Research and Testbeds in Cyber-Physical Systems

Recently uploaded

Research and Testbeds in Cyber-Physical Systems