Presentation by Fran Rabuck (Rabuck Associates) at COMIT 2016: Digitally Building Britain, September 2016 More information: http://www.comit.org.uk/liveblog

1. Digitally Building Britain #COMIT2016
28th/29th September 2016. London, UK.
Francis Rabuck, Principal Research Consultant
Tools for the Future of the Digital Infrastructure Lifecycle
As a new era of Digital Infrastructure arrives, we have to ask ourselves
are we prepared?
How will we design, build and measure Infrastructure through the 4th
Industrial Revolution? How will government, industry, jobs and society
change to adapt? Like Godzilla gods we plan to build and destroy cities
with budgets we can’t even imagine, and maybe can’t afford.
The machinery of past eras, our construction equipment, our digital
planning and collaboration, even our current digital drawings and
methods will not be enough. We need to create a new era of ideas,
tools and applications for this Era of Mass Construction – and do it
quickly!
Robotics, Artificial Intelligence, Drones, Autonomous Vehicles, VR/AR,
NextGen Computing, Sensors, Image capture, Data Tracking and
Collaboration, User Interfaces (UX) and Measuring Tools are just a few
of the technologies we’ll discuss that are emerging to conquer this Era.

2. “Great” to be back for Year 5!
• “Make America Great Again”
• “Great Gatsby”
• “Great” Britain

3. Mobile Future
• COMIT roots are Mobile
• Mobile is still central to IoT
• Future of Everything Digital
• …but “Mobile” is being Redefined

4. Mobile is NOT…

5. Mobile is Sensors…

6. Mobile is Adaptable – Moto Z

7. CHIPS of the FUTURE – AI
• Artificial intelligence (AI) has relied on energy-
hogging fast processors and large datasets for
training neural networks – both of which
presupposed centralized computing
architectures. But today, more powerful chips
are lettingAI escape from centralized, cloud-
based systems and move out to devices at the
edge of the network. Among incumbents, Intel
spent a whopping $16.7 billion on AI chipmaker
Altera; Google is developing an AI chip called
Tensor and working with Movidius to put AI on
a USB stick; and Nvidia has dropped $2 billion
so far on itsTesla graphics chip for machine
vision and other AI tasks. At the same time,
startups like krtkl, KnuEdge, Nervana, MIT’s
Eyeriss, and China’s Horizon Robotics are all
developing new chips to bring AI to robots,
self-driving cars, and other things in the
Internet ofThings (IoT) that have to operate
independently with an intermittent network
connection – an IoT without the Internet.

8. Watson- AI Video

9. GoFetchCode
• Finds your regulatory code
in a snap
• Bookmarks important
codes
• Remembers your previous
questions
• Easily navigates and cross
reference

10. Microsoft Cognitive

11. Mobile Apps – OUT, ChatBots - IN
• Voice is becoming the new UI for applications
• Backend intelligent applications that converse
are replacing Mobile apps…Siri was just the
beginning
• VIV and other new companies emerging in the
market

12. Beacons of Hope – Extending the Where of GPS
http://www.aislelabs.com/reports/beacon-guide/

13. LPWAN – LoRa, SIGFOX, LTE-M
http://www.nickhunn.com/lora-vs-lte-m-vs-sigfox/
• Ingenu
• Starfish
• Cynet
• Accellus
• Telensa
• Nwave
• Waviot,
• Sigfox, LoRa and LTE-M

14. 3D Print- Voxel 8, HP in the Game, GE buys
Arcam

18. Winner is…Hubo from KAIST

19. Rodney Brooks on Robot Apocalypse

20. Collaborative Robotics,
Cooperative Robotics =CoBots
• Collaborative Robtics – MainstreamTrend for robots safely working
with Humans (who also typically train them on a task)
• Cooperative Robotics – FutureTrend – Robots working with each
other, swarming, ground-air, etc.
• Merging of these to define CoBots era

21. Components of CoBots (NSF)
• Cognition
• NLP
• Resiliency
• Dexterity
• Mobility
• Interoperability
• Safety
• Emotional Awareness

22. Sensors/Robotics

23. Senses/Sensors
Sight or vision
Capability of the eyes to focus and detect images, color, light,
brightness and shapes.
Hearing/Auditory – Voice Recognition
Ability to perceive sound by detecting vibrations,
changes in the pressure over time.
Touch
Touch, or somatosensory, is a perception resulting from activation
of neural receptors, generally in the skin and includes pressure
sensitivity.
Taste Olfactory (Smell)
Capability of the eyes to focus and detect images, color,
light, brightness and shapes.

24. 6th Sense and 7th Sense
Vestibular
The vestibular system explains the
perception of our body in relation to gravity,
movement and balance. The vestibular
system measures acceleration, g-force,
movements and head position.
Source: http://www.7senses.org.au/
Proprioception
Proprioception is the sense of the
relative position of neighboring parts of
the body and strength of effort being
employed in movement.

25. Vision
• Vision Advancement from Google, Microsoft, IBM (Watson) and
other large research
• Mostly in image recognition
• Acceleration in the market because of AR/VR

26. AR? – Ricoh Theta S
• 360/Spherical/PanoVideo Capture
• Real – Reality
• Site Capture/WalkThru/Inspections
• Linking ofVideo Capture

27. Nico 360 – Coming Soon
http://nico360.com/

28. Snap Extensions
• SnapChat – Now Snap – announces Google-like Glasses
• Video Capture Only
• $129 – estimated price

29. Vision – No Cameras
• Photogrammetry
• LiDAR
• IR
• Ultrasound
• Hyperspectral Imaging
• Temperature sensing (Heat Maps)
• Digitally Created from Models and 3D Navigation
• RFID-UWB (UltraWide Band)

30. Drone – Vision and NOW GoPro Karma

31. Vision Extended Beyond Video

32. Drone Vision - Thermal Imaging
CWSI – AgTech Crop Water Stress Index

33. Some Work in 2015 on Vision
IEEE EmbeddedVision Workshops on RoboticsVision
http://cvisioncentral.com/evw2015
The EmbeddedVision Alliance
http://www.embeddedvision.com
http://embeddedvisionsummit.com

34. Voice (Auditory In/Out)
• Voice Recognition
• Listen to the sound wave
• Convert wave into text
• Understand text question
• Find the answer
• Convert answer from text to speech

35. Touch
End of Arm Terminators (EOAT)
• Robots are clumsy?
• Misconception – Robots can
beVERY precise…
Intuitive Surgical?
Beer Pong?
Gecko-like emulation?

36. Empire – Beer Pong

37. Soft Robotics
• Research work on sensors, soft, rubbery material and electronics
• Major work in Boston area – Harvard, MIT –Wyss Institute
• Checkout the open source work and competition of the Soft Robotics
Toolkit.

38. Other Sensors
• Kinetic Sensors for movement and balance
• Often coupled with vision and orientation sensors family
• Emotional Sensors? Hanson Robotics and Jibo – facial rec and human
expression.
• Other emotional sensors (fear, danger, happiness, bodimetrics)

39. Challenges
• Multifunctional Robots
• Multimodal Input
• Sensor degradation over time
• Sensor standardization of measurements
• Social/Political Policy/Legislation

40. Future
• Smaller, Faster, Cheaper – Pick all
• Increasing Data Science/Analytics Improve
Results
• Post Processing to RealTime Processing (Cloud-
Based)
• Multi-sensor integration on a chip
• Brain Integration with Robotics
• Modularization of Components
• ROS – Open Source Movement
• Voice – dominant interface from toys to
appliances

41. China
• Foxcon replacing
factory of low cost
workers with lights
out robots
• China buys ARM
• Heavy investment
in 3D Printing
• China buys Kuka
• China builds cities –
that are empty

42. Collaborative Robotics,
Cooperative Robotics =CoBots
• Collaborative Robtics – MainstreamTrend for robots safely working
with Humans (who also typically train them on a task)
• Cooperative Robotics – FutureTrend – Robots working with each
other, swarming, ground-air, etc.
• Merging of these to define CoBots era

43. Components of CoBots (NSF)
• Cognition
• NLP
• Resiliency
• Dexterity
• Mobility
• Interoperability
• Safety
• Emotional Awareness

44. Building Digital Infrastructure
SUPERMARKET YOUR STORE
Digital Airspace
Redefined:
Drones First,
Jetsons Next
Drones
Autonomous
Swarms
Sensors
Software
Digital
Signage
Billboards
BillBuildings?
80%
Digital Buildings
Cooperative? CoBuilds?
From SmartGrid to Smart
City
Digital Transportation
Autonomous Public
Transportation First,
Logistics/Supply Chain
Second,
Consumers Last

45. BIM & LEGOS – continued tomorrow
• B - I – M, I=?
• Information?
• Innovation?
• Investment?
• Tomorrow –Toys 4Techies and the LEGO Connection
• Questions now?
• Contact me or follow me:
• Twitter: @frabuck
• eMail: frabuck@att.net
• Linkedin: www.linkedin.com/francisrabuck

46. Questions? More Information?
•Francis Rabuck
•eMail: frabuck@att.net
•Linkedin:
•www.linkedin.com/in/francisrabuck/
•Twitter: @frabuck