Download as PDF, PPTX
![Raspberry
PI
2
Arduberry
Servo
Soware
Communica]on
across
Hardware
Layers
Servo
Raspberry
PI
Chassis
JavaScriptPI
Binary
(Compiled
C
/
C++)](https://image.slidesharecdn.com/javaonecodingmojo-151029171052-lva1-app6891/75/JavaOne-2015-How-I-Rediscovered-My-Coding-Mojo-by-Building-an-IoT-Robotics-Prototype-24-2048.jpg)
![var five = require("johnny-five");
var myBoard = new five.Board();
myBoard.on("ready", function() {
var myLed = new five.Led(13);
myLed.blink(500);
this.repl.inject({
replLed: myLed
});
});
Imports
J5
Dependancy
Adds
LED
instance
to
REPL
Declares
LED
as
connected
to
UNO
Pin
13
Blinks
LED
every
500
milliseconds
Code
block
triggered
by
UNO
”Ready”
Event
Ini]alises
UNO
Johnny-‐Five
Code
Example](https://image.slidesharecdn.com/javaonecodingmojo-151029171052-lva1-app6891/75/JavaOne-2015-How-I-Rediscovered-My-Coding-Mojo-by-Building-an-IoT-Robotics-Prototype-28-2048.jpg)
![GeSng
Started
with
Johnny-‐Five
1. Buy
an
Arduino
Experimenters
Kit.
2. Follow
the
tutorials
at
hSp://node-‐ardx.org.
3. Visit
hSp://johnny-‐five.io
for
more
informa]on
and
inspira]on.](https://image.slidesharecdn.com/javaonecodingmojo-151029171052-lva1-app6891/75/JavaOne-2015-How-I-Rediscovered-My-Coding-Mojo-by-Building-an-IoT-Robotics-Prototype-32-2048.jpg)
![Speech
Recogni]on
Requirements
Need
to
have
• Quality
and
speed
of
speech
recogni]on.
• Free,
no
restric]ons.
• Soware
based.
• JavaScript.
Nice
to
have
• Speech
to
text.
• One
stop
service.
• Bahle
tested.](https://image.slidesharecdn.com/javaonecodingmojo-151029171052-lva1-app6891/75/JavaOne-2015-How-I-Rediscovered-My-Coding-Mojo-by-Building-an-IoT-Robotics-Prototype-34-2048.jpg)
![Web
Speech
API
:
Configura]on](https://image.slidesharecdn.com/javaonecodingmojo-151029171052-lva1-app6891/75/JavaOne-2015-How-I-Rediscovered-My-Coding-Mojo-by-Building-an-IoT-Robotics-Prototype-38-2048.jpg)
![Why
Add
a
Message
Broker?
• Sepera]on
of
concerns.
• Isolate
main
components
for
easier
tes]ng.](https://image.slidesharecdn.com/javaonecodingmojo-151029171052-lva1-app6891/75/JavaOne-2015-How-I-Rediscovered-My-Coding-Mojo-by-Building-an-IoT-Robotics-Prototype-49-2048.jpg)
![MQTT
–
MQ
Telemetry
Transport
• Internet
of
Things
connec]vity
protocol.
• Designed
to
be
lightweight
with
a
small
footprint
and
lihle
overhead.
• Is
a
protocol
and
a
Pub-‐Sub
Message
Broker.
• Used
by
Facebook
for
pushing
updates
to
mobile
clients.](https://image.slidesharecdn.com/javaonecodingmojo-151029171052-lva1-app6891/75/JavaOne-2015-How-I-Rediscovered-My-Coding-Mojo-by-Building-an-IoT-Robotics-Prototype-50-2048.jpg)
![MQTT
Over
WebSockets
with
MQTT.js
• MQTT.js
is
a
Node.js
package
and
is
meant
for
use
on
the
Server
Side.
• To
allow
MQTT.js
to
run
from
the
Browser,
we
first
needed
to
”Browserify”
the
MQTT
library.
• We
could
then
access
the
”Browserified”
MQTT
client
library
from
the
Browser.
• This
solu]on
requires
that
your
MQTT
Broker
has
a
WebSocket
endpoint.](https://image.slidesharecdn.com/javaonecodingmojo-151029171052-lva1-app6891/75/JavaOne-2015-How-I-Rediscovered-My-Coding-Mojo-by-Building-an-IoT-Robotics-Prototype-53-2048.jpg)
![Node.js
Twiher
Client
• Fully
fledged
Twiher
Client:
– Asynchronous.
– Supports
REST
API
(write
and
write)
– Supports
Streaming
API
(events
and
tweets).
• Requires
developer
creden]als
from
Twiher:
– Trivial
to
get
hold
of.](https://image.slidesharecdn.com/javaonecodingmojo-151029171052-lva1-app6891/75/JavaOne-2015-How-I-Rediscovered-My-Coding-Mojo-by-Building-an-IoT-Robotics-Prototype-56-2048.jpg)
![Video
Streaming
via
Mo]on
• MoFon:
Soware
Mo]on
Detector.
• Provides
streaming
video
with
possibility
to
create
snapshots.
• Good
performance
on
the
Raspberry
PI.
• PotenFal
side
project:
get
Robot
to
follow
moving
objects?](https://image.slidesharecdn.com/javaonecodingmojo-151029171052-lva1-app6891/75/JavaOne-2015-How-I-Rediscovered-My-Coding-Mojo-by-Building-an-IoT-Robotics-Prototype-58-2048.jpg)
Uploaded byMark West
JavaOne 2015 : How I Rediscovered My Coding Mojo by Building an IoT/Robotics Prototype
The document details the journey of the author, Mark West, in rekindling his passion for coding through the development of a NodeBot Rover, integrating Arduino and Raspberry Pi technologies. It discusses various components and software used, such as Johnny-Five for robotics, MQTT for communication, and the Web Speech API for voice control. Additionally, it highlights resources and personal growth in programming skills acquired during this project.
More Related Content
Similar to JavaOne 2015 : How I Rediscovered My Coding Mojo by Building an IoT/Robotics Prototype
![Coded Agents – with UiPath SDK + LangGraph [Virtual Hands-on Workshop]](https://cdn.slidesharecdn.com/ss_thumbnails/codedagentsdeck-251215155422-5497c599-thumbnail.jpg?width=640&height=640&fit=bounds)
JavaOne 2015 : How I Rediscovered My Coding Mojo by Building an IoT/Robotics Prototype
- 1. How I Got Back my Coding Mojo! Mark West
- 2.
- 3.
- 7. “Any applica+on that can be wri3en in JavaScript, will eventually be wri3en in JavaScript” James Atwood (founder, stackoverflow.com)
- 10.
- 11.
- 12. NodeBot Rover Component Overview Hardware Computer Micro Controller Camera Chassis Pan & Tilt SoAware Speech Robot Control Web Server IntegraFon Other
- 13. The Arduino Ecosystem • MicroController plaLorm. • Many different Arduino models. • Open Source design. • MicroControllers extensible via “Shields”.
- 14. PuSng the Hardware Together
- 18. Two Servos for Camera Pan & Tilt Servos wired to Arduino Chassis Raspberry PI In PlasFc Case WIFI Dongle
- 19. Raspberry PI Camera Wired directly to the Raspberry PI
- 20.
- 21. Combining the Raspberry PI & Arduino Raspberry PI • Linux PC. • Supports USB peripherals. • Programming. Arduino PlaNorm • MicroController. • Robust. • Flexibility (input/output). The whole is greater than the sum of parts!
- 22.
- 23. NodeBot Rover Component Overview Hardware Raspberry PI Arduberry (Arduino) Pi Cam Zumo Chassis Servos SoAware Speech Robot Control Web Server IntegraFon Other
- 24.
- 25. The NodeBots Movement Source : nodebots.io
- 27. 1. Maturity 2. Community 3. DSL 4. Portability 5. Open Source 6. Node.js ecosystem 7. REPL Benefits of using Johnny-‐Five
- 28. var five =require("johnny-five"); var myBoard = new five.Board(); myBoard.on("ready", function() { var myLed = new five.Led(13); myLed.blink(500); this.repl.inject({ replLed: myLed }); }); Imports J5 Dependancy Adds LED instance to REPL Declares LED as connected to UNO Pin 13 Blinks LED every 500 milliseconds Code block triggered by UNO ”Ready” Event Ini]alises UNO Johnny-‐Five Code Example
- 29.
- 30.
- 32. GeSng Started with Johnny-‐Five 1. Buy an Arduino Experimenters Kit. 2. Follow the tutorials at hSp://node-‐ardx.org. 3. Visit hSp://johnny-‐five.io for more informa]on and inspira]on.
- 33. NodeBot Rover Component Overview Hardware Raspberry PI Arduberry (Arduino) Pi Cam Zumo Chassis Servos SoAware Speech Johnny-‐ Five Web Server IntegraFon Other
- 34. Speech Recogni]on Requirements Need to have • Quality and speed of speech recogni]on. • Free, no restric]ons. • Soware based. • JavaScript. Nice to have • Speech to text. • One stop service. • Bahle tested.
- 37. Web Speech API (limited to Google Chrome)
- 38. Web Speech API : Configura]on
- 39. Web Speech API : Events
- 40. Web Speech API : Control
- 41.
- 42. Buhon press and release connected to Web Speech API start and stop Control methods. Con+nuous dicta+on switched on, to avoid cuSng commands short. Interim results switched on – shown in green text (final results in white). Each set of results checked for uniqueness to avoid sending duplicate commands to the Robot. Web Speech API : Robot
- 43. NodeBot Rover Component Overview Hardware Raspberry PI Arduberry (Arduino) Pi Cam Zumo Chassis Servos SoAware HTML5 Speech Johnny-‐ Five Web Server IntegraFon Other
- 45. Node.js Express Web Server (17 lines of code)
- 46. NodeBot Rover Component Overview Hardware Raspberry PI Arduberry (Arduino) Pi Cam Zumo Chassis Servos SoAware Speech Johnny-‐ Five Express IntegraFon Other
- 47. Johnny-‐Five Process Express Process Raspberry PI 2 WE Browser HTTPS NodeBot Rover Hardware Firmata
- 48. Johnny-‐Five Process Express Process Raspberry PI 2 WE Browser HTTPS NodeBot Rover Hardware Firmata MQTT Message Broker MQTT MQTT over WebSockets Commands Acknowledgements MQTT.js Client MQTT.js Client
- 49. Why Add a Message Broker? • Sepera]on of concerns. • Isolate main components for easier tes]ng.
- 50. MQTT – MQ Telemetry Transport • Internet of Things connec]vity protocol. • Designed to be lightweight with a small footprint and lihle overhead. • Is a protocol and a Pub-‐Sub Message Broker. • Used by Facebook for pushing updates to mobile clients.
- 51. Adding MQTT to the NodeBot Rover Broker • Public MQTT Broker – Many Public Brokers exist. – One less process to run on Raspberry PI. Client • MQTT.js – Provides an MQTT client library for Node.js. – Extremely simple to use. – Integrates seamlessly with Johnny-‐Five.
- 52. MQTT.js (Node.js) Client Example
- 53. MQTT Over WebSockets with MQTT.js • MQTT.js is a Node.js package and is meant for use on the Server Side. • To allow MQTT.js to run from the Browser, we first needed to ”Browserify” the MQTT library. • We could then access the ”Browserified” MQTT client library from the Browser. • This solu]on requires that your MQTT Broker has a WebSocket endpoint.
- 54. MQTT Over WebSockets Demo
- 55. NodeBot Rover Component Overview Hardware Raspberry PI Arduberry (Arduino) Pi Cam Zumo Chassis Servos SoAware HTML5 Speech Johnny-‐ Five Express MQTT & WebSocket Other
- 56. Node.js Twiher Client • Fully fledged Twiher Client: – Asynchronous. – Supports REST API (write and write) – Supports Streaming API (events and tweets). • Requires developer creden]als from Twiher: – Trivial to get hold of.
- 57. Node.js Twiher Client REST Example
- 58. Video Streaming via Mo]on • MoFon: Soware Mo]on Detector. • Provides streaming video with possibility to create snapshots. • Good performance on the Raspberry PI. • PotenFal side project: get Robot to follow moving objects?
- 59. Other things I picked up • Git / GitHub • HTML5 • CSS • Linux
- 61. NodeBot Rover Component Overview Hardware Raspberry PI Arduberry (Arduino) Pi Cam Zumo Chassis Servos SoAware HTML5 Speech Johnny-‐ Five Express MQTT & WebSocket TwiSer/ MoFon/ Git/GitHub/ CSS/Linux
- 62. So Did I Get My Coding Mojo Back?
- 64.
- 67.