A discussion on AI and Edge which was held for a virtual meetup in Eindhoven technical community. You can also find a recording https://www.meetup.com/Technical-Enablement-for-High-Tech-developers/events/270314133/

1. IBM Meetup Session
AI and Edge computing
Eric Cattoir - IT Specialist IBM Cloud Europe
@CattoirEric
eric_cattoir@be.ibm.com

2. © 2020 IBM Corporation 2
Topics
• Edge computing and its edges
• Edge management challenges
• Some client cases
• IBM Edge Application Manager offering
• How does it work?

3. © 2020 IBM Corporation 3
Edge …
Improves business:
Outcomes (in real-time)
Resiliency
Security
A distributed computing
architecture which brings
computation closer to the
location where data is
created and needs to be
acted upon.

4. © 2020 IBM Corporation 4
Edge Computing will reshape every industry…including
KiosksFinancial HealthcareVehicles
Insurance RetailManufacturing Distribution
Comply with data regulations
and improve client experience
Reduce downtime, improve
throughput, quality and worker
safety
Improve driver experience and
reduce cost of operations
Improve resiliency and agility and
enable evolution to autonomous
operations
Improve client experience, lower
cost of operations and higher
security
Improve client experience and
safety, and protect privacy
Improve patient experience and
improve data privacy and
security
Improve client experience and
reduce operational and
inventory costs

5. © 2020 IBM Corporation 5
…
IOT meets Edge
Specialized
development
environments

6. © 2020 IBM Corporation 6
Delivering application and AI to the edge
Edge Application
and AI model
management…
Standard IT
development
environments

7. © 2020 IBM Corporation 7
Delivering application and AI to the edge
Edge Application
and AI model
management…

8. © 2020 IBM Corporation 7
Delivering application and AI to the edge
Edge Application
and AI model
management…
The need: Respond to events in real
time
Required: 5G/PLTE + Edge
Computing Platform + AI & Video
The need: Reduce human effort and
improve quality
Required: 5G + Edge Computing
Platform + Visual analytics
The need: Optimize efficiency and
reduce POS anomalies
Required: 5G + Edge Computing
Platform + AI & analytics + POS

9. © 2020 IBM Corporation 8
Edge Computing edges and their ecosystem
Edge cloudsFar Edge
Connected Devices
Device
Edge
Mobile Private Network (MPN)
Site
Edge
Private LTE/5G
5G
Network Aggregation sites
Regional Edge
5G
Centralized core cloud
Central Hybrid Cloud
Mobile network Sites
Network Aggregation sites
3th party / Hyperscale XaaS
Colocation clouds
Regional Colocation clouds
Public Mobile or Fixed Network
Telco Edge Telco Core

10. © 2020 IBM Corporation 9
Autonomous Management with IBM Edge Application Manager
Autonomous management
actions such as, negotiation,
agreement, execution,
on-going validation of workloads
Between IBM Edge Application
Manager & Edge endpoints
using a lightweight Edge agent
Based on administrator intent,
but without admin intervention,
even during new endpoint
onboarding
To address the scale, variability
and rate of change of Edge
topologies
Massive scale, variability and rate of change requires new style of management

11. © 2020 IBM Corporation 9
Autonomous Management with IBM Edge Application Manager
Autonomous management
actions such as, negotiation,
agreement, execution,
on-going validation of workloads
Between IBM Edge Application
Manager & Edge endpoints
using a lightweight Edge agent
Based on administrator intent,
but without admin intervention,
even during new endpoint
onboarding
To address the scale, variability
and rate of change of Edge
topologies
Massive scale, variability and rate of change requires new style of management

12. © 2020 IBM Corporation 10
Worker insight and safety - Industry 4.0/Construction/manufacturing
Visual combined met sensory analytics
Hazards
Detection
GPS Sensor:
Location
Accelerometer:
Speed-X
Speed-Y
Speed-Z
Bio-sensing:
Heart-rate
Body temperature
Environmental-sensing:
Temperature
Light
Noise
Oxygen deficiency
Carbon monoxide
Analytics - Detection (real-time) / Predictive
IBM IoT Worker Insights
with IoT Platform
Overexertion
Heat stress
Helmet Off
Fatigue
Panic
Falls
Alert employee
Inform supervisor and
emergency center
Broadcast message
to nearby employees
Sensors are worn by employees which monitor data such as heartbeat, acceleration, skin
temperature, humidity and outside weather conditions.
If hazards are detected, workers, nearby colleagues and supervisors are notified.
Action can be taken to prevent serious injuries and emergency services can be called for
assistance.
https://github.com/johnwalicki/EdgeComputing-WorkerSafety-HardHat-Detection

13. © 2020 IBM Corporation 11
Autonomous
management
Sensors
Personalized
options
Digital Twin
Real time remote
monitoring
35%-50%
Reduced Operational Cost
???%
Fraude prevention
Kiosk ATM or Other
(MVP with client)
Visual recognition of
the individual and
surrounding
Real-time fraud and
harm prevention
Improved user
experience

14. © 2020 IBM Corporation 12
IBM Edge Application Manager

15. © 2020 IBM Corporation 13
IBM Edge Computing
IBM Services for Edge Applications, and Enterprise Network
Clouds
IBM Edge Application Manager
5G 5G
Network edge
Central cloudsEdge devices Edge clusters and gateways
https://www.lfedge.org/members/

16. © 2020 IBM Corporation 14
IBM Edge Application Manager Capabilities
Autonomous
Industry’s first autonomous
workload lifecycle management
edge offering with edge-native
programming model
Secure
Firewall ready, prevents common
attacks, encrypted & signed
messages, container tampering &
update verification
Flexible
Consistent visibility, control and
automation for managing and
scaling workloads from edge to core
and across any hybrid multi-cloud
environment, even when
disconnected
Support for Red Hat OpenShift Platform v4.3
Improved Scalability up to 10,000 endpoints
per Edge Hub
Simpler developer experience with Edge
Native Programming model best practices
guidance
Enhanced user experience across install,
deploy, manage and filtering tasks
Broader Edge Device support via Debian OS
support for Edge Computing Manager Agent
Faster onboarding of Edge Nodes via batch
installation

17. © 2020 IBM Corporation 15
How Does It Work?

18. © 2020 IBM Corporation 16
Key concepts
Workloads are micro-services packaged as Containers – either individual or a grouped collection
Workload is placed on individual nodes as the result of an Agreement that is negotiated between the device
Agent and an Agreement-Bot (AgBot)
Negotiations are predicated on a set of expressed conditions: either a Pattern or a Policy
The Agent and the AgBot actively monitor that the negotiated agreements remains valid in the presence of
changing conditions

19. © 2020 IBM Corporation 17
IBM Edge Application Manager - Autonomous Management Terminology
Edge Nodes are physical edge endpoints
Workloads are business logic microservices and/or AI/Analytics
models packaged into one or more containers
Management Hub is the centralized single pane of glass for
management actions, often deployed in a public or private cloud
Edge Agent software runs on Edge Nodes, is used to express the
capabilities and properties of the Edge Node and is part of the
autonomous management platform
Administrator intent is captured in YAML files that express the
needs and constraints of a particular workload, and stored in the
Exchange
Exchange runs on the Management hub and is an encrypted peer-to-
peer message mailbox system, one mailbox per Edge Agent, that each
Edge Agent checks continuously to verify if there are new or updated
workloads to deploy
Agreement Bot (AgBot) runs on the Management Hub and is used to
form agreements between the Edge Agent and messages in the
Exchange
Workload Placement occurs on individual Edge Nodes as the result of
an Agreement that is negotiated between the Edge Agent and the AgBot
based on the conditions expressed by the Administrator and the
capabilities and properties of the Edge Node
Continuous Verification of negotiated agreements in the presence of
changing conditions is carried out by the AgBot and Node Agent

20. © 2020 IBM Corporation 18
IBM Edge Application Manager Components
IEAM Agent
• Register node
• Negotiate agreements
• Model synchronization
• Monitor agreement conditions
IEAM Agent
Agreement Bot (AgBot) Model Manager
Switchboard
• P2P messaging service,
unique peer per IEAM Agent
• Encrypted
• Eavesdropping prevention
• AI/ML model
synchronization without
workload downtime
• Negotiate agreement with
each IEAM Agent
• Autonomous placements
• Set agreement status
System
State
Model
Repository
Exchange
• Edge node registration
• Service Publication
• Status Queries
Container Registry
RHEL + OCP
Edge Management Hub
Centralized Public/Private CloudEdge Locations
Common Services
Devices Clusters

21. © 2020 IBM Corporation 19
Device pre-reqs
1. Supported Architectures (ARM32v6,v7, ARM64v8,
x86, MacOS)
2. Linux capable (RHEL, ubuntu, debian, raspbian)
3. Container environment (Docker)
– privileged access
– File system to load the docker images
4. IEAM Agent (OpenHorizon) activation
– 30MB for binaries
– SCP or equivalent
– Command line or equivalent
5. HTTPS (REST-API)
6. File system access for applications needing
persistence

22. March 11, 2020 20
Secure Data Protection
• A focus on policy & privacy for
regulated industries
• Signed workloads with runtime
isolation and data encryption
• Compliance supported with
reporting and auditing
Innovation with specialized
platform-services
• Rich catalog of services such as
Watson AI, IVA, IoT, etc.
• Machine / Deep Learning in the
cloud and at the edge
1 3 4
Portable Open technology
Private, Public, and Edge
• Open Kubernetes/container for
app delivery
• Open source for data, messaging,
and caching services
• OpenPOWER, x86 and ARM
hardware
• Built on Open Horizon OSS project
2
Management of edge workloads
Governance, Automation, Visibility
• Common management and
orchestration across clusters and
edge
• Policy-based role and compliance
management
• Event & service management
Thousands of gateways/servers and millions of devices.
Enterprise grade. Open by design.
4 Key Tenets of IBM Edge Computing Manager
Management at
enormous scale
Open source
technologies
Data
Protection
Value add
capabilities

23. © 2020 IBM Corporation 21
Demo
https://cloudsalesdemos3.mybluemix.net/hc/edge-application-manager-workload-management/index.html

24. © 2020 IBM Corporation 22
Demo
https://vimeo.com/385261159/42d584b65b
https://www.youtube.com/watch?v=CCWbVjVqH20

25. © 2020 IBM Corporation 23
Useful links
Online documentation:
–https://www.ibm.com/support/knowledgecenter/SSFKVV_4.0/kc_welcome_containers.html
–https://www.ibm.com/cloud/architecture/architectures/edge-computing
–https://www.ibm.com/cloud/blog/policies-at-the-edge
IBM Think Conference Announcements
–https://www.ibm.com/widget/ibm/think20/Ondemand?search.cloudsubtopics=1575391031579006z9p7
Open Source
–https://www.lfedge.org/
–https://github.com/open-horizon/
Learning module
–https://learn.ibm.com/course/view.php?id=6944
Demo Materials
–https://github.com/open-horizon/examples/tree/master/edge/services/helloworld

26. © 2020 IBM Corporation 24