Fares S. Al-Qunaieer
Engineering Consultant in Artificial Intelligence at SITE | Google
Developer Expert (GDE) in Machine Learning
7 September 2020
AI is a field in
Computer Science
that concerns on
developing
algorithms that
mimic human
intelligence
Artificial Intelligence
Problem Solving
Perception
Natural Language
Processing
Planning Knowledge
Representation
Machine LearningReasoning
Input Consume Compute
request
response
Data transmission
Data transmission
Latency (Performance)
Data transmission
Latency (Performance)
Scalability
Data transmission
Latency (Performance)
Scalability
User Experience
Data transmission
Latency (Performance)
ScalabilityPrivacy Concerns
User Experience
Data transmission
Latency (Performance)
Scalability
Security Risks
Privacy Concerns
User Experience
• Performing the computation locally
• Distribute the computation across the network
• Perform computations close to the data source
• Security and surveillance
• Removing Personally Identifiable Information (PII)
• Image quality check
• Autonomous cars
• Predictive maintenance
• Medical monitoring devices
Data transmission
Latency (Performance)
Scalability
Security Risks
Privacy Concerns
User Experience
Input Consume/Compute
Algorithms Hardware Capturing
Algorithms Hardware Capturing
Small networks
QuantizationSmall networks
Quantization PruningSmall networks
Image source: https://towardsdatascience.com/pruning-deep-neural-network-56cae1ec5505
Quantization Pruning
Knowledge Distillation
Small networks
Image source: https://nervanasystems.github.io/distiller/knowledge_distillation.html
Quantization Pruning
Knowledge Distillation
Small networks
Distributed Deep Neural
Networks (DDNN)
Image source: Machine Learning at the Network Edge: A Survey, M.G. Sarwar Murshed et. al, 2019
Federated and split learning
Quantization Pruning
Knowledge Distillation
Small networks
Distributed Deep Neural
Networks (DDNN)
Federated and split learning
Quantization Pruning
Knowledge Distillation
Small networks
Distributed Deep Neural
Networks (DDNN)
Image source: https://proandroiddev.com/federated-learning-e79e054c33ef
Image source: https://splitlearning.github.io
Algorithms Hardware Capturing
Graphics Processing
Unit (GPU)
Video source: https://www.youtube.com/watch?v=-P28LKWTzrI
Graphics Processing
Unit (GPU)
AI Accelerators
Graphics Processing
Unit (GPU)
Tensor Processing
Unit (TPU)
AI Accelerators
Graphics Processing
Unit (GPU)
Tensor Processing
Unit (TPU)
AI Accelerators
Field Programmable
Gate Array (FPGA)
Graphics Processing
Unit (GPU)
Tensor Processing
Unit (TPU)
AI Accelerators
Field Programmable
Gate Array (FPGA)
Application Specific
Integrated Circuit (ASIC)
Algorithms Hardware Capturing
Embedded Sensors
Embedded Sensors
Text / Speech / Images
Embedded Sensors
Text / Speech / Images
Event Cameras
Fares S. Al-Qunaieer
Website: www.qunaieer.com
Twitter: @qunaieer
LinkedIn: https://www.linkedin.com/in/qunaieer

Artificial Intelligence at the Edge - الذكاء الاصطناعي على الأجهزة الطرفية