Robotics Vision
in Industry
Dr. Mohamed Elsayed Elawady
Lecturer, Data Science
Department of Computing Science and Mathematics
Faculty of Natural Sciences
University of Stirling
Oct 2022
mohamed.elawady@ieee.org
1
Agenda
•About Me
•Background
•Indonesia
•Summary
2
About Me: Education
•BSc of Computers & Informatics (Major: Computer
Science) - Suez Canal University, Egypt [2002 - 2007]
•Erasmus Mundus MSc Program in Computer Vision &
Robotics - Burgundy / Girona / Heriot-Watt Universities,
Europe [2012 - 2014]
•PhD in Computer Vision - Jean Monnet / Lyon University,
France [2014 - 2019]
3
About Me: Teaching I
•Undergraduate courses in computer science - Suez Canal
University, Egypt [2008-2012]
•Undergraduate courses in image processing - Telecom St-Etienne,
France [2014-2018]
•Postgraduate courses in computer vision - international masters
programs of Jean Monnet University (COSI, CIMET, 3DMT, MLDM),
France [2014-2017]
•Mentorship of academic & industrial internships - NTNU, Sorbonne,
ENS Scalay and Polytechnique, Europe [2018-2020]
4
About Me: Teaching II
•Coordinator for undergraduate courses in
computer science - University of Stirling, UK
[2020-Now] + Organizer with international
partners (UAE, Oman, China)
•Supervision of academic dissertations (Honors
and MSc) - University of Stirling, UK [2021-Now]
•Research committee member - 1st and 2nd
Year PhD VIVA [2020-Now]
✓RATE nominee: Excellence in Teaching in the
Faculty of Natural Science
✓RATE nominee: Dedication to Accessibility and
Inclusion in Blended Learning
5
About Me: Research
•Research Assistant - Computer Science Department, Suez Canal
University, Egypt [2008 - 2012] : Web Services
•Research Intern - Le2i Lab UMR CNRS 6306, France [2013] : Thermal
Imaging
•Research Intern - VisionLab, Heriot-Watt University, UK [2014]:
Underwater Image Classi
fi
cation using Deep Learning
•Doctoral Researcher - Hubert Curien Lab UMR CNRS 5516, France
[2014-2018]: Symmetry Detection in 2D images
•Lecturer, Data Science - University of Stirling, UK [2020-Now]: Computer
Vision
6
About Me: Industrial
•Computer Vision Researcher - Qopius / Trax [2018 - 2020]
•YouTube: [https://youtu.be/9Xo7YWbrVdU] [https://youtu.be/QD-xt8oW_T4]
•News: https://www.mediamarktsaturn.com/en/top-stories/app-desired-product
7
About Me: Robotics Vision
•Metralabs Tory
•Parrot AR Drone 2.0
•HWU ROV/AUV
•EPFL E-Puck
8
https://youtu.be/b4Fq5Jh08YI?t=45
Background: UN Goals
9
Background: Food I
•Chef Robots
• Moley Robotics
• Remy Robotics
10
Source: BBC News
https://youtu.be/78hpInIEhqU
•Waiter Robots
• Pudu Robotics
• Bear Robotics
https://youtu.be/spTPYFHy1QI
https://youtu.be/Dojvmqx49fw
https://youtu.be/fNpBDwYLi-Q
Background: Food II
•Delivery Robots
• Starship Technologies
• Amazon Air
11
Source: BBC News
•Retail Robots
• Bossa Nova Robotics
• Halodi Robotics
• Temi Robot
https://youtu.be/Z417CncwQsg
https://youtu.be/mzhvR4wm__M
https://youtu.be/BzEjiItbzB8
https://youtu.be/8gyWF43NcfA
https://youtu.be/ZsEano0qwcg
Background: Healthcare
•Surgical Robots
• CMR Surgical
• Intuitive Surgical
12
Source: BBC News
•Social Robots
• Aldebaran Robotics
• Blue Frog Robotics
https://youtu.be/YVWgRjWfD9k
https://youtu.be/6mhu4E_cZ5Q
https://youtu.be/XuwP5iOB-gs
https://youtu.be/KypYVagpYBk
Background: Infrastructure
•Inspection Robots
• Blue Atlas Robotics
• Perceptual Robotics
13
Source: BBC News
•Operation Robots
• OceanOneK
• Houston Mechatronics
• Equinor
https://youtu.be/H9yWzQ-JJlA
https://youtu.be/MLj7AqpPYhM
https://youtu.be/h2CLLBUpPZg
https://youtu.be/shimvNXyVtw
https://youtu.be/oFNeQln1f2c
Indonesia: AI x Robotics
14
Source: Wikipedia
https://cset.georgetown.edu/publication/indonesias-ai-promise-in-perspective/
AI-enabled companies focus on:
•Data Analytics (Eureka AI)
•Virtual Assistants (Katai.ai)
•Food Dietary (Snapcart)
•Transport / Ecosystem (Gojek)
•E-commerce (Tokopedia)
Robotics companies are hardware
distributers:
•Halo Robotics
•Masindo Robotics
Or still in early stages:
•Widya Robotics
Indonesia: Pollution
•Types:
• Air
• Noise
• Waste - Land / Water
• Plastic
15
https://aqli.epic.uchicago.edu/country-spotlight/indonesia/
Source: BBC News
•Solution?
• Robot (Drone, AUV / ROV)
• Sensor
• Air quality
• Water quality
• Microphone
• Multispectral
Indonesia: Traf
fi
c
16
•Issues:
• Accidents / Collisions
• Aggressive Driving
• Tailgating
Source: BBC News
•Solution?
• Robot (Drone, Tra
ffi
c Police)
• AI
• Law breaking
identi
fi
cation
• Vehicle tracking
• Tra
ffi
c sign recognition
https://www.dw.com/en/indonesia-managing-jakartas-infamous-tra
ffi
c-jams/
Indonesia: Deforestation
17
Source: BBC News
https://en.wikipedia.org/wiki/Deforestation_in_Indonesia
•Where:
• Borneo
• Papua
• Sumatra
•Why:
• Tobacco / Palm Oil
Plantation
• Agricultural Fires
•Solution?
• Robot (Drone) + Stations
• AI
• Fire detection
• Action Recognition
–Johnny Appleseed
Thanks for your attention!
Questions?
18

Robotics Vision in Industry: Indonesia

  • 1.
    Robotics Vision in Industry Dr.Mohamed Elsayed Elawady Lecturer, Data Science Department of Computing Science and Mathematics Faculty of Natural Sciences University of Stirling Oct 2022 mohamed.elawady@ieee.org 1
  • 2.
  • 3.
    About Me: Education •BScof Computers & Informatics (Major: Computer Science) - Suez Canal University, Egypt [2002 - 2007] •Erasmus Mundus MSc Program in Computer Vision & Robotics - Burgundy / Girona / Heriot-Watt Universities, Europe [2012 - 2014] •PhD in Computer Vision - Jean Monnet / Lyon University, France [2014 - 2019] 3
  • 4.
    About Me: TeachingI •Undergraduate courses in computer science - Suez Canal University, Egypt [2008-2012] •Undergraduate courses in image processing - Telecom St-Etienne, France [2014-2018] •Postgraduate courses in computer vision - international masters programs of Jean Monnet University (COSI, CIMET, 3DMT, MLDM), France [2014-2017] •Mentorship of academic & industrial internships - NTNU, Sorbonne, ENS Scalay and Polytechnique, Europe [2018-2020] 4
  • 5.
    About Me: TeachingII •Coordinator for undergraduate courses in computer science - University of Stirling, UK [2020-Now] + Organizer with international partners (UAE, Oman, China) •Supervision of academic dissertations (Honors and MSc) - University of Stirling, UK [2021-Now] •Research committee member - 1st and 2nd Year PhD VIVA [2020-Now] ✓RATE nominee: Excellence in Teaching in the Faculty of Natural Science ✓RATE nominee: Dedication to Accessibility and Inclusion in Blended Learning 5
  • 6.
    About Me: Research •ResearchAssistant - Computer Science Department, Suez Canal University, Egypt [2008 - 2012] : Web Services •Research Intern - Le2i Lab UMR CNRS 6306, France [2013] : Thermal Imaging •Research Intern - VisionLab, Heriot-Watt University, UK [2014]: Underwater Image Classi fi cation using Deep Learning •Doctoral Researcher - Hubert Curien Lab UMR CNRS 5516, France [2014-2018]: Symmetry Detection in 2D images •Lecturer, Data Science - University of Stirling, UK [2020-Now]: Computer Vision 6
  • 7.
    About Me: Industrial •ComputerVision Researcher - Qopius / Trax [2018 - 2020] •YouTube: [https://youtu.be/9Xo7YWbrVdU] [https://youtu.be/QD-xt8oW_T4] •News: https://www.mediamarktsaturn.com/en/top-stories/app-desired-product 7
  • 8.
    About Me: RoboticsVision •Metralabs Tory •Parrot AR Drone 2.0 •HWU ROV/AUV •EPFL E-Puck 8 https://youtu.be/b4Fq5Jh08YI?t=45
  • 9.
  • 10.
    Background: Food I •ChefRobots • Moley Robotics • Remy Robotics 10 Source: BBC News https://youtu.be/78hpInIEhqU •Waiter Robots • Pudu Robotics • Bear Robotics https://youtu.be/spTPYFHy1QI https://youtu.be/Dojvmqx49fw https://youtu.be/fNpBDwYLi-Q
  • 11.
    Background: Food II •DeliveryRobots • Starship Technologies • Amazon Air 11 Source: BBC News •Retail Robots • Bossa Nova Robotics • Halodi Robotics • Temi Robot https://youtu.be/Z417CncwQsg https://youtu.be/mzhvR4wm__M https://youtu.be/BzEjiItbzB8 https://youtu.be/8gyWF43NcfA https://youtu.be/ZsEano0qwcg
  • 12.
    Background: Healthcare •Surgical Robots •CMR Surgical • Intuitive Surgical 12 Source: BBC News •Social Robots • Aldebaran Robotics • Blue Frog Robotics https://youtu.be/YVWgRjWfD9k https://youtu.be/6mhu4E_cZ5Q https://youtu.be/XuwP5iOB-gs https://youtu.be/KypYVagpYBk
  • 13.
    Background: Infrastructure •Inspection Robots •Blue Atlas Robotics • Perceptual Robotics 13 Source: BBC News •Operation Robots • OceanOneK • Houston Mechatronics • Equinor https://youtu.be/H9yWzQ-JJlA https://youtu.be/MLj7AqpPYhM https://youtu.be/h2CLLBUpPZg https://youtu.be/shimvNXyVtw https://youtu.be/oFNeQln1f2c
  • 14.
    Indonesia: AI xRobotics 14 Source: Wikipedia https://cset.georgetown.edu/publication/indonesias-ai-promise-in-perspective/ AI-enabled companies focus on: •Data Analytics (Eureka AI) •Virtual Assistants (Katai.ai) •Food Dietary (Snapcart) •Transport / Ecosystem (Gojek) •E-commerce (Tokopedia) Robotics companies are hardware distributers: •Halo Robotics •Masindo Robotics Or still in early stages: •Widya Robotics
  • 15.
    Indonesia: Pollution •Types: • Air •Noise • Waste - Land / Water • Plastic 15 https://aqli.epic.uchicago.edu/country-spotlight/indonesia/ Source: BBC News •Solution? • Robot (Drone, AUV / ROV) • Sensor • Air quality • Water quality • Microphone • Multispectral
  • 16.
    Indonesia: Traf fi c 16 •Issues: • Accidents/ Collisions • Aggressive Driving • Tailgating Source: BBC News •Solution? • Robot (Drone, Tra ffi c Police) • AI • Law breaking identi fi cation • Vehicle tracking • Tra ffi c sign recognition https://www.dw.com/en/indonesia-managing-jakartas-infamous-tra ffi c-jams/
  • 17.
    Indonesia: Deforestation 17 Source: BBCNews https://en.wikipedia.org/wiki/Deforestation_in_Indonesia •Where: • Borneo • Papua • Sumatra •Why: • Tobacco / Palm Oil Plantation • Agricultural Fires •Solution? • Robot (Drone) + Stations • AI • Fire detection • Action Recognition
  • 18.
    –Johnny Appleseed Thanks foryour attention! Questions? 18