Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
MULTIMODAL AI
APPROACH TO PROVIDE
ASSISTIVE SERVICES
Francesco Puja
Research Technology Manager
Konica Minolta Laboratory ...
© 2018 Konica Minolta, Inc. 2
KONICA MINOLTA
140-year-old history: Innovation is in our DNA
1870
Released the
digital prin...
© 2018 Konica Minolta, Inc. 3
SALES BREAKDOWN BY REGION
(FY 2016)
8.1Billion€
Consolidated
net sales
as of 31st March 2017...
© 2018 Konica Minolta, Inc. 4
KONICA MINOLTA EUROPE
In numbers
2.43
Billion €
Consolidatednetsales
as of 31st March2017
CL...
© 2018 Konica Minolta, Inc. 5
Source: Konica Minolta Intellectual Property Report 2017, Konica Minolta, Inc.
€ 613 Million...
© 2018 Konica Minolta, Inc. 6
Konica Minolta Laboratory Europe
Who we are
2015
Research as a transformative
process to dev...
© 2018 Konica Minolta, Inc. 7
Konica Minolta Laboratory Europe
Where we are
Brno Munich
London
Headquarters and Exploratio...
© 2018 Konica Minolta, Inc. 8
ResearchAreas
Developing business opportunities and innovative applications
Computer Vision ...
© 2018 Konica Minolta, Inc.
Key Points
• Innovation: what does it mean?
9
Research
Applied
Research
Real Worl
Problems
• A...
© 2018 Konica Minolta, Inc.
3-way approach
10
Human needs
Human roles in
different contexts
Ecosystem analysis and its com...
© 2018 Konica Minolta, Inc.
What we do: Assistive AI Services
Assistive Services are services that increase, maintain, imp...
© 2018 Konica Minolta, Inc.
What we do: Our challenge to provide assistive AI services
Our challenge is to create new cogn...
© 2018 Konica Minolta, Inc.
How we do it
It is an extended and intelligent perception……
© 2018 Konica Minolta, Inc.
How we do it
….. of the digital world into the physical world
© 2018 Konica Minolta, Inc. 15
© 2018 Konica Minolta, Inc. 16
Vomiting
Back pain
Chest pain
Human Activity Recognition
© 2018 Konica Minolta, Inc. 17
Human Activity Recognition
© 2018 Konica Minolta, Inc.© 2016 Konica Minolta, Inc.Confidential – Internal Use
18
Face Recognition – Age & Gender Estim...
© 2018 Konica Minolta, Inc.
Activities recognized with
accuracy greater than 0.9
Human Activity Recognition
© 2018 Konica Minolta, Inc.
Activities recognized with
accuracy greater than 0.9
Human Activity Recognition
© 2018 Konica Minolta, Inc.
Activities recognized with
accuracy greater than 0.9
Human Activity Recognition
© 2018 Konica Minolta, Inc.
Activities recognized with
accuracy greater than 0.9
Human Activity Recognition
© 2018 Konica Minolta, Inc.
Live Demo
Konica Minolta Dealer Conference 2019 – Los Angeles
https://youtu.be/LmcSy_Sqjcs
© 2018 Konica Minolta, Inc.
PoC: Hospital Environment
• https://youtu.be/vmqL-YEnKGg
• https://youtu.be/GgLX67rOrDM
© 2018 Konica Minolta, Inc. 26
Thank you
http://research.konicaminolta.eu
http://workplacehub.konicaminolta.com/
Multimodal AI Approach to Provide Assistive Services (Francesco Puja)
Upcoming SlideShare
Loading in …5
×

Multimodal AI Approach to Provide Assistive Services (Francesco Puja)

149 views

Published on

Presentazione dal Meetup del Machine Learning / Data Science Meetup di Roma - Giugno 2019:
https://www.meetup.com/it-IT/Machine-Learning-Data-Science-Meetup/events/262120815/

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Multimodal AI Approach to Provide Assistive Services (Francesco Puja)

  1. 1. MULTIMODAL AI APPROACH TO PROVIDE ASSISTIVE SERVICES Francesco Puja Research Technology Manager Konica Minolta Laboratory Europe
  2. 2. © 2018 Konica Minolta, Inc. 2 KONICA MINOLTA 140-year-old history: Innovation is in our DNA 1870 Released the digital printing system “bizhub PRESS” 1900 1970 1960 1873 Rokusaburo Sugiura sets up Konica Corporation 1903 Created “Cherry Hand Camera”, Japan’s first brand name camera 1960 Completed the company’s first copier “Minolta Copymaster” 1962 The first pictures of earth taken from space with a Minolta Hi-Matic (during John Glenn’s ‘Friendship 7’ space flight) 1975 Released the world’s first 35mm camera with built-in flash and AE functions “C35EF” 1977 The world’s first finger-measurement type pulse oximeter 1984 Developed an ultra-high-precision aspheric plastic lens for CD players 1992 Became the first company worldwide to receive a Blue Angel mark in the field of copying 1980 2000 2017 2003 Konica and Minolta merge to form Konica Minolta 2010 2011 Released wireless DR system “AeroDR” to meet the demandsof an increased digitization in the healthcare sector and reduce the amount of x-ray radiation to patients 2012 Opened the Konica Minolta Planetarium “Tenku”, Japan’s second most popular planetarium Set up of yhe European network of R&D laboratories developing projects about digital workplaces 2014 Launched the first Business Innovation Centre (BIC) in London Named Leader in Gartner Magic Quadrant 2014 for Managed Print Services (MPS) and Managed Content Services (MCS) 2010 2005 Released the world’s first Mammography to use phase contrast technology 2007 Left the photo and camera business 2002 Developed Simitri – the world’s first polymerized toner with biomass. Along with economical production reduces CO2 and NOx emissions by up to 40% 1990 2015 2014 Launch of Workplace Hub Portfolio 1928 Tashima set up Nichi-Doku Shashinki Shoten (later known as Minolta Co.) Konica Minolta Laboratory Europe
  3. 3. © 2018 Konica Minolta, Inc. 3 SALES BREAKDOWN BY REGION (FY 2016) 8.1Billion€ Consolidated net sales as of 31st March 2017 Approx.44,000Employees worldwide 150countries 23% ASIA&OTHER 20% JAPAN 2 Million CUSTOMERS WORLDWIDE 31% EUROPE 26% NORTHAMERICA KONICA MINOLTA Facts and Figures
  4. 4. © 2018 Konica Minolta, Inc. 4 KONICA MINOLTA EUROPE In numbers 2.43 Billion € Consolidatednetsales as of 31st March2017 CLUSTERWEST CLUSTEREAST CLUSTERSOUTH CLUSTERNORDIC BEU OTHERS 28% 13% 25% 7% 8% 19% SALES BREAKDOWN BY CLUSTER (FY 2016) Employees throughout Europe contribute to help our clients concentrate on what they do best: their business Approx. 9,700 countries with sales subsidiaries/National Operating Companies (NOCs) 30 Countries throughout EuropeActivein 51 200,000 CUSTOMERS IN EUROPE Founded in 1965
  5. 5. © 2018 Konica Minolta, Inc. 5 Source: Konica Minolta Intellectual Property Report 2017, Konica Minolta, Inc. € 613 Million R&D EXPENDITURES 21,652 TOTAL NUMBER OF PATENTS REGISTERED INNOVATION Investments in R&D
  6. 6. © 2018 Konica Minolta, Inc. 6 Konica Minolta Laboratory Europe Who we are 2015 Research as a transformative process to develop products and services for smart systems and digital workplace Customers’ needs as a focus of development We test innovative ideas through experiments, POC and prototype demonstration Our results provide Konica Minolta with the baseline for developing new solutions
  7. 7. © 2018 Konica Minolta, Inc. 7 Konica Minolta Laboratory Europe Where we are Brno Munich London Headquarters and Exploration Lab est. May 2015 Digital Workplace Lab est. October 2015 Digital Healthcare Lab est. May 2017 Rome Physical workplace and Smart Systems Lab est. February 2018 7 52 in total Strategic Planning Partnership and Portfolio Management Cognitive Computing Distributed Robotics Living Lab Semantic Technologies Data Analytics IoT (HW/Sensors) Human Computer Interaction Computer Vision Medical Imaging Computing Diagnostics Decision Support Precision Medicine Sensors and Robotics AI Core Computational Platforms IoT (Platforms) Robotics Cyber Security Communication • In FY18: 4 locations over Europe • Most recently added facility in Rome • The Labs deliver proof of concepts and prototypes up to SG4 • Working with DWP Portfolio Extension Team and DWP Technical Development Team on the handover between SG3 and SG4 and supporting the stage beyond towards commercialisation • Potential R&D Tax Incentives jointly generated by KMLE and WPH in ITaly during FY18 ~1.700k€
  8. 8. © 2018 Konica Minolta, Inc. 8 ResearchAreas Developing business opportunities and innovative applications Computer Vision and Image Processing Internet of Things Semantic technologies and Smart data systems Distributed Robotics Human Computer Interaction Fog cloud distributed edge computing
  9. 9. © 2018 Konica Minolta, Inc. Key Points • Innovation: what does it mean? 9 Research Applied Research Real Worl Problems • Address Complex Problems: – requires a varied and multi-disciplinary approach – synergistic work of cutting-edge technology of different technological macro-areas Cloud/Edge ML + Deep Learning Computer Vision
  10. 10. © 2018 Konica Minolta, Inc. 3-way approach 10 Human needs Human roles in different contexts Ecosystem analysis and its components Technologies that boost and support work environment alongside humans Human-Centered Approach several interconnected technologies able to solve classes of problems Robotics/IoT Computer Vision NLP Distributed Cloud Inteligence ML – Deep Learning AI Extended perception Fall detection alarm!! Overnight monitorin g (Infrared Thermal Cameras) ! ! ! Vibration sensors on floor Temperature: High Breath level: irregular Engagement: low Stress risk Reduce workload Assistive Skills Psychophysical Status Assessment Extended perception Engagement and patient interaction T = 37°C HR = 70 BPM Identity: Bob T = 39°C HR = 150 BPM Alert! Alert! Continuous Monitoring and data collection Assistance for Facility Management Realize/Test in real workplace scenarios
  11. 11. © 2018 Konica Minolta, Inc. What we do: Assistive AI Services Assistive Services are services that increase, maintain, improve people’s capabilities. Assistive Services enhance how people perceive, understand, and influence the world Cutting edge technologies combine data from different sources to enable innovative customized assistive services
  12. 12. © 2018 Konica Minolta, Inc. What we do: Our challenge to provide assistive AI services Our challenge is to create new cognitive services able to address partners’ real needs A cognitive service is a supporting solution able to: pay attention to the world by watching and listening it; analyze the context; proactively assist user’s decision process; To achieve this goal we develop a set of functionalities based on the cutting-edge technologies. Through cognitive services, we orchestrate distributed devices and provide assistive services. the world through different sensors the context using cutting-edge tech the environment using robotics PERCEIVE UNDERSTAND INFLUENCE ORCHESTRATE
  13. 13. © 2018 Konica Minolta, Inc. How we do it It is an extended and intelligent perception……
  14. 14. © 2018 Konica Minolta, Inc. How we do it ….. of the digital world into the physical world
  15. 15. © 2018 Konica Minolta, Inc. 15
  16. 16. © 2018 Konica Minolta, Inc. 16 Vomiting Back pain Chest pain Human Activity Recognition
  17. 17. © 2018 Konica Minolta, Inc. 17 Human Activity Recognition
  18. 18. © 2018 Konica Minolta, Inc.© 2016 Konica Minolta, Inc.Confidential – Internal Use 18 Face Recognition – Age & Gender Estimation
  19. 19. © 2018 Konica Minolta, Inc. Activities recognized with accuracy greater than 0.9 Human Activity Recognition
  20. 20. © 2018 Konica Minolta, Inc. Activities recognized with accuracy greater than 0.9 Human Activity Recognition
  21. 21. © 2018 Konica Minolta, Inc. Activities recognized with accuracy greater than 0.9 Human Activity Recognition
  22. 22. © 2018 Konica Minolta, Inc. Activities recognized with accuracy greater than 0.9 Human Activity Recognition
  23. 23. © 2018 Konica Minolta, Inc. Live Demo Konica Minolta Dealer Conference 2019 – Los Angeles https://youtu.be/LmcSy_Sqjcs
  24. 24. © 2018 Konica Minolta, Inc. PoC: Hospital Environment • https://youtu.be/vmqL-YEnKGg • https://youtu.be/GgLX67rOrDM
  25. 25. © 2018 Konica Minolta, Inc. 26 Thank you http://research.konicaminolta.eu http://workplacehub.konicaminolta.com/

×