SlideShare a Scribd company logo
1 of 41
Download to read offline
© Integrated Computer Solutions, Inc. All Rights Reserved
Automotive Media Management
in Future IVI Systems
Roland Krause Ph.D., Director of Engineering
www.ics.com
1
© Integrated Computer Solutions, Inc. All Rights Reserved
Leaving the Driver Seat
Profound changes in how people experience Automotive Transportation
• Car ownership percentage among 16-34 year olds is still on a declining path
2
© Integrated Computer Solutions, Inc. All Rights Reserved
Some Trends in the Automotive Market
There is a discussion about whether car sharing is replacing ownership!
• Car sharing changes how we view and interact with transportation
• It drives new and different use cases and expectations
• Ride Apps, advertising options, etc..
• Among 18- to 24-year-olds, 64% said they expected their vehicle’s technology
to be able to do all the things that a smartphone can do; that compared with
56% of Gen X respondents*
Add to that changes in technology such as driver assist and fully
autonomous driving
3
*Source: Cox Automotive
© Integrated Computer Solutions, Inc. All Rights Reserved
Consequences for In-Vehicle-Infotainment
Shared automotive experience
• While it doesn’t really matter which car comes to pick you up it still matters to
have a consistent user experience
• Convenient, easy, flexible and fast adapting to new technologies, trends and
applications
• ByoD, wearables, etc. require much faster updates and more intelligence in an
automobile
• Convergence of ubiquitous technologies is mandatory
• unless one of them will replace the car IVI altogether
4
© Integrated Computer Solutions, Inc. All Rights Reserved
Steps to Autonomous Driving - Level 2
5
• Driver is disengaged from
physically operating the vehicle.
• The driver must still always be
ready to take control of the
vehicle.
• This does not open significantly
different infotainment options,
however improved convergence
and integration options are likely
to bring value for all passengers
of vehicles
© Integrated Computer Solutions, Inc. All Rights Reserved
Steps to Autonomous Driving - Level 3
6
• Completely shift "safety-critical
functions" to the vehicle.
• Under certain traffic or
environmental conditions.
• Driver is still present and will
intervene if necessary, but is not
required to monitor the
situation in the same way as for
previous levels.
© Integrated Computer Solutions, Inc. All Rights Reserved
Steps to Autonomous Driving - Level 4+
• Fully autonomous.
• Vehicles designed to perform all
safety-critical driving functions
and monitor roadway conditions
for an entire trip.
• Limited to the "operational
design domain (ODD)"
• At level 5 the vehicle's
performance is expected to
equal that of a human driver, in
every driving scenario.
7
© Integrated Computer Solutions, Inc. All Rights Reserved 8
(In) vehicle experience is now
distinguishing factor as horse power
no longer matters
© Integrated Computer Solutions, Inc. All Rights Reserved
New Opportunities Determine Requirements
for Vehicle Entertainment
9
© Integrated Computer Solutions, Inc. All Rights Reserved
Common Functionality
Common to all levels is that
the IVI still needs to provide
functionality to interact with
the vehicle
• HVAC
• Interior such as lighting,
seats, doors and windows
• Controlled by touchscreens
or voice, similar to smart
homes
10
“Alexa, set the front temperature to 72 degrees.”
© Integrated Computer Solutions, Inc. All Rights Reserved
Scenarios for Levels 4 and 5
Medium rides - Less than an hour
○ Example - Commuting
● Solo or with likely known people
● Likely to want personalized entertainment options
○ Commuters might want a ‘virtual desk’
Long rides
● Road trip, commercial transport
● Almost certain to want personalized entertainment
11
© Integrated Computer Solutions, Inc. All Rights Reserved
Prototype Implementation
• ICS developed an In-Vehicle-Infotainment Prototype based on automotive
hardware and middleware
• Modern UI, Plugin based architecture, easily customizable and extendable
• Features a rich Media Stack
• BYOD Music, Bluetooth Connectivity, Navigation, Rear Seat Entertainment
and much more
• Already had remote control capabilities from speech recognition module
• Ideal for fast prototyping of the Connected Car scenario
12
© Integrated Computer Solutions, Inc. All Rights Reserved
Media Management
• At ICS we have designed and built many In-Vehicle-Infotainment systems
• When asked to look into Media Management we found this to be a vexing and
complex problem
• The challenge for automotive IVI implementations is:
• People’s media -- their music, videos, audiobooks, podcasts and television -- exist in
a multitude of forms and originate from many disparate sources
• For example, some music files may reside at home in an iTunes library, others may
have been purchased from Amazon Music or Google Play
• Since most media is never downloaded to a computer or a USB drive, it is retrieved
through a phone, hence seamless Bluetooth is the most important option!
13
© Integrated Computer Solutions, Inc. All Rights Reserved
Requirements
The job of finding and making available media to the passengers of a car is
that of the Media Manager
• First step: Recognizing a Device is brought into the car
• Next: Finding and Indexing Media on the Device
• Possibly: Enhancing Media Information to allow improved search,
filtering, etc.
• Definitely: Playing of Media using the car’s advanced audio systems
• Controlling the flow of Media to e.g. different speaker zones, headphone
jacks, videos to headrest screens etc.
14
© Integrated Computer Solutions, Inc. All Rights Reserved
Requirements (continued)
• When multiple occupants drive in the car each individual should be able
to enjoy their own audio and video selections.
• Hence a media manager should be able to direct media to specific
passengers.
15
© Integrated Computer Solutions, Inc. All Rights Reserved
Challenges
• Differences in lifecycles
• Cars, consumer devices, phones, home automation
• Different development times
• Dictated by regulation, consumer expectations:
car life cycle (>10 years)
• Automotive and mobile industries have very different objectives
• Consumer acceptance
• Depends on significant lifestyle improvements
• Balanced with costs and marketing strategies
16
© Integrated Computer Solutions, Inc. All Rights Reserved
The Idea - Coding for the Unknown
Today’s media consumers behavior changes rapidly:
• Remember the “Walkman” - Enjoyed it for Decades
• CDs - Lasted maybe 10 years
• MP3s on CDs, USB Pendrives, Less than 5 years
• Cloud based music sharing, Amazon tbd.
• Pandora, by all means not saying it’s dead but:
• Spotify, is the current Darling (< 2 years)
• The cycles become shorter and shorter
• Consumers change phones 2-3 years on average
• We must keep in mind that what we create might be partially outdated by
the time is is released - Ouch!
17
© Integrated Computer Solutions, Inc. All Rights Reserved
Possible Solutions
• Use a Mobile Phone or Tablet OS in the Car
• Use a Web Technology Based Stack in the Car
• Design an Open Standards based, Car specific OS and create a system of
plugins and components with open interfaces that can be easily updated
• Architecture of the ICS Media Manager follows this idea
18
© Integrated Computer Solutions, Inc. All Rights Reserved 19
Architecture
© Integrated Computer Solutions, Inc. All Rights Reserved
Plugin Architecture
Media Manager Core Functionality
• Load Plugins:
• Device Manager
• Media Devices
• Media Players
• Services (Audio Manager, Media Enrichment)
• Controllers (UI, RC, RVI)
• Organize Flow of Media Info Data from Device to Player and Device to
Controller
20
© Integrated Computer Solutions, Inc. All Rights Reserved 21
Media Devices
© Integrated Computer Solutions, Inc. All Rights Reserved
Device Manager Plugin Interface
/** DeviceManagerInterface is a Plugin Interface for DeviceManagers
* that detect MediaDevices which contain Media that can be indexed
* by a suitable MediaDevice.
**/
class DeviceManagerInterface : public QObject
{
Q_OBJECT
public:
explicit DeviceManagerInterface(QObject * parent=0) : QObject(parent) {}
virtual ~DeviceManagerInterface() {}
signals:
void deviceCreated(const QString mediaDeviceType, const QUrl mediaDevicePath) const;
void deviceRemoved(const QString mediaDeviceType, const QUrl mediaDevicePath) const;
};
#define DeviceManagerInterface_iid "com.ics.media-manager.DeviceManagerInterface"
Q_DECLARE_INTERFACE(DeviceManagerInterface, DeviceManagerInterface_iid)
22
© Integrated Computer Solutions, Inc. All Rights Reserved
ICS-Terra
Build Better User Experiences
Faster
23
© Integrated Computer Solutions, Inc. All Rights Reserved
Terra provides rapid development tools and
reusable code for building interfaces within a
standardized architecture
• Architecture
• Software
• Proven Process
• ICS People
24
© Integrated Computer Solutions, Inc. All Rights Reserved
Architecture
Terra features layered design
© Integrated Computer Solutions, Inc. All Rights Reserved
Architecture
Benefits of Layered Design
• User interface can be tested independently
• Supporting layers can be tested independently
Why it matters
Layered design makes testing more efficient, which improves quality and
saves money.
Example:
Spray
Application
26
© Integrated Computer Solutions, Inc. All Rights Reserved
Architecture facilitates flexible, efficient development
© Integrated Computer Solutions, Inc. All Rights Reserved
Terra offers many benefits —
Architecture brings all of the pieces together
• Reusable code
• Roles/assignment of tasks
• Flexible development timeline
• Division of ICS & client responsibilities
Why it matters
With all of these pieces in place, client captures full benefits of Terra— lower
costs, higher quality and reduced risk.
© Integrated Computer Solutions, Inc. All Rights Reserved
• Common graphic elements
• Common functionality
• Code can be configured for target environment
Why it matters
Reusable code lowers cost and risk.
Software
Terra software enables ICS to streamline
development of touchscreen interfaces
Example:
RT Graphing
Library
29
© Integrated Computer Solutions, Inc. All Rights Reserved
Software
Terra software components
• State machine authoring tool
• Enhancements and extensions to Qt and Qt Quick
• Utilities & management tools
• Integration with common embedded technologies
30
© Integrated Computer Solutions, Inc. All Rights Reserved
Software
ICS enhancements and extensions to Qt
provide important features at very low cost
• We are the Qt experts
• Projects in every vertical market, especially auto & medical
• Training and coaching
• Terra distills best practices refined over hundreds of projects
• More cost-effective than pure custom development
• Proven software — fewer bugs, easier testing, less work
• Engineers are more productive
31
© Integrated Computer Solutions, Inc. All Rights Reserved
Software
Qt Extensions: Theming
• QtQuick.Controls 2.0 come with Qt
• Android and Microsoft Themes out of the box
• Hard to add or tweak your own theme
• Terra extends
• Configurable via simple QML files
• Changing the look of buttons, pickers, etc is easy
• Support for night/day, blue vs. red, etc
• Can reload UI at runtime
32
© Integrated Computer Solutions, Inc. All Rights Reserved
Software
Qt Extensions: Internationalization
• Qt Provides extensive support for i18n
• Terra Extends
• Extra skeleton to make i18n seamless during development
• Add and verify translations as you go
• Generates test translations
• Generates font metrics and areas available to text to grow
• Prevents translators from creating strings that are too long to fit
33
© Integrated Computer Solutions, Inc. All Rights Reserved
Software
Qt Extensions: Documentation
• Doxygen tools document API
• Terra extends
• How is this feature implemented?
• How the parts fit together?
• What is the code “supposed to do”
34
© Integrated Computer Solutions, Inc. All Rights Reserved
Software
Utilities & Management Tools
• Logging
• Event tracking and reporting
• Automatic updates
• Access to web content
• Streaming media
© Integrated Computer Solutions, Inc. All Rights Reserved
Software
Integration with Embedded Technologies
• Controller libraries
• Device drivers
• Embedded development tools
36
© Integrated Computer Solutions, Inc. All Rights Reserved
• ICS has developed touch interfaces on across devices and industries
• ICS is the world’s largest independent supplier of Qt services
• Our experience provides tangible value to customers
• Reduced risk
• Understand tradeoffs
• Create rapid prototypes
Why it matters
It is well established that a programmer’s effort exponentially decreases as
his/her experience increases, reducing cost and risk.
Process
37
© Integrated Computer Solutions, Inc. All Rights Reserved
• All the disciplines
• Software Architect, Project Manager, Engineer
• Human Factors, Visual Designer, Graphic Designer, UX Designer
• Can tap expertise as needed
• Team-based approach
Why it matters
People have the skills & experience required, so work gets done faster.
Problems are discovered and solved earlier, reducing cost and risk.
People
38
© Integrated Computer Solutions, Inc. All Rights Reserved
Terra for IVI
© Integrated Computer Solutions, Inc. All Rights Reserved
What is Next?
• Automotive industry is at the center of a paradigm shift
• Demand for connected lifestyle is evident
• Must keep up with the pace of developing mobile and home automation
ecosystems
• Automotive industry could separate shareable components from
differentiating value propositions
• Joint development of common, shareable components based on open
standards
• Provides the platform to hold pace with development cycles of mobile
industry
• Autonomous mobility will accelerate demand for connected lifestyle
40
© Integrated Computer Solutions, Inc. All Rights Reserved
Questions?
www.ics.com
41

More Related Content

What's hot

New Open Source project at HGI for SmartHome Device Abstraction Templates - A...
New Open Source project at HGI for SmartHome Device Abstraction Templates - A...New Open Source project at HGI for SmartHome Device Abstraction Templates - A...
New Open Source project at HGI for SmartHome Device Abstraction Templates - A...
mfrancis
 
Designing and Deploying Internet-Scale Services
Designing and Deploying Internet-Scale ServicesDesigning and Deploying Internet-Scale Services
Designing and Deploying Internet-Scale Services
bigqiang zou
 
e-Business - Mobile development trends
e-Business - Mobile development trendse-Business - Mobile development trends
e-Business - Mobile development trends
Vladimir Kotov
 
"Implementing Eye Tracking for Medical, Automotive and Headset Applications,"...
"Implementing Eye Tracking for Medical, Automotive and Headset Applications,"..."Implementing Eye Tracking for Medical, Automotive and Headset Applications,"...
"Implementing Eye Tracking for Medical, Automotive and Headset Applications,"...
Edge AI and Vision Alliance
 

What's hot (20)

Leveraging Artificial Intelligence Processing on Edge Devices
Leveraging Artificial Intelligence Processing on Edge DevicesLeveraging Artificial Intelligence Processing on Edge Devices
Leveraging Artificial Intelligence Processing on Edge Devices
 
Driving Down Automotive Costs for Richer HMIs with Qt & i.MX RT1170
Driving Down Automotive Costs for Richer HMIs with Qt & i.MX RT1170Driving Down Automotive Costs for Richer HMIs with Qt & i.MX RT1170
Driving Down Automotive Costs for Richer HMIs with Qt & i.MX RT1170
 
Meet Qt
Meet QtMeet Qt
Meet Qt
 
Qt Licensing Explained
Qt Licensing ExplainedQt Licensing Explained
Qt Licensing Explained
 
KDE Plasma for Mobile Phones
KDE Plasma for Mobile PhonesKDE Plasma for Mobile Phones
KDE Plasma for Mobile Phones
 
Learn how to addressing medical and industrial challenges with BlackBerry QNX...
Learn how to addressing medical and industrial challenges with BlackBerry QNX...Learn how to addressing medical and industrial challenges with BlackBerry QNX...
Learn how to addressing medical and industrial challenges with BlackBerry QNX...
 
Shaping the Future of Automatic Programming
Shaping the Future of Automatic ProgrammingShaping the Future of Automatic Programming
Shaping the Future of Automatic Programming
 
Shipping Mobile Applications Using Qt for Symbian
Shipping Mobile Applications Using Qt for SymbianShipping Mobile Applications Using Qt for Symbian
Shipping Mobile Applications Using Qt for Symbian
 
Qt in depth - presentation for Symbian expo 2009
Qt in depth - presentation for Symbian expo 2009Qt in depth - presentation for Symbian expo 2009
Qt in depth - presentation for Symbian expo 2009
 
Advance ui development and design
Advance ui  development and design Advance ui  development and design
Advance ui development and design
 
New Open Source project at HGI for SmartHome Device Abstraction Templates - A...
New Open Source project at HGI for SmartHome Device Abstraction Templates - A...New Open Source project at HGI for SmartHome Device Abstraction Templates - A...
New Open Source project at HGI for SmartHome Device Abstraction Templates - A...
 
Tracing the evolution - Open source & Embedded systems
Tracing the evolution - Open source & Embedded systemsTracing the evolution - Open source & Embedded systems
Tracing the evolution - Open source & Embedded systems
 
Designing and Deploying Internet-Scale Services
Designing and Deploying Internet-Scale ServicesDesigning and Deploying Internet-Scale Services
Designing and Deploying Internet-Scale Services
 
Ad111 Lotusphere 2011 - Developing Mobile Apps Rapidly for WebKit Browsers Us...
Ad111 Lotusphere 2011 - Developing Mobile Apps Rapidly for WebKit Browsers Us...Ad111 Lotusphere 2011 - Developing Mobile Apps Rapidly for WebKit Browsers Us...
Ad111 Lotusphere 2011 - Developing Mobile Apps Rapidly for WebKit Browsers Us...
 
e-Business - Mobile development trends
e-Business - Mobile development trendse-Business - Mobile development trends
e-Business - Mobile development trends
 
The Evolution of Industrial Visualization
The Evolution of Industrial VisualizationThe Evolution of Industrial Visualization
The Evolution of Industrial Visualization
 
Dublin Unity User Group Meetup Sept 2015
Dublin Unity User Group Meetup Sept 2015Dublin Unity User Group Meetup Sept 2015
Dublin Unity User Group Meetup Sept 2015
 
Driving and virtualizing control systems: the Open Source approach used in Wh...
Driving and virtualizing control systems: the Open Source approach used in Wh...Driving and virtualizing control systems: the Open Source approach used in Wh...
Driving and virtualizing control systems: the Open Source approach used in Wh...
 
Smalltalk on a CE device
Smalltalk on a CE deviceSmalltalk on a CE device
Smalltalk on a CE device
 
"Implementing Eye Tracking for Medical, Automotive and Headset Applications,"...
"Implementing Eye Tracking for Medical, Automotive and Headset Applications,"..."Implementing Eye Tracking for Medical, Automotive and Headset Applications,"...
"Implementing Eye Tracking for Medical, Automotive and Headset Applications,"...
 

Similar to [Webinar] Automotive Media Management in Future IVI Systems

Droidcon 2013 connected services burrel_ford
Droidcon 2013 connected services burrel_fordDroidcon 2013 connected services burrel_ford
Droidcon 2013 connected services burrel_ford
Droidcon Berlin
 
introduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdf
introduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdfintroduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdf
introduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdf
VishalKumarJha10
 
Ciw going mobile
Ciw going mobileCiw going mobile
Ciw going mobile
r82093403
 
End-to-End and e-Business Value from the Telematics Reference Implementation ...
End-to-End and e-Business Value from the Telematics Reference Implementation ...End-to-End and e-Business Value from the Telematics Reference Implementation ...
End-to-End and e-Business Value from the Telematics Reference Implementation ...
mfrancis
 

Similar to [Webinar] Automotive Media Management in Future IVI Systems (20)

Open Source Automotive Development
Open Source Automotive DevelopmentOpen Source Automotive Development
Open Source Automotive Development
 
Strategies to Develop In-Vehicle Infotainment System
Strategies to Develop In-Vehicle Infotainment SystemStrategies to Develop In-Vehicle Infotainment System
Strategies to Develop In-Vehicle Infotainment System
 
From Driver Distraction to Driver Augmentation: Open Source in Cars
From Driver Distraction to Driver Augmentation: Open Source in CarsFrom Driver Distraction to Driver Augmentation: Open Source in Cars
From Driver Distraction to Driver Augmentation: Open Source in Cars
 
Droidcon 2013 connected services burrel_ford
Droidcon 2013 connected services burrel_fordDroidcon 2013 connected services burrel_ford
Droidcon 2013 connected services burrel_ford
 
What is IVI (In Vehicle Infotainment)?
What is IVI (In Vehicle Infotainment)?What is IVI (In Vehicle Infotainment)?
What is IVI (In Vehicle Infotainment)?
 
Connected Car Investment Thesis
Connected Car Investment ThesisConnected Car Investment Thesis
Connected Car Investment Thesis
 
introduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdf
introduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdfintroduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdf
introduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdf
 
A 2008 perspective on the i-Car
A 2008 perspective on the i-CarA 2008 perspective on the i-Car
A 2008 perspective on the i-Car
 
droidcon 2012: The Android passenger, Joerg Decker, Capgemini
droidcon 2012: The Android passenger, Joerg Decker, Capgeminidroidcon 2012: The Android passenger, Joerg Decker, Capgemini
droidcon 2012: The Android passenger, Joerg Decker, Capgemini
 
Techprom presentation 1 6-18-9
Techprom presentation 1 6-18-9Techprom presentation 1 6-18-9
Techprom presentation 1 6-18-9
 
Techprom presentation 1 6-18-10
Techprom presentation 1 6-18-10Techprom presentation 1 6-18-10
Techprom presentation 1 6-18-10
 
Ciw going mobile
Ciw going mobileCiw going mobile
Ciw going mobile
 
Techprom presentation 1 6-18-8
Techprom presentation 1 6-18-8Techprom presentation 1 6-18-8
Techprom presentation 1 6-18-8
 
1 Million Cups Presentation
1 Million Cups Presentation1 Million Cups Presentation
1 Million Cups Presentation
 
Tier X and the Coming of the Whitebox Car
Tier X and the Coming of the Whitebox CarTier X and the Coming of the Whitebox Car
Tier X and the Coming of the Whitebox Car
 
End-to-End and e-Business Value from the Telematics Reference Implementation ...
End-to-End and e-Business Value from the Telematics Reference Implementation ...End-to-End and e-Business Value from the Telematics Reference Implementation ...
End-to-End and e-Business Value from the Telematics Reference Implementation ...
 
Android-Audio-HAL-Overview-Flow-WithHIDL-
Android-Audio-HAL-Overview-Flow-WithHIDL-Android-Audio-HAL-Overview-Flow-WithHIDL-
Android-Audio-HAL-Overview-Flow-WithHIDL-
 
Hud
Hud Hud
Hud
 
Using Watson to build Cognitive IoT Apps on Bluemix
Using Watson to build Cognitive IoT Apps on BluemixUsing Watson to build Cognitive IoT Apps on Bluemix
Using Watson to build Cognitive IoT Apps on Bluemix
 
Iot and self driving cars
Iot  and self driving cars Iot  and self driving cars
Iot and self driving cars
 

More from ICS

Software Update Mechanisms: Selecting the Best Solutin for Your Embedded Linu...
Software Update Mechanisms: Selecting the Best Solutin for Your Embedded Linu...Software Update Mechanisms: Selecting the Best Solutin for Your Embedded Linu...
Software Update Mechanisms: Selecting the Best Solutin for Your Embedded Linu...
ICS
 

More from ICS (20)

A Deep Dive into Secure Product Development Frameworks.pdf
A Deep Dive into Secure Product Development Frameworks.pdfA Deep Dive into Secure Product Development Frameworks.pdf
A Deep Dive into Secure Product Development Frameworks.pdf
 
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
 
Practical Advice for FDA’s 510(k) Requirements.pdf
Practical Advice for FDA’s 510(k) Requirements.pdfPractical Advice for FDA’s 510(k) Requirements.pdf
Practical Advice for FDA’s 510(k) Requirements.pdf
 
Accelerating Development of a Safety-Critical Cobot Welding System with Qt/QM...
Accelerating Development of a Safety-Critical Cobot Welding System with Qt/QM...Accelerating Development of a Safety-Critical Cobot Welding System with Qt/QM...
Accelerating Development of a Safety-Critical Cobot Welding System with Qt/QM...
 
Overcoming CMake Configuration Issues Webinar
Overcoming CMake Configuration Issues WebinarOvercoming CMake Configuration Issues Webinar
Overcoming CMake Configuration Issues Webinar
 
Enhancing Quality and Test in Medical Device Design - Part 2.pdf
Enhancing Quality and Test in Medical Device Design - Part 2.pdfEnhancing Quality and Test in Medical Device Design - Part 2.pdf
Enhancing Quality and Test in Medical Device Design - Part 2.pdf
 
Designing and Managing IoT Devices for Rapid Deployment - Webinar.pdf
Designing and Managing IoT Devices for Rapid Deployment - Webinar.pdfDesigning and Managing IoT Devices for Rapid Deployment - Webinar.pdf
Designing and Managing IoT Devices for Rapid Deployment - Webinar.pdf
 
Quality and Test in Medical Device Design - Part 1.pdf
Quality and Test in Medical Device Design - Part 1.pdfQuality and Test in Medical Device Design - Part 1.pdf
Quality and Test in Medical Device Design - Part 1.pdf
 
Creating Digital Twins Using Rapid Development Techniques.pdf
Creating Digital Twins Using Rapid Development Techniques.pdfCreating Digital Twins Using Rapid Development Techniques.pdf
Creating Digital Twins Using Rapid Development Techniques.pdf
 
Secure Your Medical Devices From the Ground Up
Secure Your Medical Devices From the Ground Up Secure Your Medical Devices From the Ground Up
Secure Your Medical Devices From the Ground Up
 
Cybersecurity and Software Updates in Medical Devices.pdf
Cybersecurity and Software Updates in Medical Devices.pdfCybersecurity and Software Updates in Medical Devices.pdf
Cybersecurity and Software Updates in Medical Devices.pdf
 
MDG Panel - Creating Expert Level GUIs for Complex Medical Devices
MDG Panel - Creating Expert Level GUIs for Complex Medical DevicesMDG Panel - Creating Expert Level GUIs for Complex Medical Devices
MDG Panel - Creating Expert Level GUIs for Complex Medical Devices
 
How to Craft a Winning IOT Device Management Solution
How to Craft a Winning IOT Device Management SolutionHow to Craft a Winning IOT Device Management Solution
How to Craft a Winning IOT Device Management Solution
 
Bridging the Gap Between Development and Regulatory Teams
Bridging the Gap Between Development and Regulatory TeamsBridging the Gap Between Development and Regulatory Teams
Bridging the Gap Between Development and Regulatory Teams
 
IoT Device Fleet Management: Create a Robust Solution with Azure
IoT Device Fleet Management: Create a Robust Solution with AzureIoT Device Fleet Management: Create a Robust Solution with Azure
IoT Device Fleet Management: Create a Robust Solution with Azure
 
Basic Cmake for Qt Users
Basic Cmake for Qt UsersBasic Cmake for Qt Users
Basic Cmake for Qt Users
 
Software Update Mechanisms: Selecting the Best Solutin for Your Embedded Linu...
Software Update Mechanisms: Selecting the Best Solutin for Your Embedded Linu...Software Update Mechanisms: Selecting the Best Solutin for Your Embedded Linu...
Software Update Mechanisms: Selecting the Best Solutin for Your Embedded Linu...
 
Qt Installer Framework
Qt Installer FrameworkQt Installer Framework
Qt Installer Framework
 
Bridging the Gap Between Development and Regulatory Teams
Bridging the Gap Between Development and Regulatory TeamsBridging the Gap Between Development and Regulatory Teams
Bridging the Gap Between Development and Regulatory Teams
 
Overcome Hardware And Software Challenges - Medical Device Case Study
Overcome Hardware And Software Challenges - Medical Device Case StudyOvercome Hardware And Software Challenges - Medical Device Case Study
Overcome Hardware And Software Challenges - Medical Device Case Study
 

Recently uploaded

“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
Muhammad Subhan
 
Revolutionizing SAP® Processes with Automation and Artificial Intelligence
Revolutionizing SAP® Processes with Automation and Artificial IntelligenceRevolutionizing SAP® Processes with Automation and Artificial Intelligence
Revolutionizing SAP® Processes with Automation and Artificial Intelligence
Precisely
 

Recently uploaded (20)

Event-Driven Architecture Masterclass: Challenges in Stream Processing
Event-Driven Architecture Masterclass: Challenges in Stream ProcessingEvent-Driven Architecture Masterclass: Challenges in Stream Processing
Event-Driven Architecture Masterclass: Challenges in Stream Processing
 
Intro to Passkeys and the State of Passwordless.pptx
Intro to Passkeys and the State of Passwordless.pptxIntro to Passkeys and the State of Passwordless.pptx
Intro to Passkeys and the State of Passwordless.pptx
 
Portal Kombat : extension du réseau de propagande russe
Portal Kombat : extension du réseau de propagande russePortal Kombat : extension du réseau de propagande russe
Portal Kombat : extension du réseau de propagande russe
 
Design Guidelines for Passkeys 2024.pptx
Design Guidelines for Passkeys 2024.pptxDesign Guidelines for Passkeys 2024.pptx
Design Guidelines for Passkeys 2024.pptx
 
ADP Passwordless Journey Case Study.pptx
ADP Passwordless Journey Case Study.pptxADP Passwordless Journey Case Study.pptx
ADP Passwordless Journey Case Study.pptx
 
Oauth 2.0 Introduction and Flows with MuleSoft
Oauth 2.0 Introduction and Flows with MuleSoftOauth 2.0 Introduction and Flows with MuleSoft
Oauth 2.0 Introduction and Flows with MuleSoft
 
Design and Development of a Provenance Capture Platform for Data Science
Design and Development of a Provenance Capture Platform for Data ScienceDesign and Development of a Provenance Capture Platform for Data Science
Design and Development of a Provenance Capture Platform for Data Science
 
2024 May Patch Tuesday
2024 May Patch Tuesday2024 May Patch Tuesday
2024 May Patch Tuesday
 
Introduction to FIDO Authentication and Passkeys.pptx
Introduction to FIDO Authentication and Passkeys.pptxIntroduction to FIDO Authentication and Passkeys.pptx
Introduction to FIDO Authentication and Passkeys.pptx
 
Continuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on ThanabotsContinuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
 
Generative AI Use Cases and Applications.pdf
Generative AI Use Cases and Applications.pdfGenerative AI Use Cases and Applications.pdf
Generative AI Use Cases and Applications.pdf
 
WebRTC and SIP not just audio and video @ OpenSIPS 2024
WebRTC and SIP not just audio and video @ OpenSIPS 2024WebRTC and SIP not just audio and video @ OpenSIPS 2024
WebRTC and SIP not just audio and video @ OpenSIPS 2024
 
Syngulon - Selection technology May 2024.pdf
Syngulon - Selection technology May 2024.pdfSyngulon - Selection technology May 2024.pdf
Syngulon - Selection technology May 2024.pdf
 
(Explainable) Data-Centric AI: what are you explaininhg, and to whom?
(Explainable) Data-Centric AI: what are you explaininhg, and to whom?(Explainable) Data-Centric AI: what are you explaininhg, and to whom?
(Explainable) Data-Centric AI: what are you explaininhg, and to whom?
 
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
 
Microsoft CSP Briefing Pre-Engagement - Questionnaire
Microsoft CSP Briefing Pre-Engagement - QuestionnaireMicrosoft CSP Briefing Pre-Engagement - Questionnaire
Microsoft CSP Briefing Pre-Engagement - Questionnaire
 
Revolutionizing SAP® Processes with Automation and Artificial Intelligence
Revolutionizing SAP® Processes with Automation and Artificial IntelligenceRevolutionizing SAP® Processes with Automation and Artificial Intelligence
Revolutionizing SAP® Processes with Automation and Artificial Intelligence
 
Long journey of Ruby Standard library at RubyKaigi 2024
Long journey of Ruby Standard library at RubyKaigi 2024Long journey of Ruby Standard library at RubyKaigi 2024
Long journey of Ruby Standard library at RubyKaigi 2024
 
TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...
TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...
TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...
 
Cyber Insurance - RalphGilot - Embry-Riddle Aeronautical University.pptx
Cyber Insurance - RalphGilot - Embry-Riddle Aeronautical University.pptxCyber Insurance - RalphGilot - Embry-Riddle Aeronautical University.pptx
Cyber Insurance - RalphGilot - Embry-Riddle Aeronautical University.pptx
 

[Webinar] Automotive Media Management in Future IVI Systems

  • 1. © Integrated Computer Solutions, Inc. All Rights Reserved Automotive Media Management in Future IVI Systems Roland Krause Ph.D., Director of Engineering www.ics.com 1
  • 2. © Integrated Computer Solutions, Inc. All Rights Reserved Leaving the Driver Seat Profound changes in how people experience Automotive Transportation • Car ownership percentage among 16-34 year olds is still on a declining path 2
  • 3. © Integrated Computer Solutions, Inc. All Rights Reserved Some Trends in the Automotive Market There is a discussion about whether car sharing is replacing ownership! • Car sharing changes how we view and interact with transportation • It drives new and different use cases and expectations • Ride Apps, advertising options, etc.. • Among 18- to 24-year-olds, 64% said they expected their vehicle’s technology to be able to do all the things that a smartphone can do; that compared with 56% of Gen X respondents* Add to that changes in technology such as driver assist and fully autonomous driving 3 *Source: Cox Automotive
  • 4. © Integrated Computer Solutions, Inc. All Rights Reserved Consequences for In-Vehicle-Infotainment Shared automotive experience • While it doesn’t really matter which car comes to pick you up it still matters to have a consistent user experience • Convenient, easy, flexible and fast adapting to new technologies, trends and applications • ByoD, wearables, etc. require much faster updates and more intelligence in an automobile • Convergence of ubiquitous technologies is mandatory • unless one of them will replace the car IVI altogether 4
  • 5. © Integrated Computer Solutions, Inc. All Rights Reserved Steps to Autonomous Driving - Level 2 5 • Driver is disengaged from physically operating the vehicle. • The driver must still always be ready to take control of the vehicle. • This does not open significantly different infotainment options, however improved convergence and integration options are likely to bring value for all passengers of vehicles
  • 6. © Integrated Computer Solutions, Inc. All Rights Reserved Steps to Autonomous Driving - Level 3 6 • Completely shift "safety-critical functions" to the vehicle. • Under certain traffic or environmental conditions. • Driver is still present and will intervene if necessary, but is not required to monitor the situation in the same way as for previous levels.
  • 7. © Integrated Computer Solutions, Inc. All Rights Reserved Steps to Autonomous Driving - Level 4+ • Fully autonomous. • Vehicles designed to perform all safety-critical driving functions and monitor roadway conditions for an entire trip. • Limited to the "operational design domain (ODD)" • At level 5 the vehicle's performance is expected to equal that of a human driver, in every driving scenario. 7
  • 8. © Integrated Computer Solutions, Inc. All Rights Reserved 8 (In) vehicle experience is now distinguishing factor as horse power no longer matters
  • 9. © Integrated Computer Solutions, Inc. All Rights Reserved New Opportunities Determine Requirements for Vehicle Entertainment 9
  • 10. © Integrated Computer Solutions, Inc. All Rights Reserved Common Functionality Common to all levels is that the IVI still needs to provide functionality to interact with the vehicle • HVAC • Interior such as lighting, seats, doors and windows • Controlled by touchscreens or voice, similar to smart homes 10 “Alexa, set the front temperature to 72 degrees.”
  • 11. © Integrated Computer Solutions, Inc. All Rights Reserved Scenarios for Levels 4 and 5 Medium rides - Less than an hour ○ Example - Commuting ● Solo or with likely known people ● Likely to want personalized entertainment options ○ Commuters might want a ‘virtual desk’ Long rides ● Road trip, commercial transport ● Almost certain to want personalized entertainment 11
  • 12. © Integrated Computer Solutions, Inc. All Rights Reserved Prototype Implementation • ICS developed an In-Vehicle-Infotainment Prototype based on automotive hardware and middleware • Modern UI, Plugin based architecture, easily customizable and extendable • Features a rich Media Stack • BYOD Music, Bluetooth Connectivity, Navigation, Rear Seat Entertainment and much more • Already had remote control capabilities from speech recognition module • Ideal for fast prototyping of the Connected Car scenario 12
  • 13. © Integrated Computer Solutions, Inc. All Rights Reserved Media Management • At ICS we have designed and built many In-Vehicle-Infotainment systems • When asked to look into Media Management we found this to be a vexing and complex problem • The challenge for automotive IVI implementations is: • People’s media -- their music, videos, audiobooks, podcasts and television -- exist in a multitude of forms and originate from many disparate sources • For example, some music files may reside at home in an iTunes library, others may have been purchased from Amazon Music or Google Play • Since most media is never downloaded to a computer or a USB drive, it is retrieved through a phone, hence seamless Bluetooth is the most important option! 13
  • 14. © Integrated Computer Solutions, Inc. All Rights Reserved Requirements The job of finding and making available media to the passengers of a car is that of the Media Manager • First step: Recognizing a Device is brought into the car • Next: Finding and Indexing Media on the Device • Possibly: Enhancing Media Information to allow improved search, filtering, etc. • Definitely: Playing of Media using the car’s advanced audio systems • Controlling the flow of Media to e.g. different speaker zones, headphone jacks, videos to headrest screens etc. 14
  • 15. © Integrated Computer Solutions, Inc. All Rights Reserved Requirements (continued) • When multiple occupants drive in the car each individual should be able to enjoy their own audio and video selections. • Hence a media manager should be able to direct media to specific passengers. 15
  • 16. © Integrated Computer Solutions, Inc. All Rights Reserved Challenges • Differences in lifecycles • Cars, consumer devices, phones, home automation • Different development times • Dictated by regulation, consumer expectations: car life cycle (>10 years) • Automotive and mobile industries have very different objectives • Consumer acceptance • Depends on significant lifestyle improvements • Balanced with costs and marketing strategies 16
  • 17. © Integrated Computer Solutions, Inc. All Rights Reserved The Idea - Coding for the Unknown Today’s media consumers behavior changes rapidly: • Remember the “Walkman” - Enjoyed it for Decades • CDs - Lasted maybe 10 years • MP3s on CDs, USB Pendrives, Less than 5 years • Cloud based music sharing, Amazon tbd. • Pandora, by all means not saying it’s dead but: • Spotify, is the current Darling (< 2 years) • The cycles become shorter and shorter • Consumers change phones 2-3 years on average • We must keep in mind that what we create might be partially outdated by the time is is released - Ouch! 17
  • 18. © Integrated Computer Solutions, Inc. All Rights Reserved Possible Solutions • Use a Mobile Phone or Tablet OS in the Car • Use a Web Technology Based Stack in the Car • Design an Open Standards based, Car specific OS and create a system of plugins and components with open interfaces that can be easily updated • Architecture of the ICS Media Manager follows this idea 18
  • 19. © Integrated Computer Solutions, Inc. All Rights Reserved 19 Architecture
  • 20. © Integrated Computer Solutions, Inc. All Rights Reserved Plugin Architecture Media Manager Core Functionality • Load Plugins: • Device Manager • Media Devices • Media Players • Services (Audio Manager, Media Enrichment) • Controllers (UI, RC, RVI) • Organize Flow of Media Info Data from Device to Player and Device to Controller 20
  • 21. © Integrated Computer Solutions, Inc. All Rights Reserved 21 Media Devices
  • 22. © Integrated Computer Solutions, Inc. All Rights Reserved Device Manager Plugin Interface /** DeviceManagerInterface is a Plugin Interface for DeviceManagers * that detect MediaDevices which contain Media that can be indexed * by a suitable MediaDevice. **/ class DeviceManagerInterface : public QObject { Q_OBJECT public: explicit DeviceManagerInterface(QObject * parent=0) : QObject(parent) {} virtual ~DeviceManagerInterface() {} signals: void deviceCreated(const QString mediaDeviceType, const QUrl mediaDevicePath) const; void deviceRemoved(const QString mediaDeviceType, const QUrl mediaDevicePath) const; }; #define DeviceManagerInterface_iid "com.ics.media-manager.DeviceManagerInterface" Q_DECLARE_INTERFACE(DeviceManagerInterface, DeviceManagerInterface_iid) 22
  • 23. © Integrated Computer Solutions, Inc. All Rights Reserved ICS-Terra Build Better User Experiences Faster 23
  • 24. © Integrated Computer Solutions, Inc. All Rights Reserved Terra provides rapid development tools and reusable code for building interfaces within a standardized architecture • Architecture • Software • Proven Process • ICS People 24
  • 25. © Integrated Computer Solutions, Inc. All Rights Reserved Architecture Terra features layered design
  • 26. © Integrated Computer Solutions, Inc. All Rights Reserved Architecture Benefits of Layered Design • User interface can be tested independently • Supporting layers can be tested independently Why it matters Layered design makes testing more efficient, which improves quality and saves money. Example: Spray Application 26
  • 27. © Integrated Computer Solutions, Inc. All Rights Reserved Architecture facilitates flexible, efficient development
  • 28. © Integrated Computer Solutions, Inc. All Rights Reserved Terra offers many benefits — Architecture brings all of the pieces together • Reusable code • Roles/assignment of tasks • Flexible development timeline • Division of ICS & client responsibilities Why it matters With all of these pieces in place, client captures full benefits of Terra— lower costs, higher quality and reduced risk.
  • 29. © Integrated Computer Solutions, Inc. All Rights Reserved • Common graphic elements • Common functionality • Code can be configured for target environment Why it matters Reusable code lowers cost and risk. Software Terra software enables ICS to streamline development of touchscreen interfaces Example: RT Graphing Library 29
  • 30. © Integrated Computer Solutions, Inc. All Rights Reserved Software Terra software components • State machine authoring tool • Enhancements and extensions to Qt and Qt Quick • Utilities & management tools • Integration with common embedded technologies 30
  • 31. © Integrated Computer Solutions, Inc. All Rights Reserved Software ICS enhancements and extensions to Qt provide important features at very low cost • We are the Qt experts • Projects in every vertical market, especially auto & medical • Training and coaching • Terra distills best practices refined over hundreds of projects • More cost-effective than pure custom development • Proven software — fewer bugs, easier testing, less work • Engineers are more productive 31
  • 32. © Integrated Computer Solutions, Inc. All Rights Reserved Software Qt Extensions: Theming • QtQuick.Controls 2.0 come with Qt • Android and Microsoft Themes out of the box • Hard to add or tweak your own theme • Terra extends • Configurable via simple QML files • Changing the look of buttons, pickers, etc is easy • Support for night/day, blue vs. red, etc • Can reload UI at runtime 32
  • 33. © Integrated Computer Solutions, Inc. All Rights Reserved Software Qt Extensions: Internationalization • Qt Provides extensive support for i18n • Terra Extends • Extra skeleton to make i18n seamless during development • Add and verify translations as you go • Generates test translations • Generates font metrics and areas available to text to grow • Prevents translators from creating strings that are too long to fit 33
  • 34. © Integrated Computer Solutions, Inc. All Rights Reserved Software Qt Extensions: Documentation • Doxygen tools document API • Terra extends • How is this feature implemented? • How the parts fit together? • What is the code “supposed to do” 34
  • 35. © Integrated Computer Solutions, Inc. All Rights Reserved Software Utilities & Management Tools • Logging • Event tracking and reporting • Automatic updates • Access to web content • Streaming media
  • 36. © Integrated Computer Solutions, Inc. All Rights Reserved Software Integration with Embedded Technologies • Controller libraries • Device drivers • Embedded development tools 36
  • 37. © Integrated Computer Solutions, Inc. All Rights Reserved • ICS has developed touch interfaces on across devices and industries • ICS is the world’s largest independent supplier of Qt services • Our experience provides tangible value to customers • Reduced risk • Understand tradeoffs • Create rapid prototypes Why it matters It is well established that a programmer’s effort exponentially decreases as his/her experience increases, reducing cost and risk. Process 37
  • 38. © Integrated Computer Solutions, Inc. All Rights Reserved • All the disciplines • Software Architect, Project Manager, Engineer • Human Factors, Visual Designer, Graphic Designer, UX Designer • Can tap expertise as needed • Team-based approach Why it matters People have the skills & experience required, so work gets done faster. Problems are discovered and solved earlier, reducing cost and risk. People 38
  • 39. © Integrated Computer Solutions, Inc. All Rights Reserved Terra for IVI
  • 40. © Integrated Computer Solutions, Inc. All Rights Reserved What is Next? • Automotive industry is at the center of a paradigm shift • Demand for connected lifestyle is evident • Must keep up with the pace of developing mobile and home automation ecosystems • Automotive industry could separate shareable components from differentiating value propositions • Joint development of common, shareable components based on open standards • Provides the platform to hold pace with development cycles of mobile industry • Autonomous mobility will accelerate demand for connected lifestyle 40
  • 41. © Integrated Computer Solutions, Inc. All Rights Reserved Questions? www.ics.com 41