Fachgebiet Verteilte Multimodale Informationsverarbeitung
Prof. Dr. Matthias Kranz                                          Technische Universität München




                        DriveAssist – A V2X-Based Driver
                         Assistance System for Android


        Stefan Diewald, Andreas Möller, Luis Roalter and Matthias Kranz




                                      Konstanz, September 11, 2012
                                             Automotive HMI
                                  Workshop at Mensch und Computer 2012
Fachgebiet Verteilte Multimodale Informationsverarbeitung
Prof. Dr. Matthias Kranz                                              Technische Universität München



Outline

§  Motivation of our Solution

§  System Overview

§  DriveAssist - Functionality Overview

§  Supported Use-Cases

§  Live Demo

§  Conclusion and Future Work




11.09.2012       Dipl.-Ing. Stefan Diewald           Automotive HMI                                    2
Fachgebiet Verteilte Multimodale Informationsverarbeitung
Prof. Dr. Matthias Kranz                                                        Technische Universität München



Motivation and State of the Art

•     V2X-Communications
       §  Goal: Increase traffic safety and driving convenience
       §  In-Car-Applications and Services
       §  State of the Art: e.g. radio communication concepts, GeoNetworking, data
           generation concepts

•     Smartphone Integration
       §  Android as an economic and easily accessible platform
       §  High availability of devices
       §  Users are accustomed to devices and HMI
       §  State of the Art: e. g. pothole/traffic sign detection, vehicle state monitoring


              V2X-                                          Driver Assistance   Smartphone
          Communications                                         System          Integration

11.09.2012       Dipl.-Ing. Stefan Diewald           Automotive HMI                                              3
Fachgebiet Verteilte Multimodale Informationsverarbeitung
Prof. Dr. Matthias Kranz                                                               Technische Universität München



Bridge the Gap – Automotive vs. Consumer

                                          new                         old   obsolete



                            Apps


             Mobile Devices


      Vehicle: electronics


      Vehicle: mechanical
                                                                                                        time




11.09.2012       Dipl.-Ing. Stefan Diewald           Automotive HMI                                                     4
Fachgebiet Verteilte Multimodale Informationsverarbeitung
Prof. Dr. Matthias Kranz                                              Technische Universität München



System Overview




11.09.2012       Dipl.-Ing. Stefan Diewald           Automotive HMI                                    5
Fachgebiet Verteilte Multimodale Informationsverarbeitung
Prof. Dr. Matthias Kranz                                              Technische Universität München



DriveAssist – Functionality Overview (1)

§    Reception and decoding of CAMs/DENMs (V2X)
§    Warning generation on map view or with a warning screen
§    Algorithms for complex scenarios with multiple events / participants
§    Extendable platform to support Central Traffic Services (CTS), TomTom HD
      Traffic implemented (screenshots)




11.09.2012       Dipl.-Ing. Stefan Diewald           Automotive HMI                                    6
Fachgebiet Verteilte Multimodale Informationsverarbeitung
Prof. Dr. Matthias Kranz                                              Technische Universität München



DriveAssist – Functionality Overview (2)


§  Several customizable
    parameters (screenshots)
§  Database support
§  Debugging options
§  Location service supporting
    GPS, EGO CAM, AP/
    Network and static position




11.09.2012       Dipl.-Ing. Stefan Diewald           Automotive HMI                                    7
Fachgebiet Verteilte Multimodale Informationsverarbeitung
Prof. Dr. Matthias Kranz                                              Technische Universität München



DriveAssist – Warning Screen

§  Background service running on the Android device
§  Automatically triggered, shown on top of all other applications
§  Shows distance and direction of next relevant traffic incident
§  Configurable radius of interest
§  Accompanied by text-to-speech (TTS) output




11.09.2012       Dipl.-Ing. Stefan Diewald           Automotive HMI                                    8
Fachgebiet Verteilte Multimodale Informationsverarbeitung
Prof. Dr. Matthias Kranz                                              Technische Universität München



DriveAssist – Map View

§  Overview of (nearby) traffic incidents
§  Driver awareness with configurable radius
§  Notification about new traffic incidents
§  Detailed information by tapping warning sign




11.09.2012       Dipl.-Ing. Stefan Diewald           Automotive HMI                                    9
Fachgebiet Verteilte Multimodale Informationsverarbeitung
       Prof. Dr. Matthias Kranz                                                                               Technische Universität München



       Supported Use-Cases
       Signaled by DENM:                                                                         Signaled by CAM:
       1.  Electronic Emergency Brake Lights                                                     6. Approaching Emergency Vehicle
       2.  Working Area Warning
       3.  Stationary Vehicle Warning
       4.  Hazardous Location Notification
       5.  Traffic Jam Ahead Warning




                             1                      2                     3                      4        5                6


              Priority Mechanisms:
              1.  Moving events have higher priority than static events.
              2.  Events with decreasing distance to user have higher priority than
                  events with increasing distance.
              3.  Near events have higher priority than events which are further away.
Images 2, 4, 5: from http://de.wikipedia.org/wiki/Bildtafel_der_Verkehrszeichen_in_Deutschland


       11.09.2012        Dipl.-Ing. Stefan Diewald          Automotive HMI                                                                     10
Fachgebiet Verteilte Multimodale Informationsverarbeitung
Prof. Dr. Matthias Kranz                                              Technische Universität München



Live Demo
       Scenario 1




       Scenario 2




11.09.2012       Dipl.-Ing. Stefan Diewald           Automotive HMI                                    11
Fachgebiet Verteilte Multimodale Informationsverarbeitung
Prof. Dr. Matthias Kranz                                              Technische Universität München



Conclusion and Outlook

§  DriveAssist as first research prototype
§  Combination of V2X communication and central traffic services:
    Good operability from the beginning on, even when there are only a few
    vehicles equipped with V2X
§  Active and passive awareness and warning element



Future Work:
§  Evaluation of DriveAssist: user study
§  HMI rework
§  Integration of route and map context




11.09.2012       Dipl.-Ing. Stefan Diewald           Automotive HMI                                    12
Fachgebiet Verteilte Multimodale Informationsverarbeitung
Prof. Dr. Matthias Kranz                                                       Technische Universität München




                                            DriveAssist – A V2X-Based Driver
                                             Assistance System for Android




11.09.2012       Dipl.-Ing. Stefan Diewald           Automotive HMI                                             13
Fachgebiet Verteilte Multimodale Informationsverarbeitung
Prof. Dr. Matthias Kranz                                               Technische Universität München




                                           Thank you for your attention!
                                                  Questions?




                                                            ?
                                                            ?
                                  stefan.diewald@tum.de
                         www.vmi.ei.tum.de/team/stefan-diewald.html

20.09.2012       Luis Roalter                                                                           14
Fachgebiet Verteilte Multimodale Informationsverarbeitung
Prof. Dr. Matthias Kranz                                       Technische Universität München



Paper Reference

•     Please find the associated paper at:
      https://vmi.lmt.ei.tum.de/publications/2012/DriveAssist_preprint.pdf

•     Please cite this work as follows:
•     Stefan Diewald, Andreas Möller, Luis Roalter, Matthias Kranz. 2012.
      DriveAssist - A V2X-Based Driver Assistance System for Android
      In: Automotive HMI Workshop at Mensch und Computer 2012, Konstanz,
      Germany, September 2012




20.09.2012       Luis Roalter                                                                   15
Fachgebiet Verteilte Multimodale Informationsverarbeitung
Prof. Dr. Matthias Kranz                                                              Technische Universität München



If you use BibTex, please use the following entry
to cite this work:



 @inproceedings{DBLP:conf/mc/DiewaldMRK12,
   author = {Stefan Diewald and Andreas M{"o}ller and Luis Roalter and Matthias Kranz},
   title = {{DriveAssist - A V2X-Based Driver Assistance System for Android}},
   booktitle = {Mensch {&} Computer Workshopband},
   year     = {2012},
   pages = {373--380},
   ee      = {http://dl.mensch-und-computer.de/handle/123456789/2990},
   crossref = {DBLP:conf/mc/2012w},
   bibsource = {DBLP, http://dblp.uni-trier.de},
 }
 @proceedings{DBLP:conf/mc/2012w,
   editor = {Harald Reiterer and Oliver Deussen},
   title = {Mensch {&} Computer 2012 - Workshopband: interaktiv informiert
            - allgegenw{"a}rtig und allumfassend!? Konstanz, Germany, September 9-12, 2012},
   booktitle = {Mensch {&} Computer Workshopband},
   publisher = {Oldenbourg Verlag},
   year     = {2012},
   ee      = {http://dl.mensch-und-computer.de/handle/123456789/2858},
   bibsource = {DBLP, http://dblp.uni-trier.de},
 }

20.09.2012       Luis Roalter                                                                                          16

DriveAssist – A V2X-Based Driver Assistance System for Android

  • 1.
    Fachgebiet Verteilte MultimodaleInformationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München DriveAssist – A V2X-Based Driver Assistance System for Android Stefan Diewald, Andreas Möller, Luis Roalter and Matthias Kranz Konstanz, September 11, 2012 Automotive HMI Workshop at Mensch und Computer 2012
  • 2.
    Fachgebiet Verteilte MultimodaleInformationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München Outline §  Motivation of our Solution §  System Overview §  DriveAssist - Functionality Overview §  Supported Use-Cases §  Live Demo §  Conclusion and Future Work 11.09.2012 Dipl.-Ing. Stefan Diewald Automotive HMI 2
  • 3.
    Fachgebiet Verteilte MultimodaleInformationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München Motivation and State of the Art •  V2X-Communications §  Goal: Increase traffic safety and driving convenience §  In-Car-Applications and Services §  State of the Art: e.g. radio communication concepts, GeoNetworking, data generation concepts •  Smartphone Integration §  Android as an economic and easily accessible platform §  High availability of devices §  Users are accustomed to devices and HMI §  State of the Art: e. g. pothole/traffic sign detection, vehicle state monitoring V2X- Driver Assistance Smartphone Communications System Integration 11.09.2012 Dipl.-Ing. Stefan Diewald Automotive HMI 3
  • 4.
    Fachgebiet Verteilte MultimodaleInformationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München Bridge the Gap – Automotive vs. Consumer new old obsolete Apps Mobile Devices Vehicle: electronics Vehicle: mechanical time 11.09.2012 Dipl.-Ing. Stefan Diewald Automotive HMI 4
  • 5.
    Fachgebiet Verteilte MultimodaleInformationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München System Overview 11.09.2012 Dipl.-Ing. Stefan Diewald Automotive HMI 5
  • 6.
    Fachgebiet Verteilte MultimodaleInformationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München DriveAssist – Functionality Overview (1) §  Reception and decoding of CAMs/DENMs (V2X) §  Warning generation on map view or with a warning screen §  Algorithms for complex scenarios with multiple events / participants §  Extendable platform to support Central Traffic Services (CTS), TomTom HD Traffic implemented (screenshots) 11.09.2012 Dipl.-Ing. Stefan Diewald Automotive HMI 6
  • 7.
    Fachgebiet Verteilte MultimodaleInformationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München DriveAssist – Functionality Overview (2) §  Several customizable parameters (screenshots) §  Database support §  Debugging options §  Location service supporting GPS, EGO CAM, AP/ Network and static position 11.09.2012 Dipl.-Ing. Stefan Diewald Automotive HMI 7
  • 8.
    Fachgebiet Verteilte MultimodaleInformationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München DriveAssist – Warning Screen §  Background service running on the Android device §  Automatically triggered, shown on top of all other applications §  Shows distance and direction of next relevant traffic incident §  Configurable radius of interest §  Accompanied by text-to-speech (TTS) output 11.09.2012 Dipl.-Ing. Stefan Diewald Automotive HMI 8
  • 9.
    Fachgebiet Verteilte MultimodaleInformationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München DriveAssist – Map View §  Overview of (nearby) traffic incidents §  Driver awareness with configurable radius §  Notification about new traffic incidents §  Detailed information by tapping warning sign 11.09.2012 Dipl.-Ing. Stefan Diewald Automotive HMI 9
  • 10.
    Fachgebiet Verteilte MultimodaleInformationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München Supported Use-Cases Signaled by DENM: Signaled by CAM: 1.  Electronic Emergency Brake Lights 6. Approaching Emergency Vehicle 2.  Working Area Warning 3.  Stationary Vehicle Warning 4.  Hazardous Location Notification 5.  Traffic Jam Ahead Warning 1 2 3 4 5 6 Priority Mechanisms: 1.  Moving events have higher priority than static events. 2.  Events with decreasing distance to user have higher priority than events with increasing distance. 3.  Near events have higher priority than events which are further away. Images 2, 4, 5: from http://de.wikipedia.org/wiki/Bildtafel_der_Verkehrszeichen_in_Deutschland 11.09.2012 Dipl.-Ing. Stefan Diewald Automotive HMI 10
  • 11.
    Fachgebiet Verteilte MultimodaleInformationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München Live Demo Scenario 1 Scenario 2 11.09.2012 Dipl.-Ing. Stefan Diewald Automotive HMI 11
  • 12.
    Fachgebiet Verteilte MultimodaleInformationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München Conclusion and Outlook §  DriveAssist as first research prototype §  Combination of V2X communication and central traffic services: Good operability from the beginning on, even when there are only a few vehicles equipped with V2X §  Active and passive awareness and warning element Future Work: §  Evaluation of DriveAssist: user study §  HMI rework §  Integration of route and map context 11.09.2012 Dipl.-Ing. Stefan Diewald Automotive HMI 12
  • 13.
    Fachgebiet Verteilte MultimodaleInformationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München DriveAssist – A V2X-Based Driver Assistance System for Android 11.09.2012 Dipl.-Ing. Stefan Diewald Automotive HMI 13
  • 14.
    Fachgebiet Verteilte MultimodaleInformationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München Thank you for your attention! Questions? ? ? stefan.diewald@tum.de www.vmi.ei.tum.de/team/stefan-diewald.html 20.09.2012 Luis Roalter 14
  • 15.
    Fachgebiet Verteilte MultimodaleInformationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München Paper Reference •  Please find the associated paper at: https://vmi.lmt.ei.tum.de/publications/2012/DriveAssist_preprint.pdf •  Please cite this work as follows: •  Stefan Diewald, Andreas Möller, Luis Roalter, Matthias Kranz. 2012. DriveAssist - A V2X-Based Driver Assistance System for Android In: Automotive HMI Workshop at Mensch und Computer 2012, Konstanz, Germany, September 2012 20.09.2012 Luis Roalter 15
  • 16.
    Fachgebiet Verteilte MultimodaleInformationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München If you use BibTex, please use the following entry to cite this work: @inproceedings{DBLP:conf/mc/DiewaldMRK12, author = {Stefan Diewald and Andreas M{"o}ller and Luis Roalter and Matthias Kranz}, title = {{DriveAssist - A V2X-Based Driver Assistance System for Android}}, booktitle = {Mensch {&} Computer Workshopband}, year = {2012}, pages = {373--380}, ee = {http://dl.mensch-und-computer.de/handle/123456789/2990}, crossref = {DBLP:conf/mc/2012w}, bibsource = {DBLP, http://dblp.uni-trier.de}, } @proceedings{DBLP:conf/mc/2012w, editor = {Harald Reiterer and Oliver Deussen}, title = {Mensch {&} Computer 2012 - Workshopband: interaktiv informiert - allgegenw{"a}rtig und allumfassend!? Konstanz, Germany, September 9-12, 2012}, booktitle = {Mensch {&} Computer Workshopband}, publisher = {Oldenbourg Verlag}, year = {2012}, ee = {http://dl.mensch-und-computer.de/handle/123456789/2858}, bibsource = {DBLP, http://dblp.uni-trier.de}, } 20.09.2012 Luis Roalter 16