Paper 3632


Published on

Published in: Technology, Business
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Paper 3632

  1. 1. EUROFOT: A RISKS ANALYSIS Marco Dozza1, Karsten Heinig1*, Emma Johansson1, Lena Kanstrup1, Fredrik Moeschlin1, Erik Svanberg1, Johan Engström1, Zoran Antic2, Claes Avedal2 1. Volvo Technology Corporation, Sweden 2. Volvo 3P, Sweden Karsten Heinig Götaverksgatan 10, M1.6 40508 Göteborg, Sweden +46 31 322 74 69 ABSTRACT Field operational tests (FOTs) are studies aimed at collecting data in real-traffic in order, for example, to evaluate the actual impact of in-vehicle systems on road safety. Both Japan and the US have a long history of FOTs which demonstrated both how powerful and delicate FOTs can be. In fact, on the one hand FOT data has the potential to answer in a definitive, quantitative, and statistically significant way many questions related to the actual benefits of new technologies. On the other hand, the high complexity of such studies results in a number of challenges to be faced and risks to be managed. euroFOT is one of the first large scale field operational test in Europe and aims at collecting extended data (from Controller Area Network, cameras, and extra sensors) from 1500 vehicles in real-traffic. euroFOT has the potential to catch up and even go beyond US/Japan. However, euroFOT’s high ambitions and complexity imply a number of challenges and risks. In this paper, the main challenges and risks foreseen at the moment from an Original Equipment Manufacturer stand point in euroFOT are discussed and risk management actions to minimize risks in the euroFOT project are also presented. KEYWORD field operational test, euroFOT, in-vehicle safety systems, risk management INTRODUCTION Field operational tests (FOTs) are studies undertaken to evaluate a function, or functions, under normal operating conditions in environments typically encountered by the host vehicles(s) using quasi-experimental methods [1]. FOT studies in the US and in Japan have already shown how, for instance, by using frontal collision warning and adaptive cruise 1
  2. 2. control, accidents can be reduced up to 28% (Volvo Intelligent Vehicle Initiative Field Operational Test [2]). However, such information for European traffic is still missing due to the limited number of FOT studies performed so far in Europe. euroFOT [3] is a FP7, EC-funded FOT which promises, together with TeleFOT [4], and other national FOTs (e.g. AOS [5] and SeMiFOT [6]) now in progress, to partially fill in the gap of knowledge in between Europe and US/Japan by assessing the impact of in-vehicle systems on the European traffic. Previous FOTs evidenced how delicate FOTs are and how high is the risk of technical failure resulting in data loss in such tests. Therefore, euroFOT success depends on this project ability to successfully overcome 1) well-known challenges individuated by previous FOTs and 2) new challenges which originate from the new FOT geographical location (e.g. European-specific ethical and legal regulations). In this paper, some of the challenges that euroFOT, as well as most of the other European FOTs, will need to face in the next couple of years to successfully achieve what they have promised are discussed from an Original Equipment Manufacturer (OEM) point of view. CHALLENGES IN THE EXECUTION OF EUROFOT euroFOT is a very complex project because it comprises: 1) installing additional hardware in a large number of vehicles spread across Europe, 2) collecting, uploading, and analysing huge amounts of data, 3) taking care of legal issues related to the continuous collection of data (such as video recording of real traffic), 4) guarantying the driver’s ethical rights during the test, and 5) protecting the proprietary developments of the different OEMs and suppliers involved in this project. In the rest of this section, we discuss 1) how this implicit complexity of euroFOT results in a number of challenges and risks for the success of euroFOT (Figure 1) and 2) how euroFOT can face theses challenges and manage these risks. Figure 1 – Main risks in euroFOT which may severely and negatively impact the project. 2
  3. 3. Recruitment and Communication with the Participants euroFOT is recruiting 1500 customer vehicles. Recruitment is crucial for the euroFOT execution since lack of participants will proportionally result in lack of data, and potentially impair statistical significance of the results. Customers are very important for the profit of the OEMs involved in euroFOT, so any discomfort from participating to euroFOT needs to be avoided. Discomfort to the customers may be originated by 1) unclear communication of the consequences of participating to euroFOT, 2) malfunctioning of the logging systems resulting in partial or total malfunctioning of the vehicles, 3) intensive communication or demands to collect subjective data, 4) stand still time for the vehicle due to data collection or installation and maintenance of the data acquisition systems (DASs). In order to avoid (or at least mitigate) customers’ discomfort, euroFOT is 1) creating a good OEM-specific communication plan with the euroFOT participants, 2) planning on performing extensive pilot tests (see Loggers’ installation and data collection paragraph below), and 3) working on a strategy to offer continuous support and incentive the customers. Legal and ethical regulations across Europe euroFOT is collecting petabytes of data. Data will come from the Controller Area Network (CAN), extra sensors such as eye tracking systems and accelerometers, and video cameras. Regulations for collection, ownership, and storage of such data may differ across Europe. Nevertheless, euroFOT data collection needs to comply with the legal requirements of each country. For this reasons, euroFOT already asked support to the EUCAR consortium to understand European, country-specific, legal requirements. Additional support from the European Commission or projects such as FOT-NET [7] may be necessary for euroFOT to gather enough information about legal requirements in Europe and successfully comply with these requirements. Further, video cameras will record both the drivers’ and the vehicles surrounding. Data privacy is therefore an issue since position of many vehicles and people will be stored and time stamped in the data loggers. In addition, video recording might be legally restricted in proximity of military areas, airports, boarders, industrial delivery areas, etc… Collection of data where not authorized and access of private data from anybody outside the project may seriously and negatively impact euroFOT. The probability that one of the euroFOT vehicles will be involved in a crash is statistically low, however, it is possible. Such a situation may constitute a risk for the project since: 1) it will need to be proved that the data acquisition system installation did not induce (or contribute to) the accident and 2) the data recorded by the logger may be used by public authorities against the driver participating to euroFOT. Depending on the different European countries, a FOT may be considered an experiment with human subjects and may therefore need to comply with the Declaration of Helsinki [8] and corresponding national laws. Support from the European Commission or projects such as FOT-NET [7] may be necessary for euroFOT to be aware of the different ethical regulations in the different European countries and be able to guarantee that the participants’ ethical rights are guaranteed accordingly. Data Acquisition System and Data Collection 3
  4. 4. Data collection in euroFOT is accomplished in two main steps: 1) the collection of data in the vehicles by means of a data acquisition system and 2) the upload of the recorded data to a data base. Hence data collection depends on the availability of a suitable and validated data acquisition system (DAS) and upload procedure. A DAS consists of one or more main units for recording of all data sources of interest, such as the vehicle communication networks (e. g. CAN or Local Interconnect Network), several cameras recording the vehicle surroundings, and data from additional sensing equipment like eye-/ head tracking or accelerometers. It consists of course also of all necessary cable harnesses and communication gateways. To minimize the necessary efforts for installing and maintaining a DAS during the runtime of the FOT, several demands must be met, such as 1) an easy, time and resource efficient as well as a rugged and OEM regulation compliant installation of all units in the vehicles, while at the same time providing easy accessibility of the different units for maintenance during the runtime of the FOT, 2) providing means for an easy, robust, time- and resource-efficient collection or upload of the data. Wireless data upload is preferable, but might not be possible due to huge amounts of video data, 3) the DAS must fulfil legal requirements relevant for automotive products since it might not always be possible to avoid customer owned vehicles, which are not classified as test vehicles. 4) the DAS and the data collection process must be fully validated in two consecutive steps. First, a pilot study will be carried out before the majority of the vehicles can be instrumented. Secondly, every single installation of a DAS in a FOT vehicle will be validated by following a vehicle specific procedure. The pilot study includes a validation of all units of the DAS, but also of the complete DAS as it will be installed in the FOT vehicles. It consists of extensive tests of the DAS on the workbench and in its test installation in the pilot vehicles in all relevant use cases and of several test drives including predefined driving manoeuvres and driving in a realistic traffic environment, that is, in real traffic. In order to properly test all equipment and reduce technical risks, euroFOT is planning on having extensive piloting. In fact, in vehicle adaptation and piloting are in the process to be re-planned at each OEM. This re-planning is aimed at guaranteeing longer time to test 1) the prototype vehicle and the DAS, 2) the data collection, uploading and storing, chain, and 3) the data analysis procedure – by collecting representative data able to test the script for data analysis and the database functionalities. Data analysis and overall presentation of the results euroFOT will evaluate the impact of 8 different in-vehicle systems on safety, environment, mobility, and usage and acceptance. The main risk for the data analysis is to be inconclusive due to, for example, 1) lack of statistical significance, 2) lack of time to complete the analysis, or 3) lack of data due to technical issues. However, data analysis may also be hindered in case, for instance, if the OEM’s and supplier’s proprietary knowledge are not sufficiently protected. For example, radar data from adaptive cruise control systems may not be shared by the OEMs since, reverse engineering on such data would result in disclosing proprietary algorithms. Interest in participating to the euroFOT project may totter from the OEMs and suppliers side when balanced with the risk of disclosing proprietary information, and have consequently a negative impact on data analysis. This risk can be avoided by setting reasonable expectations about the extent and modality of data sharing which can be 4
  5. 5. envisioned inside the euroFOT project. Discussions on this issue have been initiated among the euroFOT steering committee members. CONCLUSIONS euroFOT is an ambitious project which will face several challenges. This paper discusses some of the risks involved with facing such challenges. Specifically, 1) not fulfilling legal and ethical European regulation, 2) presence of DAS technical problems, and 3) uncontrolled data sharing seem to constitute the major risks in euroFOT. Active support from the European Commission and FOT-NET may be the only way to guarantee the fulfilment of legal and ethical European regulation; extensive testing is necessary to minimize technical-related risks; and, finally, a clear plan on data sharing seems the best way to prevent undesired sharing of the risks of proprietary knowledge. In euroFOT, risk management actions are in progress to avoid, minimize, or mitigate all risks individuated so far. REFERENCES [1] FESTA Consortium, (2008). FESTA Consortium. D6.4 - festa handbook. Technical report. [2] Battelle, (2007). Evaluation of the Volvo intelligent vehicle initiative field operational test. Final report. [3] euroFOT Consortium, (2008). [4] TeleFOT Consortium, (2008). [5] Robbert Verweij, (2008). Field operational test - accident prevention systems for lorries. [6] SeMiFOT Consortium, (2008). analysis/semifot [7] FOT-NET Consortium, (2008). [8] The World Medical Association, (2008). World medical association declaration of helsinki. Ethical principles for medical research involving human subjects. 5