WheelLogger, Driver Tracing using SmartWatch The result of my research. 2017. 08. 23.

1. WheelLogger: Driver Tracing
using Smart Watch
Joon Young Park / Jong Pil Yoon / Dong Hoon Lee
Korea Unviersity

2. Agenda
• Overview
• Related Works
• What we did
• Conclusion

3. Permissions on iPhone/Watch

4. Permissions on iPhone/Watch
But NOT on sensor data

5. 11Pag
Touch logger
11Pa
Recover text
14Pg
Recognizing Speech
Dan Boneh
15Pa
Tracking metro
15Wag
Recover text using
SmartWatch
15Wa
Recover password
16Pagm
Route & Location
Related Works

6. 11Pag
Touch logger
11Pa
Recover text
14Pg
Recognizing Speech
Dan Boneh
15Pa
Tracking metro
15Wag
Recover text using
SmartWatch
15Wa
Recover password
16Pagm
Route & Location
Related Works

7. Motivation

8. First sketch
• Accel / Deceleration
• Right / Left turn
• Ascent / Descent
• Speed bumps
• Parking

9. System Overview

10. Application
• Collects accelerometer data of AppleWatch
• Save to iPhone
• Send the data to attacker’s server

11. System Overview

12. The Extractor

13. System Overview

14. The Extractor

15. System Overview

16. Filtering the RAW Data

17. Lagrange interpolation

18. Calculating the Distance traveled

19. Calculating the Distance traveled
from to
Calculated
Distance
163(m) 210(m)
Real
Distance
180(m) 230(m)

20. System Overview

21. Turning Detector

22. Turning Detector

23. Turning Detector

24. Turning Detector

25. Turning Detector
Method Algorithm Accuracy
Classification
LMT tree 93.9394%
Logisitic 93.9394%
Clustering
EM 93.9394%
K-Means 93.9394%
Filtered cluster 93.9394%

26. Turning Detector

27. System Overview

28. Route Drawer

29. System Overview

30. Map Matching

31. Experiment and Result

32. Assumptions
• Drivers are using Apple Watch, with our malware installed which can
send accelerometer data to adversary’s server.
• Drivers should grip steering wheel as a side-grip, down-grip or
double-grip.

33. Final result
76 to 84 % of accuracy

34. Conclusion

35. Main Contributions
• An efficient approach using mathematical and machine learning
method to infer driver’s route.
• A proposal of simple methodology of map matching framework.
• Proven that the side-channel attack using rich sensors can be
critical for user privacy.

36. Future Works
• Formal way for map matching algorithm using graph theory.
• Gyroscope data can be used to further accuracy.

37. Question & Answer