MiSnap is a mobile imaging platform that provides real-time feedback and automatically captures images of documents to extract data for tasks like deposits and bill payments. The team developed an application for Google Glass to allow touchless extraction of data from driver's licenses using MiSnap, as Glass is designed for touchless interaction. However, limitations in the Glass camera prevented automatic image capture, requiring the user to take pictures manually. Future improvements could support automatic capture and multiple document types if camera functions improve.

1. Group M: MiSnap on Google
Glass
Final Presentation
Team Members: Maxence Dutreix, Junjie Ma, Wei Wang, Luyao Zhou
Mentors: Zohrab Broyan, Fritz Hesse
Sponsor: Mitek System
1

2. What is MiSnap?
● Mitek Mobile imaging platform
● Provides real-time feedback until suitable image of document is
detected
● Automatically captures picture
and server extracts data from it
● Fast way to make deposit,
pay bill. Simplify sign-ups
2

3. Motivations
● More and more devices tend to be touchless
● Google Glass is one of the most advanced touchless device
● Problem: limited keyboard interaction. How do you type in
text more effectively?
● Solution: MiSnap touchless data extraction!
3

4. Google Glass
● Wearable Android device equipped with
a camera, a microphone, a screen (optical
head-mounted display) and a trackpad on
the side
● Built around touchlessness. Menu designed
to be navigated using voice commands
● Wirelessly connected to the internet
4

5. Application design
The goal of our application is to extract data from a California Driver License
5

6. Launch application
“Ok Glass” voice
command
Tap on
home card
6

7. Take a picture
User taps
to
take picture
User swipes to
reject image
User taps to
accept picture
7

8. Display extracted data
Server accepts
image
Server rejects
image
8

9. Demo Video 1
9

10. Demo Video 2
10

11. Demo Video 3
11

12. Google Glass limitations
● Google Glass camera unable to perform autofocus
● MiSnap automatic image capture requires autofocus
functionality. This feature could not be implemented
● Still possible to extract data when picture taken manually
BUT cannot use real driver license (too small for current
version of the camera)
12

13. Potential improvements
● Implement automatic capture if future versions of Glass
allow it
● Detect and support multiple document types (our app
only accepts CA Driver License)
● Share extracted data with website/database/apps
13