Thesis presentation easter

1,290 views

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,290
On SlideShare
0
From Embeds
0
Number of Embeds
580
Actions
Shares
0
Downloads
6
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Face based contact book: Gebruik je gezichtalsbusinesscard.
  • A solution needed to be found.
  • 11 wekenbezig => 20 uur per week = 220 uurwerkDesign = achter de schermen, API’s, scenarios, polls, privacy concerns,…
  • Thesis presentation easter

    1. 1. Augmented reality face recognition for mobile devices Gerry Hendrickx Promoter: Professor Erik Duval Coordinator: Gonzalo Parra 1
    2. 2. Overview• Recap• Implementation• Storyboard/Screen transition diagram• Evaluation• Demo• Problems• Todo• Planning• Statistics 2
    3. 3. Recap 3
    4. 4. Recap: ConceptAugmented reality face recognition for mobile devices… Camera of smartphone will beReal world augmented with extra used to accomplish goalsinformation, by using a camera -> Extra information on screen Extra information will be about people, by recognizing their faces Extra information will be taken from social networks … with social network information 4
    5. 5. Recap: Scenarios1. Get contact info2. Create a face based contact book3. Quick access to slides/publications by recognizing speaker4. Quick access to social network information 5
    6. 6. Recap: Technical info• iOS – Face detection• iPhone• Face.com – Free, SDK, private namespace,… 6
    7. 7. Recap: Paper prototyping• 3 iterations 7
    8. 8. Paper prototyping: Iteration 1 8
    9. 9. Paper prototyping: Iteration 1 9
    10. 10. Paper prototyping: Iteration 1 10
    11. 11. Paper prototyping: Iteration 2• Elaboration of UI3• New functionality: History, Settings, Overview 11
    12. 12. Paper prototyping: Iteration 2• Positive: • Negative: – Clean UI – Not enough home – iOS style buttons – The concept – Unclear contact icon – Not him/her button! 12
    13. 13. Paper prototyping: Iteration 3• Adapted to negative points• Tested with prof Duval and 5 assistants• Should improve: – Incorrect button – Still too much clicking to get somewhere => Tabbed Bar – Delete person from history 13
    14. 14. Implementation 14
    15. 15. Implementation: MVCController View ModelSocialRecognizerViewController SocialRecognizerView UserModelCameraViewController CameraViewOverviewViewController OverviewView RecognizedPersonHistoryViewController HistoryView UserModelSettingsViewController SettingsView UserModel FBRequestWrapper 15
    16. 16. Implementation: Class diagram 16
    17. 17. Implementation: Class diagram 17
    18. 18. Implementation: FBRequestWrapper– Singleton– Handles all requests from Facebook– Has delegate-methods– Preferred way to implement it! 18
    19. 19. Implementation: CameraViewController– Uses AVCaptureSession instead of UIImagePickerController– Linked with Face.com through API– Uses iOS5 face detection to track faces– Redraws facebox each frame– Tried to be memory efficient 19
    20. 20. Implementation: UserModel– Saves UID’s and names of friends Reduces # requests– Saves list of recognized persons– Saves the settings 20
    21. 21. Implementation: RecognizedUser– Saves UID and name of recognized person– Saves profile picture– Saves all other information received from Facebook request 21
    22. 22. Storyboard/Screen transition Diagram 22
    23. 23. Storyboard/Screen transition Diagram 23
    24. 24. Demo 24
    25. 25. Storyboard 25
    26. 26. Storyboard 26
    27. 27. Storyboard 27
    28. 28. Evaluation 28
    29. 29. Evaluation: Iteration 1– Tested with 7 smartphone users– 4 already tested the paper prototype– Current state of the app– Focus on face recognition– Results and comments were saturated fast 29
    30. 30. Evaluation: Iteration 1– Think aloud– Tasks– Extra questions about satisfaction– USE questionnaire 30
    31. 31. Evaluation: results– Tapping the face is cumbersome– Statusinfo 31
    32. 32. Problems 32
    33. 33. Problems– Knowing which face belongs to who– Tapping the face– Augmented part is failing… 33
    34. 34. Todo 34
    35. 35. Todo– Adapt to results evaluation– Implement history and settings– Training algorithm– Multiple social networks– Private namespace Requires database Which order??? 35
    36. 36. Planning 36
    37. 37. Planning 37
    38. 38. Statistics 38
    39. 39. Statistics# Blog posts 21# Comments on other blogs 10 (hcifetcher results: 3075)# Tweets concerning thesis 81Total # of hours worked 395# of hours on literature study 20# of hours on related work 10# of hours on reports/blog posts 26# of hours dedicated to other theses 18# of hours on iOS learning 52# of hours on design 35# of hours on paper prototype testing 28# of hours on paper prototype creating 35and evaluating# of hours on implementation 166# of hours on digital prototype testing 5 39
    40. 40. Thank you for listening! Questions? 40

    ×