Augmented  Reality<br />
Tracking-Learning-Detection (Predator ) Algorithm<br />HCI Demo using Virtual Mouse<br />
Augmented Reality?<br />Overlaying of digital data on the real world<br />
The Team <br />Navneet<br />Nikhil<br />Manohar<br />Ritesh<br />http://tinyurl.com/twdemo<br />
We built <br />“ <br />An augmented reality application to be used inside an Enterprise to manage contacts and location se...
PANACEA<br />TWANACEA<br />* Possible names for the application<br />
Contacts<br />Problems<br />Not Updated<br />Unmanageable<br />Non-scalable<br />
Contacts<br />Problems<br />Wait! Is there a name of a person as well? So, now I know the person as well his/her phone num...
Contacts<br />Problems<br />Navneet KumarDeveloper<br />ThoughtWorks Technologies (India) Pvt Ltd2nd Floor, Tower C, Corpo...
Contacts<br />Problems<br /> Future of Visiting Cards<br />Navneet Kumar<br />With Best Wishes <br />ThoughtWorks Technolo...
Contacts<br />Problems<br />My only use for it now is to attach it to gifts that I give. <br />
A radical new way of exchanging contacts inside the enterprise<br />vCards 2.0 <br />
      Contacts Management <br />
You meet these guys at Dev-Camp. How long do you think it will take you exchange your contact information? <br /> We say a...
Possibilities …<br />* Stock photo from stck.xchng<br />
A new way of putting up Assistance and event posters.<br />Posters<br />
A new way of putting up assistance posters. No numbers, no hassles. <br />For all Travel related Queries<br />Logon to PAN...
X-Conf 4 – March 5th<br />Event Posters - Revisited<br />//TODO: Add functionality that will add this event to your calend...
Presence <br />* VISION<br />@starkcoffee - hopefully my.thoughtworks will be a completely fresh experience to TWers !<br />
* VISION<br />Dinesh Tantri – Geek Lunch<br />Talk: Introducing  myThoughtWorks<br />Give Feedback , ask questions<br />Lo...
Event / Conference Feedback(2/2)<br />* VISION<br />Talk: Introducing  my.thoughtworks!<br />Comments<br />Feedback<br />P...
How we do this. <br />Tech<br />
  Application Walkthrough<br />
 - 3 step process<br /> - Core of the idea is a ML<br />Algorithm for face recognition<br /><ul><li>As with any ML algorit...
Step 1<br />Detecting…<br />No Faces in this Image<br />
Step 2<br />Scanning…<br />A Face Found !!!<br />
Step 3<br />Fetching…<br />Fetch Data From Active Directory<br />PratekhsaUday<br />Prateeksha@thoughtworks.com<br />Mobil...
Implementation and Challenges<br />Uh Oh!<br />
First Approach<br /> Training Set<br />Manual Training<br />Face Detection<br />LDAP<br />Face Recognition<br />Service Ca...
Problems with this approach <br />Too Painful<br /> Training Set<br />Manual Training<br />Face Detection<br />Face Recog...
Second Approach<br />Gives<br />Compile Using<br />opencv.so<br />C++ Libraries<br />Android NDK<br />opencv.so<br />Java ...
          Face Recognition<br />
Pros & Cons - Second Approach<br />opencv.so<br />Java Native Interface (JNI)<br />App<br />Not Accurate<br />Near Real ti...
Face Recognition<br />PANACEA<br />
Hybrid Approach<br />Face Detection<br />Scanning Mode<br />Face?<br />Yes<br />Face Recognition<br />Training Mode<br />
Train Every Employee ?? Damn ! It’s painful <br />
Distributed Dataset Training<br />
Do you know these applications?<br />* Logos courtesy their corresponding websites<br />
Location<br />Problems<br />    Only 13% of the smart phones sold across the world are Location Aware<br />  Less than 4% ...
Location<br />Problems<br />Too many places. Search doesn’t solve the problem either. <br />*screen shot courtesy google.c...
Location<br />Problems<br />Roof top Restaurant<br />Roof top - Bar<br />Pizzeria<br />Chinese Restaurant<br />Cafe<br />M...
Creating and using GPS agnostic Hyper local communities<br /> Location<br />
Introducing the PlaceMark!<br />Join my community and share your thoughts<br />
Hyperlocal Community<br />
Enterprise Network<br />Chicago<br />Bangalore<br />Pune<br />Chennai<br />Melbourne<br />
Implementation<br />Face Detection<br />Scanning Mode<br />Face?<br />Yes<br />Face Recognition<br />Location?<br />
Application Architecture<br />Main UI Surface<br />Overlays<br />Camera<br />Info Overlay<br />status Overlay<br />Process...
Panacea
Upcoming SlideShare
Loading in …5
×

Panacea

1,511 views

Published on

it's an Augmented reality android app which can be used inside an enterprise to manage contacts and location services

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,511
On SlideShare
0
From Embeds
0
Number of Embeds
926
Actions
Shares
0
Downloads
9
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Augmented reality (AR) is a term for a live direct or an indirect view of a physical, real-world environment whose elements are augmented by computer-generated sensory input, such as sound or graphics. Simple Defn : overlaying of digital data on the real world.
  • Face Recognition – Once a face is detected, the face has to be processed by an algorithm which will associate a unique id from the training set.
  • Once the algorithm returns a unique identifier based on the processed image, we fetch the data corresponding to that id. In our case, the details from Active Directory. (actually, not just AD)
  • We found Open Source Computer Vision. A free library that does object detection, recognition and 500 other image processing algorithm
  • This video visualizes the detection process of OpenCV&apos;s face detector. The algorithm uses the Viola Jones method of calculating the integral image and then performing some calculations on all the areas defined by the black and white rectangles to analyze the differences between the dark and light regions of a face. The sub-window (in red) is scanned across the image at various scales to detect if there is a potential face within the window. If not, it continues scanning. If it passes all stages in the cascade file, it is marked with a red rectangle. But this does not yet confirm a face. In the post-processing stage all the potential faces are checked for overlaps. Typically, 2 or 3 overlapping rectangles are required to confirm a face. Loner rectangles are rejected as false-positives.In stead of finding faces, the algorithm should discard non-faces.
  • Panacea

    1. 1. Augmented Reality<br />
    2. 2. Tracking-Learning-Detection (Predator ) Algorithm<br />HCI Demo using Virtual Mouse<br />
    3. 3. Augmented Reality?<br />Overlaying of digital data on the real world<br />
    4. 4. The Team <br />Navneet<br />Nikhil<br />Manohar<br />Ritesh<br />http://tinyurl.com/twdemo<br />
    5. 5. We built <br />“ <br />An augmented reality application to be used inside an Enterprise to manage contacts and location services.<br />“ <br />
    6. 6. PANACEA<br />TWANACEA<br />* Possible names for the application<br />
    7. 7.
    8. 8.
    9. 9. Contacts<br />Problems<br />Not Updated<br />Unmanageable<br />Non-scalable<br />
    10. 10. Contacts<br />Problems<br />Wait! Is there a name of a person as well? So, now I know the person as well his/her phone number.<br />What happens if the Phone number changes?<br />Exposed Phone numbers<br />
    11. 11. Contacts<br />Problems<br />Navneet KumarDeveloper<br />ThoughtWorks Technologies (India) Pvt Ltd2nd Floor, Tower C, Corporate Block, Diamond District Airport Road, Bangalore - 560 008, Indiatel : +91 80 4064 9570, fax : +91 9686577076<br />navneetk@thoughtworks.com <br />… passé <br />
    12. 12. Contacts<br />Problems<br /> Future of Visiting Cards<br />Navneet Kumar<br />With Best Wishes <br />ThoughtWorks Technologies (India) Pvt Ltd2nd Floor, Tower C, Corporate Block, Diamond District Airport Road, Bangalore - 560 008, Indiatel : +91 80 4064 9570, fax : +91 9686577076<br />navneetk@thoughtworks.com <br />. . .You know why? <br />
    13. 13. Contacts<br />Problems<br />My only use for it now is to attach it to gifts that I give. <br />
    14. 14. A radical new way of exchanging contacts inside the enterprise<br />vCards 2.0 <br />
    15. 15. Contacts Management <br />
    16. 16. You meet these guys at Dev-Camp. How long do you think it will take you exchange your contact information? <br /> We say about 10 seconds! <br />
    17. 17. Possibilities …<br />* Stock photo from stck.xchng<br />
    18. 18. A new way of putting up Assistance and event posters.<br />Posters<br />
    19. 19. A new way of putting up assistance posters. No numbers, no hassles. <br />For all Travel related Queries<br />Logon to PANACEA<br />Powered by PANACEA<br />
    20. 20. X-Conf 4 – March 5th<br />Event Posters - Revisited<br />//TODO: Add functionality that will add this event to your calendar and notify you 10 mins before the event <br />Don't do that, then! (Doctor, it hurts when I rewrite legacy applications)<br />Powered by PANACEA<br />* Photo courtesy thoughtworker.com<br />
    21. 21. Presence <br />* VISION<br />@starkcoffee - hopefully my.thoughtworks will be a completely fresh experience to TWers !<br />
    22. 22. * VISION<br />Dinesh Tantri – Geek Lunch<br />Talk: Introducing myThoughtWorks<br />Give Feedback , ask questions<br />Logon to PANACEA<br />Powered by PANACEA<br />Event / Conference Feedback(1/2)<br />PANACEA<br />
    23. 23. Event / Conference Feedback(2/2)<br />* VISION<br />Talk: Introducing my.thoughtworks!<br />Comments<br />Feedback<br />PANACEA<br />
    24. 24. How we do this. <br />Tech<br />
    25. 25. Application Walkthrough<br />
    26. 26. - 3 step process<br /> - Core of the idea is a ML<br />Algorithm for face recognition<br /><ul><li>As with any ML algorithm, the larger the training set, the better the quality of the algorithm. </li></ul> Face Recognition<br />Status flags convey what thread is currently active and processing.<br />
    27. 27. Step 1<br />Detecting…<br />No Faces in this Image<br />
    28. 28. Step 2<br />Scanning…<br />A Face Found !!!<br />
    29. 29. Step 3<br />Fetching…<br />Fetch Data From Active Directory<br />PratekhsaUday<br />Prateeksha@thoughtworks.com<br />Mobile : 9686577076<br />
    30. 30. Implementation and Challenges<br />Uh Oh!<br />
    31. 31. First Approach<br /> Training Set<br />Manual Training<br />Face Detection<br />LDAP<br />Face Recognition<br />Service Calls<br />App<br />Massive Database of Photos<br />
    32. 32. Problems with this approach <br />Too Painful<br /> Training Set<br />Manual Training<br />Face Detection<br />Face Recognition<br />Service Calls<br />App<br />Not Real time – Not scalable<br />
    33. 33. Second Approach<br />Gives<br />Compile Using<br />opencv.so<br />C++ Libraries<br />Android NDK<br />opencv.so<br />Java Native Interface (JNI)<br />App<br />
    34. 34. Face Recognition<br />
    35. 35. Pros & Cons - Second Approach<br />opencv.so<br />Java Native Interface (JNI)<br />App<br />Not Accurate<br />Near Real time<br />No Service Calls<br />Poor Training data<br />Totally in Phone<br />
    36. 36. Face Recognition<br />PANACEA<br />
    37. 37. Hybrid Approach<br />Face Detection<br />Scanning Mode<br />Face?<br />Yes<br />Face Recognition<br />Training Mode<br />
    38. 38. Train Every Employee ?? Damn ! It’s painful <br />
    39. 39. Distributed Dataset Training<br />
    40. 40.
    41. 41. Do you know these applications?<br />* Logos courtesy their corresponding websites<br />
    42. 42. Location<br />Problems<br /> Only 13% of the smart phones sold across the world are Location Aware<br /> Less than 4% of all mobile phones sold last year were Location aware.<br /> * Stats courtesy: http://textopiablog.wordpress.com/2010/02/22/how-many-people-own-a-location-aware-device/<br />
    43. 43. Location<br />Problems<br />Too many places. Search doesn’t solve the problem either. <br />*screen shot courtesy google.com <br />
    44. 44. Location<br />Problems<br />Roof top Restaurant<br />Roof top - Bar<br />Pizzeria<br />Chinese Restaurant<br />Cafe<br />Multiple Avenues – Same GPS Location <br />
    45. 45. Creating and using GPS agnostic Hyper local communities<br /> Location<br />
    46. 46. Introducing the PlaceMark!<br />Join my community and share your thoughts<br />
    47. 47. Hyperlocal Community<br />
    48. 48. Enterprise Network<br />Chicago<br />Bangalore<br />Pune<br />Chennai<br />Melbourne<br />
    49. 49. Implementation<br />Face Detection<br />Scanning Mode<br />Face?<br />Yes<br />Face Recognition<br />Location?<br />
    50. 50. Application Architecture<br />Main UI Surface<br />Overlays<br />Camera<br />Info Overlay<br />status Overlay<br />Processing<br />Android native detection<br />Recognition service<br />Gab server<br />Location server<br />PANACEA<br />

    ×