Your SlideShare is downloading. ×
Panacea - Augmented Reality
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

Panacea - Augmented Reality

1,110
views

Published on

Published in: Design

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
1,110
On Slideshare
0
From Embeds
0
Number of Embeds
4
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. PANACEA
    TWANACEA
    * Possible names for the application
  • 2. The Team
    Navneet
    Nikhil
    Manohar
    Ritesh
  • 3. For people who are on webex
    Please visit this URL for all the videos that we play.
    http://tinyurl.com/twdemo
  • 4. We built

    An augmented reality application to be used inside an Enterprise to manage contacts and location services.

  • 5. Augmented Reality?
    Augmented reality (AR) is a term for a live direct or an indirect view of a physical, real-world environment whose elements are augmented by computer-generated sensory input, such as sound or graphics
    Simple Defn : overlaying of digital data on the real world.
    * Courtesy – wikipedia and howstuffworks.com
  • 6.
  • 7.
  • 8. Contacts
    Problems
  • 9. Contacts
    Problems
    Ritesh M NayakDeveloper
    ThoughtWorks Technologies (India) Pvt Ltd2nd Floor, Tower C, Corporate Block, Diamond District Airport Road, Bangalore - 560 008, Indiatel : +91 80 4064 9570, fax : +91 80 2508 9584
    riteshm@thoughtworks.com
    … passé
  • 10. Contacts
    Problems
    My next visiting card will look like this
    Ritesh M Nayak
    With Best Wishes
    ThoughtWorks Technologies (India) Pvt Ltd2nd Floor, Tower C, Corporate Block, Diamond District Airport Road, Bangalore - 560 008, Indiatel : +91 80 4064 9570, fax : +91 80 2508 9584
    riteshm@thoughtworks.com
    . . .You know why?
  • 11. Contacts
    Problems
    My only use for it now is to attach it to gifts that I give.
  • 12. A radical new way of exchanging contacts inside the enterprise
    vCards 2.0
  • 13. Contacts Management
    Video Demo – Play Video 1 on the supporting website
  • 14. You meet these guys at X-Conf. How long do you think it will take you exchange your contact information?
    We say about 10 seconds!
  • 15. How we do this.
    Tech
  • 16. Application Walkthrough
    Video Demo – Play Video 5 on the supporting website
  • 17. - 3 step process
    - Core of the idea is a ML
    Algorithm for face recognition
    • As with any ML algorithm, the larger the training set, the better the quality of the algorithm.
    Face Recognition
    Status flags convey what thread is currently active and processing.
  • 18. Step 1
    Detection /Scanning
    No faces in this image
    Face Detection –algorithm to detect if there is a face present on the given image.
  • 19. Step 2
    Recognition
    Point out the faces that were detected
    Face Recognition – Once a face is detected, the face has to be processed by an algorithm which will associate a unique id from the training set.
  • 20. Step 3
    Data/Action Fetch
    Augement real time image with info bubble
    PrateekshaUday
    nono@hotmail.com
    9889090123
    Once the algorithm returns a unique identifier based on the processed image, we fetch the data corresponding to that id. In our case, the details from Active Directory. (actually, not just AD)
  • 21. Implementation and Challenges
    Uh Oh!
  • 22.
  • 23. Face Recognition
    Video Demo – Play Video 2 on the supporting website
  • 24. First Approach
    Training Set
    Manual Training
    Face Detection
    LDAP
    Face Recognition
    Service Calls
    App
    Massive Database of Photos
  • 25. Problems with this approach 
    Too Painful
    Training Set
    Manual Training
    Face Detection
    Face Recognition
    Service Calls
    App
    Not Real time – Not scalable
  • 26. We found Open Source Computer Vision. A free library that does object detection, recognition and 500 other image processing algorithms.
    Yay!
    OpenCV is a C++ library 
  • 27. Second Approach
    Gives
    Compile Using
    opencv.so
    C++ Libraries
    Android NDK
    opencv.so
    Java Native Interface (JNI)
    App
  • 28. Pros & Cons - Second Approach
    opencv.so
    Java Native Interface (JNI)
    App
    Not Accurate
    Near Real time
    No Service Calls
    Poor Training data
    Totally in Phone
  • 29. Hybrid Approach
    Face Detection
    Scanning Mode
    Face?
    Yes
    Face Recognition
    Training Mode
  • 30. A new way of putting up Assistance and event posters.
    Posters
  • 31. Contacts
    Problems
    Wait! Is there a name of a person as well? So, now I know the person as well his/her phone number.
    What happens if the Phone number changes?
    Exposed Phone numbers are dangerous. Can be abused by telemarketers
  • 32. A new way of putting up assistance posters. No numbers, no hassles.
    For all Travel related Queries
  • 33. X-Conf 4 – March 5th
    Event Posters - Revisited
    //TODO: Add functionality that will add this event to your calendar and notify you 10 mins before the event
    Title: Don't do that, then! (Doctor, it hurts when I rewrite legacy applications)
    * Photo courtesy thoughtworker.com
  • 34. Presence
    * VISION
    @starkcoffee - hopefully my.thoughtworks will be a completely fresh experience to TWers !
  • 35. * Almost there
    Dinesh Tantri – Geek Lunch
    Talk: Introducing my.thoughtworks
    Give Feedback , ask questions – use panacea
    Event / Conference Feedback – 1
  • 36. Event / Conference Feedback - 2
    * Almost there
    Talk: Introducing my.thoughtworks!
    Comments
    Feedback
  • 37. * VISION
    Visual URL’s and Bookmarking
    Use OCR to save this URL on a poster or on a hoarding.
  • 38. Wait, does this mean we need to train photos of every employee?Damn, that’s painful.Luckily . . . We have a solution
  • 39. Distributed Dataset Training
    Video Demo – Play Video 3 on the supporting website
  • 40. Possibilities …
    * Stock photo from stck.xchng
  • 41.
  • 42. Do you know these applications?
    * Logos courtesy their corresponding websites
  • 43. Location
    Problems
    Only 13% of the smart phones sold across the world are Location Aware
    Less than 4% of all mobile phones sold last year were Location aware.
    * Stats courtesy: http://textopiablog.wordpress.com/2010/02/22/how-many-people-own-a-location-aware-device/
  • 44. Location
    Problems
    Too many places. Search doesn’t solve the problem either.
    *screen shot courtesy google.com
  • 45. Location
    Problems
    Roof top Restaurant
    Roof top - Bar
    Pizzeria
    Chinese Restaurant
    Cafe
    Multiple Avenues – Same GPS Location
  • 46. Creating and using GPS agnostic Hyper local communities
    Location
  • 47. But, how?
    Most smartphones come with a good camera. Given that we already had the technology to recognize faces, we just appropriated it to make a location service just like FourSquare or Gowalla.
    (our algorithms can be trained on other objects as well, like boards, toys etc)
  • 48. Introducing the PlaceMark!
    Join my community and share your thoughts
  • 49. HyperLocal Communities
    Video Demo – Play Video 4 on the supporting website
  • 50. Enterprise Network
    Chicago
    Bangalore
    Pune
    Chennai
    Melbourne
  • 51. Implementation
    Face Detection
    Scanning Mode
    Face?
    Yes
    Face Recognition
    Location?
  • 52. Genesis, Ideation and Development
    Prototype
  • 53. Mockups
    * We used http://iphonemockup.lkmc.ch/ for smart phone mockups
  • 54. Application Architecture
    Main UI Surface
    Overlays
    Camera
    Info Overlay
    status Overlay
    Processing
    Android native detection
    Recognition service
    Gab server
    Location server
    PANACEA

×