Sixth Sense Technology based Virtual mouse and Virtual drawing D.Y Patil College of Engineering, Akurdi (Pune), India Presented by:- Guided by:- Ms.Priyanka JainProf Deepali Gothawal Mr.Sudhir Raut Mr.Harshal Ringe Mr.Mayur Patil
Contents What is Virtual Reality? Introduction Features Requirements How camera captures work? Processing and Overall Execution Sequence Proposed System Applications Future Scope Conclusion Reference
What is virtual realityRemoving the standard input and output and building wearable computer system to create realistic environment for user software interaction.Many input devices like camera, mic, sensors to make it easy to handle and make tough enough to develop
IntroductionDeveloping a advance human interaction system using computer vision.Where, System will look for human behavior Process the action and convert to input Last perform a user defined actionWhere we can provide a vision to industrial robots.
FeaturesVirtual paint brush using Red laser pointer Where user draw any thing on plane white surface and it get drawn on computerFinger motion based mouse control User move finger in air and system detect itHand gesture based photo snap shots Human hand position to grab image
RequirementsDevelopment tools Microsoft Visual BasicOperating System Microsoft Windows 98 or higherHardware Web camera, Laser Pointer
How Capture Work? Fig 1: Interface of camera with computer
ProcessingCapturing Camera ViewGetting Current Frame out of itCreating Memory ImageFinding Pixel RGBComparing Pixel colorDecision making
Overall Execution Sequence Fig 2: Processing and Overall execution
How DrawingVB Provides a picture box control to work as Drawing PadUsing Function and property PictureBox.Line (x1,y1)-(x2,y2) PicuteBox.BackColor = ? PictureBox.ForeColor = ? PictureBox.DrawWidth + ?
Grabbing ImageOnce system process image and get Left , Top , Height , WidthCopy Image in to temporary picture boxUsing Function SavePicture(FileName)Save Image on diskCalled Auto Image Grabbing
Mouse ControlIn this module system will continuously track for fingerFinger has red color spotImage processing part will get the X, YPass these X, Y to the function SetCursorPos()It will control mouse motion
ApplicationGaming is one of the major application which can avoid unnecessary wiring problems.Defense Robots is also one of the application that can have wide scope in military applications.
Future ScopeFace based retailing systemsReading live news papersZooming features for Image grabbingShutdown
ConclusionSixth Sense technology is next generation method to virtually communicate with the systems now by implementing this proposed system we are trying to give vision to computer system for better and easy interaction
References S. Sadhana Rao “Sixth Sense Technology” Proceedings of the International Conference on Communication and Computational Intelligence – 2010, Kongu Engineering College, Perundurai, Erode, T.N., India.27 – 29 December, 2010.pp.336-339. Sixth Sense- A Wearable Gestural Interface by P.Mistry, P. Maes. http://blog.ted.com/2009/03/sixth_sense_pranav.php http://en.wikipedia.org/wiki/ http://www.media.mit.edu/research/highlights/sixthsense-wearable- gestureal-interface augment-our-eorld