Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Senior Design Project, GIKI

1,657 views

Published on

vSmart - an integrated system for the smart control of domestic appliances in local environments based on monitored user presence and activity; thereby achieving multidimensional user-convenience and using modern technology to endow a sustainable environment in our everyday lives.

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Senior Design Project, GIKI

  1. 1. codename: imaGInation KIeve
  2. 2. <ul><li>FYP Presentation – the Finale! </li></ul><ul><li>24.04.08 </li></ul><ul><li>Project Team : </li></ul><ul><li>Syed Waqas A Burney, 2004185, FCSE (Team Lead) </li></ul><ul><li>Mutahira Ikram Khan, 2004136, FCSE </li></ul><ul><li>Project Advisor : </li></ul><ul><li>Mr. Badre Munir, FCSE </li></ul>
  3. 3. <ul><li>Agenda : </li></ul><ul><li>Core Progeny </li></ul><ul><li>Project Objective </li></ul><ul><li>Project Modularization </li></ul><ul><li>The System </li></ul><ul><ul><ul><li>Overview </li></ul></ul></ul><ul><ul><ul><li>Architecture </li></ul></ul></ul><ul><ul><ul><li>Module 1 – Motion Detection & Human Activity Monitoring </li></ul></ul></ul><ul><ul><ul><li>Module 2 – The Decision Making Software Engine </li></ul></ul></ul><ul><ul><ul><li>Module 3 – Appliance Control Mechanism & Prototype Modeling </li></ul></ul></ul><ul><li>Project Status </li></ul><ul><li>Envisioning Ahead </li></ul><ul><li>v Smart Demo </li></ul>
  4. 4. <ul><ul><li>Core Progeny </li></ul></ul><ul><li>Computer Vision </li></ul><ul><ul><li>The branch of applied computing that concerns modeling and developing artificial systems that attain information from images and thereby provide useful functionality and results. </li></ul></ul><ul><li>Domotics </li></ul><ul><ul><li>Study of specific automation requirements for homes and application of automation techniques for the comfort, convenience and security of the residents </li></ul></ul><ul><li>Development Platform : </li></ul><ul><li>.NET 2.0 Framework (C#) Visual Studio 2005 MS SQL Server 2005 </li></ul>
  5. 5. <ul><ul><li>Objective </li></ul></ul><ul><li>Prototyping an integrated system for the smart control of domestic electronic appliances in local environments, based on monitored user presence and activity ; thereby achieving multidimensional user-convenience and using modern technology to endow a sustainable environment in our everyday lives. </li></ul><ul><li>Applications : </li></ul><ul><li>User Convenience and Energy Saving </li></ul><ul><ul><li>Offices (lunch hours, after-office timings, etc) </li></ul></ul><ul><ul><li>Houses (the ‘Digital Home’ concept) </li></ul></ul>
  6. 6. <ul><li>Modularization (and timeline) </li></ul><ul><li>Problem Statement </li></ul><ul><li>Ideation through innovative techniques/lateral thinking/ brain storming </li></ul><ul><li>Engineering solutions, and thereby outlining the very FYP definition, field & scope </li></ul><ul><li>Adopting a research based/experimental approach </li></ul><ul><li>System design </li></ul><ul><li>Motion detection and respective human activity monitoring </li></ul><ul><li>Prototype modeling </li></ul><ul><li>Serially interfaced appliance control mechanism </li></ul><ul><li>Decision taking software engine– a multi-threaded expert system </li></ul><ul><li>Optimization and deployment </li></ul><ul><li>Completion </li></ul>Nov Jun Dec Jan Mar Apr codename: imaGInation KIeve
  7. 7. <ul><li>System Overview </li></ul><ul><ul><li>Module 1 </li></ul></ul><ul><ul><li>Human Activity Monitoring ( Input ) </li></ul></ul><ul><ul><li>Module 2 </li></ul></ul><ul><ul><li>The Software Engine </li></ul></ul><ul><ul><li>( Processing ) </li></ul></ul><ul><ul><li>Module 3 </li></ul></ul><ul><ul><li>Appliance Control ( Output ) </li></ul></ul><ul><ul><li>CMOS Webcams </li></ul></ul><ul><ul><li>Local Environment </li></ul></ul>
  8. 8. <ul><li>System Architecture </li></ul>
  9. 9. <ul><li>System Architecture </li></ul>MODULE 1 MODULE 1
  10. 10. <ul><ul><li>Module 1 </li></ul></ul><ul><li>Motion detection and respective human activity monitoring </li></ul><ul><ul><li>System Deployment </li></ul></ul><ul><ul><ul><ul><li>Multi-Camera Registration & Deployment </li></ul></ul></ul></ul><ul><ul><ul><ul><li>HotSpot Marking Utility </li></ul></ul></ul></ul><ul><ul><ul><ul><li>System GUI </li></ul></ul></ul></ul><ul><ul><li>System Initialization </li></ul></ul><ul><ul><ul><ul><li>Motion Detection </li></ul></ul></ul></ul><ul><ul><ul><ul><li>MER Formation </li></ul></ul></ul></ul><ul><ul><li>Multi-Threading </li></ul></ul>
  11. 11. <ul><ul><li>Module 1 (cntd..) </li></ul></ul><ul><ul><li>Motion detection and respective human activity monitoring </li></ul></ul><ul><ul><li>Critical Difficulties Encountered– Camera Zoom [View Angle , Shadows] </li></ul></ul><ul><ul><li>Camera Mounted in Room </li></ul></ul><ul><ul><li>Camera Mounted in the Model </li></ul></ul>
  12. 12. <ul><ul><li>Module 1 (cntd..) </li></ul></ul><ul><ul><li>Motion detection and respective human activity monitoring </li></ul></ul><ul><li>Prototype Environments : </li></ul><ul><ul><li>Room (Hostel); Model House </li></ul></ul><ul><li>Image Capture Devices : </li></ul><ul><ul><li>CMOS Webcam; 640 x 480 pixels; Frame Rate: 30 fps; View Angle: 54 degrees </li></ul></ul><ul><li>Platform : </li></ul><ul><ul><li>.NET 2.0 based Aforge C# Framework (open source) </li></ul></ul><ul><ul><ul><li>Using the AForge.Imaging & AForge.Vision libraries </li></ul></ul></ul><ul><ul><ul><ul><li>[ http://code.google.com/p/aforge/ ] </li></ul></ul></ul></ul>
  13. 13. <ul><ul><li>Module 1 (cntd..) </li></ul></ul><ul><ul><li>Motion detection and respective human activity monitoring </li></ul></ul><ul><li>User Detection Approach : </li></ul><ul><ul><li>Current–Previous, Current–First Algorithm </li></ul></ul><ul><ul><li>Blob Motion Algorithm </li></ul></ul><ul><li>Capturing Results : </li></ul><ul><ul><li>MER ( Minimum Enclosed Rectangle) Drawing (.NET Imaging Library) </li></ul></ul><ul><ul><li>Weighted Average, K-Means/K-Means ++ Algorithm </li></ul></ul><ul><li>Activity Monitoring : </li></ul><ul><ul><li>Initial Hotspot outline by the User on the S/W (.NET Imaging Library) </li></ul></ul><ul><ul><li>Hotspot & MER Overlap Detection using Crossing Number Method </li></ul></ul>
  14. 14. <ul><ul><li>Module 1 (cntd..) </li></ul></ul><ul><ul><li>Motion detection and respective human activity monitoring </li></ul></ul><ul><ul><li>MER formation for Motion Detection </li></ul></ul><ul><ul><li>Hotspot marking by user </li></ul></ul>
  15. 15. <ul><ul><li>Module 1 (cntd..) </li></ul></ul><ul><ul><li>Motion detection and respective human activity monitoring </li></ul></ul><ul><ul><li>Multi-Cam Supportive GUI </li></ul></ul><ul><ul><li>User-friendly Camera Registration </li></ul></ul><ul><ul><li>Spawning Threads for Concurrent Multi-User Support </li></ul></ul>
  16. 16. <ul><li>System Architecture </li></ul>MODULE 2 MODULE 2
  17. 17. <ul><ul><li>Module 2 </li></ul></ul><ul><li>Decision taking software engine – an expert system </li></ul><ul><ul><li>Knowledge Base Design </li></ul></ul><ul><ul><li>Action Triggering </li></ul></ul><ul><ul><ul><ul><li>Overlap Calculations </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Other Parameter Calculations </li></ul></ul></ul></ul><ul><ul><li>Reaction Generation </li></ul></ul><ul><ul><li>Serial Transmission </li></ul></ul>
  18. 18. <ul><ul><li>Module 2 </li></ul></ul><ul><ul><li>Decision taking software engine – an expert system </li></ul></ul><ul><li>The brain of the system– responsible for the actual “monitoring” </li></ul><ul><ul><li>Decides when to turn off what </li></ul></ul><ul><li>Expert System : </li></ul><ul><ul><li>Defining classes for rules </li></ul></ul><ul><ul><li>Having defined facts in a relational database </li></ul></ul><ul><ul><li>Using inference techniques to judge which rules, based on user activity, stand, and hence which devices are to be respectively switched off </li></ul></ul><ul><ul><li>Rules and Facts subject to changes and modifications based on user behavior </li></ul></ul><ul><li>Overview : </li></ul><ul><ul><ul><li>Small scale expert system with a dynamically adjusting knowledge base </li></ul></ul></ul>
  19. 19. <ul><li>System Architecture </li></ul>MODULE 3 MODULE 3
  20. 20. <ul><ul><li>Module 3 </li></ul></ul><ul><ul><li>Serially interfaced appliance control mechanism </li></ul></ul><ul><li>Connection to Devices : </li></ul><ul><ul><li>Serial port communication via RS232 </li></ul></ul><ul><ul><li>Microcontroller </li></ul></ul><ul><ul><li>Interface circuitry </li></ul></ul><ul><ul><li>Device Model House. </li></ul></ul><ul><ul><li>Microcontroller </li></ul></ul><ul><ul><li>Interface </li></ul></ul><ul><ul><li>Electronic Devices </li></ul></ul><ul><ul><li>Computer </li></ul></ul><ul><ul><li>RS232 </li></ul></ul>
  21. 21. <ul><ul><li>Module 3 </li></ul></ul><ul><ul><li>Serially interfaced appliance control mechanism </li></ul></ul><ul><ul><li>Trainer Board Circuitry </li></ul></ul><ul><ul><li>Vero Board Circuitry </li></ul></ul>
  22. 22. <ul><ul><li>Module 3 </li></ul></ul><ul><ul><li>Serially interfaced appliance control mechanism </li></ul></ul>
  23. 23. <ul><ul><li>Module 3 </li></ul></ul><ul><ul><li>Serially interfaced appliance control mechanism </li></ul></ul><ul><li>Serial Communication </li></ul><ul><ul><li>Data is transmitted to the microcontroller via RS-232 standard </li></ul></ul><ul><ul><li>DB- 9 connector is used to connect to the microcontroller </li></ul></ul><ul><li>Hardware circuitry </li></ul><ul><ul><li>ATMEL 89C51 </li></ul></ul><ul><ul><li>MAX 233 </li></ul></ul><ul><ul><li>2n222 Transistors </li></ul></ul><ul><ul><li>Diodes </li></ul></ul><ul><ul><li>6 volt relays </li></ul></ul><ul><ul><li>Capacitors </li></ul></ul><ul><ul><li>Resistors </li></ul></ul>
  24. 24. <ul><ul><li>Module 3 </li></ul></ul><ul><ul><li>Serially interfaced appliance control mechanism </li></ul></ul><ul><ul><li>Circuit : Part I </li></ul></ul>
  25. 26. <ul><ul><li>Module 3 </li></ul></ul><ul><ul><li>Serially interfaced appliance control mechanism </li></ul></ul><ul><ul><li>Circuit : Part II (implemented on Veroboard) </li></ul></ul>
  26. 28. <ul><ul><li>Module 3 (cntd..) </li></ul></ul><ul><ul><li>Serially interfaced appliance control mechanism </li></ul></ul><ul><li>Microcontroller ( ATMEL 89C51): </li></ul><ul><ul><li>Receives data serially from computer port </li></ul></ul><ul><ul><li>Processes the data </li></ul></ul><ul><ul><li>Sends data to its port to which devices are connected </li></ul></ul><ul><ul><li>Turning relays on and off </li></ul></ul><ul><li>MAX 233 </li></ul><ul><ul><li>RS-232 not compatible with today’s microcontrollers </li></ul></ul><ul><ul><li>Line driver to convert RS-232 signal to TTL logic levels </li></ul></ul><ul><li>Interface Circuit : </li></ul><ul><ul><li>BJT based Relay-Driver (2n222) : </li></ul></ul><ul><ul><ul><li>It provides sufficient current to drive the relay </li></ul></ul></ul><ul><ul><li>Diode : </li></ul></ul><ul><ul><ul><li>When the relay is switched off, magnetic field generated inside produces a high voltage, which can damage circuit </li></ul></ul></ul><ul><ul><ul><li>Diode prevents short circuiting when the relay is switched off </li></ul></ul></ul>
  27. 29. <ul><ul><li>Module 3 (cntd..) </li></ul></ul><ul><ul><li>Serially interfaced appliance control mechanism </li></ul></ul><ul><li>Interface Circuit (cntd..) : </li></ul><ul><ul><li>Resistor : </li></ul></ul><ul><ul><ul><li>It prevents flow of high current from the transistor to the ground on the application of VCC </li></ul></ul></ul><ul><ul><li>Relay : </li></ul></ul><ul><ul><ul><li>Mechanical relay is used to switch device off </li></ul></ul></ul>
  28. 30. <ul><ul><li>Modeling the Prototype </li></ul></ul><ul><ul><li>The Model House ( realistic cut-scale ) </li></ul></ul><ul><li>Model Specifications: </li></ul><ul><ul><li>3.5‘ x 3.5‘ x (equivalent height) </li></ul></ul><ul><ul><li>Two bedroom house (1.5‘ x 1.5') </li></ul></ul><ul><ul><li>Double-walled structure with the outer walls removable </li></ul></ul><ul><ul><li>The house is raised 1 feet in height, by supports, for magnet movements </li></ul></ul><ul><ul><li>Test Men with magnets are used to depict movements in the household </li></ul></ul>Outer Slide-Up-and-Removable Walls Normal Walls Wiring concealed in between by the removable Outer Wall ROOM
  29. 31. <ul><ul><li>Modeling the Prototype (cntd..) </li></ul></ul><ul><ul><li>The Model House </li></ul></ul><ul><ul><li>House Dimensions: 3.5’ x 3.5’ x 2’ Room Dimensions: 1.5’ x 1.5’ x 8” </li></ul></ul>
  30. 32. <ul><ul><li>Modeling the Prototype (cntd..) </li></ul></ul><ul><ul><li>The Model House with Domestic Appliances Installed </li></ul></ul><ul><ul><li>Installed Appliances: Room Lights, Room Fan, Bed-side Lamp & Study-table Lamp </li></ul></ul>
  31. 33. <ul><ul><li>(Work-based) Modular Completion Status </li></ul></ul><ul><li>Module 1 : Motion detection and respective human activity monitoring </li></ul><ul><ul><li>System Deployment </li></ul></ul><ul><ul><ul><ul><li>Multi-Camera Registration & Deployment </li></ul></ul></ul></ul><ul><ul><ul><ul><li>HotSpot Marking Utility </li></ul></ul></ul></ul><ul><ul><ul><ul><li>System GUI </li></ul></ul></ul></ul><ul><ul><li>System Initialization </li></ul></ul><ul><ul><ul><ul><li>Motion Detection </li></ul></ul></ul></ul><ul><ul><ul><ul><li>MER Formation </li></ul></ul></ul></ul><ul><ul><li>Multi-Threading ( debugging issues! ) </li></ul></ul><ul><li>Module 2 : Decision taking software engine – an expert system </li></ul><ul><ul><li>Action Triggering </li></ul></ul><ul><ul><ul><ul><li>Overlap Calculations </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Other Parameter Calculations </li></ul></ul></ul></ul><ul><ul><li>Knowledge Base Design </li></ul></ul><ul><ul><li>Reaction Generation </li></ul></ul><ul><ul><li>Serial Transmission </li></ul></ul><ul><li>Module 3 : Serially interfaced appliance control mechanism </li></ul><ul><ul><li>Trainer/Vero-board Circuit Designing </li></ul></ul><ul><ul><li>Microcontroller Interpretation </li></ul></ul><ul><ul><li>Electrical Interfacing of Appliance </li></ul></ul><ul><ul><li>System Optimization </li></ul></ul>
  32. 34. <ul><ul><li>Envisioning Ahead </li></ul></ul><ul><li>Microsoft Imagine Cup 2008 </li></ul><ul><li>GIKI Participation @ Different Technology Competitions ~ Softec ’08 </li></ul><ul><li>Submissions on Various Research-based Platforms for Domotics </li></ul><ul><li>Video Documentation </li></ul>

×