codename:  imaGInation KIeve
<ul><li>FYP Presentation – the Finale! </li></ul><ul><li>24.04.08 </li></ul><ul><li>Project Team : </li></ul><ul><li>Syed ...
<ul><li>Agenda : </li></ul><ul><li>Core Progeny </li></ul><ul><li>Project Objective </li></ul><ul><li>Project Modularizati...
<ul><ul><li>Core Progeny </li></ul></ul><ul><li>Computer Vision </li></ul><ul><ul><li>The branch of applied computing that...
<ul><ul><li>Objective </li></ul></ul><ul><li>Prototyping an integrated system for the smart control of domestic electronic...
<ul><li>Modularization (and timeline) </li></ul><ul><li>Problem Statement </li></ul><ul><li>Ideation through innovative te...
<ul><li>System Overview </li></ul><ul><ul><li>Module 1  </li></ul></ul><ul><ul><li>Human  Activity Monitoring ( Input ) </...
<ul><li>System Architecture </li></ul>
<ul><li>System Architecture </li></ul>MODULE 1 MODULE 1
<ul><ul><li>Module 1 </li></ul></ul><ul><li>Motion detection and respective human activity monitoring </li></ul><ul><ul><l...
<ul><ul><li>Module 1 (cntd..) </li></ul></ul><ul><ul><li>Motion detection and respective human activity monitoring  </li><...
<ul><ul><li>Module 1 (cntd..) </li></ul></ul><ul><ul><li>Motion detection and respective human activity monitoring </li></...
<ul><ul><li>Module 1 (cntd..) </li></ul></ul><ul><ul><li>Motion detection and respective human activity monitoring </li></...
<ul><ul><li>Module 1 (cntd..) </li></ul></ul><ul><ul><li>Motion detection and respective human activity monitoring </li></...
<ul><ul><li>Module 1 (cntd..) </li></ul></ul><ul><ul><li>Motion detection and respective human activity monitoring  </li><...
<ul><li>System Architecture </li></ul>MODULE 2 MODULE 2
<ul><ul><li>Module 2 </li></ul></ul><ul><li>Decision taking software engine – an expert system </li></ul><ul><ul><li>Knowl...
<ul><ul><li>Module 2 </li></ul></ul><ul><ul><li>Decision taking software engine – an expert system </li></ul></ul><ul><li>...
<ul><li>System Architecture </li></ul>MODULE 3 MODULE 3
<ul><ul><li>Module 3 </li></ul></ul><ul><ul><li>Serially interfaced appliance control mechanism </li></ul></ul><ul><li>Con...
<ul><ul><li>Module 3 </li></ul></ul><ul><ul><li>Serially interfaced appliance control mechanism </li></ul></ul><ul><ul><li...
<ul><ul><li>Module 3 </li></ul></ul><ul><ul><li>Serially interfaced appliance control mechanism </li></ul></ul>
<ul><ul><li>Module 3 </li></ul></ul><ul><ul><li>Serially interfaced appliance control mechanism </li></ul></ul><ul><li>Ser...
<ul><ul><li>Module 3 </li></ul></ul><ul><ul><li>Serially interfaced appliance control mechanism </li></ul></ul><ul><ul><li...
 
<ul><ul><li>Module 3 </li></ul></ul><ul><ul><li>Serially interfaced appliance control mechanism </li></ul></ul><ul><ul><li...
 
<ul><ul><li>Module 3 (cntd..) </li></ul></ul><ul><ul><li>Serially interfaced appliance control mechanism </li></ul></ul><u...
<ul><ul><li>Module 3 (cntd..) </li></ul></ul><ul><ul><li>Serially interfaced appliance control mechanism </li></ul></ul><u...
<ul><ul><li>Modeling the Prototype </li></ul></ul><ul><ul><li>The Model House ( realistic cut-scale ) </li></ul></ul><ul><...
<ul><ul><li>Modeling the Prototype (cntd..) </li></ul></ul><ul><ul><li>The Model House </li></ul></ul><ul><ul><li>House Di...
<ul><ul><li>Modeling the Prototype (cntd..) </li></ul></ul><ul><ul><li>The Model House with Domestic Appliances Installed ...
<ul><ul><li>(Work-based) Modular Completion Status </li></ul></ul><ul><li>Module 1  :  Motion detection and respective hum...
<ul><ul><li>Envisioning Ahead </li></ul></ul><ul><li>Microsoft Imagine Cup 2008 </li></ul><ul><li>GIKI Participation @ Dif...
 
Upcoming SlideShare
Loading in...5
×

Senior Design Project, GIKI

1,441
-1

Published on

vSmart - an integrated system for the smart control of domestic appliances in local environments based on monitored user presence and activity; thereby achieving multidimensional user-convenience and using modern technology to endow a sustainable environment in our everyday lives.

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
1,441
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
68
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Senior Design Project, GIKI

  1. 1. codename: imaGInation KIeve
  2. 2. <ul><li>FYP Presentation – the Finale! </li></ul><ul><li>24.04.08 </li></ul><ul><li>Project Team : </li></ul><ul><li>Syed Waqas A Burney, 2004185, FCSE (Team Lead) </li></ul><ul><li>Mutahira Ikram Khan, 2004136, FCSE </li></ul><ul><li>Project Advisor : </li></ul><ul><li>Mr. Badre Munir, FCSE </li></ul>
  3. 3. <ul><li>Agenda : </li></ul><ul><li>Core Progeny </li></ul><ul><li>Project Objective </li></ul><ul><li>Project Modularization </li></ul><ul><li>The System </li></ul><ul><ul><ul><li>Overview </li></ul></ul></ul><ul><ul><ul><li>Architecture </li></ul></ul></ul><ul><ul><ul><li>Module 1 – Motion Detection & Human Activity Monitoring </li></ul></ul></ul><ul><ul><ul><li>Module 2 – The Decision Making Software Engine </li></ul></ul></ul><ul><ul><ul><li>Module 3 – Appliance Control Mechanism & Prototype Modeling </li></ul></ul></ul><ul><li>Project Status </li></ul><ul><li>Envisioning Ahead </li></ul><ul><li>v Smart Demo </li></ul>
  4. 4. <ul><ul><li>Core Progeny </li></ul></ul><ul><li>Computer Vision </li></ul><ul><ul><li>The branch of applied computing that concerns modeling and developing artificial systems that attain information from images and thereby provide useful functionality and results. </li></ul></ul><ul><li>Domotics </li></ul><ul><ul><li>Study of specific automation requirements for homes and application of automation techniques for the comfort, convenience and security of the residents </li></ul></ul><ul><li>Development Platform : </li></ul><ul><li>.NET 2.0 Framework (C#) Visual Studio 2005 MS SQL Server 2005 </li></ul>
  5. 5. <ul><ul><li>Objective </li></ul></ul><ul><li>Prototyping an integrated system for the smart control of domestic electronic appliances in local environments, based on monitored user presence and activity ; thereby achieving multidimensional user-convenience and using modern technology to endow a sustainable environment in our everyday lives. </li></ul><ul><li>Applications : </li></ul><ul><li>User Convenience and Energy Saving </li></ul><ul><ul><li>Offices (lunch hours, after-office timings, etc) </li></ul></ul><ul><ul><li>Houses (the ‘Digital Home’ concept) </li></ul></ul>
  6. 6. <ul><li>Modularization (and timeline) </li></ul><ul><li>Problem Statement </li></ul><ul><li>Ideation through innovative techniques/lateral thinking/ brain storming </li></ul><ul><li>Engineering solutions, and thereby outlining the very FYP definition, field & scope </li></ul><ul><li>Adopting a research based/experimental approach </li></ul><ul><li>System design </li></ul><ul><li>Motion detection and respective human activity monitoring </li></ul><ul><li>Prototype modeling </li></ul><ul><li>Serially interfaced appliance control mechanism </li></ul><ul><li>Decision taking software engine– a multi-threaded expert system </li></ul><ul><li>Optimization and deployment </li></ul><ul><li>Completion </li></ul>Nov Jun Dec Jan Mar Apr codename: imaGInation KIeve
  7. 7. <ul><li>System Overview </li></ul><ul><ul><li>Module 1 </li></ul></ul><ul><ul><li>Human Activity Monitoring ( Input ) </li></ul></ul><ul><ul><li>Module 2 </li></ul></ul><ul><ul><li>The Software Engine </li></ul></ul><ul><ul><li>( Processing ) </li></ul></ul><ul><ul><li>Module 3 </li></ul></ul><ul><ul><li>Appliance Control ( Output ) </li></ul></ul><ul><ul><li>CMOS Webcams </li></ul></ul><ul><ul><li>Local Environment </li></ul></ul>
  8. 8. <ul><li>System Architecture </li></ul>
  9. 9. <ul><li>System Architecture </li></ul>MODULE 1 MODULE 1
  10. 10. <ul><ul><li>Module 1 </li></ul></ul><ul><li>Motion detection and respective human activity monitoring </li></ul><ul><ul><li>System Deployment </li></ul></ul><ul><ul><ul><ul><li>Multi-Camera Registration & Deployment </li></ul></ul></ul></ul><ul><ul><ul><ul><li>HotSpot Marking Utility </li></ul></ul></ul></ul><ul><ul><ul><ul><li>System GUI </li></ul></ul></ul></ul><ul><ul><li>System Initialization </li></ul></ul><ul><ul><ul><ul><li>Motion Detection </li></ul></ul></ul></ul><ul><ul><ul><ul><li>MER Formation </li></ul></ul></ul></ul><ul><ul><li>Multi-Threading </li></ul></ul>
  11. 11. <ul><ul><li>Module 1 (cntd..) </li></ul></ul><ul><ul><li>Motion detection and respective human activity monitoring </li></ul></ul><ul><ul><li>Critical Difficulties Encountered– Camera Zoom [View Angle , Shadows] </li></ul></ul><ul><ul><li>Camera Mounted in Room </li></ul></ul><ul><ul><li>Camera Mounted in the Model </li></ul></ul>
  12. 12. <ul><ul><li>Module 1 (cntd..) </li></ul></ul><ul><ul><li>Motion detection and respective human activity monitoring </li></ul></ul><ul><li>Prototype Environments : </li></ul><ul><ul><li>Room (Hostel); Model House </li></ul></ul><ul><li>Image Capture Devices : </li></ul><ul><ul><li>CMOS Webcam; 640 x 480 pixels; Frame Rate: 30 fps; View Angle: 54 degrees </li></ul></ul><ul><li>Platform : </li></ul><ul><ul><li>.NET 2.0 based Aforge C# Framework (open source) </li></ul></ul><ul><ul><ul><li>Using the AForge.Imaging & AForge.Vision libraries </li></ul></ul></ul><ul><ul><ul><ul><li>[ http://code.google.com/p/aforge/ ] </li></ul></ul></ul></ul>
  13. 13. <ul><ul><li>Module 1 (cntd..) </li></ul></ul><ul><ul><li>Motion detection and respective human activity monitoring </li></ul></ul><ul><li>User Detection Approach : </li></ul><ul><ul><li>Current–Previous, Current–First Algorithm </li></ul></ul><ul><ul><li>Blob Motion Algorithm </li></ul></ul><ul><li>Capturing Results : </li></ul><ul><ul><li>MER ( Minimum Enclosed Rectangle) Drawing (.NET Imaging Library) </li></ul></ul><ul><ul><li>Weighted Average, K-Means/K-Means ++ Algorithm </li></ul></ul><ul><li>Activity Monitoring : </li></ul><ul><ul><li>Initial Hotspot outline by the User on the S/W (.NET Imaging Library) </li></ul></ul><ul><ul><li>Hotspot & MER Overlap Detection using Crossing Number Method </li></ul></ul>
  14. 14. <ul><ul><li>Module 1 (cntd..) </li></ul></ul><ul><ul><li>Motion detection and respective human activity monitoring </li></ul></ul><ul><ul><li>MER formation for Motion Detection </li></ul></ul><ul><ul><li>Hotspot marking by user </li></ul></ul>
  15. 15. <ul><ul><li>Module 1 (cntd..) </li></ul></ul><ul><ul><li>Motion detection and respective human activity monitoring </li></ul></ul><ul><ul><li>Multi-Cam Supportive GUI </li></ul></ul><ul><ul><li>User-friendly Camera Registration </li></ul></ul><ul><ul><li>Spawning Threads for Concurrent Multi-User Support </li></ul></ul>
  16. 16. <ul><li>System Architecture </li></ul>MODULE 2 MODULE 2
  17. 17. <ul><ul><li>Module 2 </li></ul></ul><ul><li>Decision taking software engine – an expert system </li></ul><ul><ul><li>Knowledge Base Design </li></ul></ul><ul><ul><li>Action Triggering </li></ul></ul><ul><ul><ul><ul><li>Overlap Calculations </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Other Parameter Calculations </li></ul></ul></ul></ul><ul><ul><li>Reaction Generation </li></ul></ul><ul><ul><li>Serial Transmission </li></ul></ul>
  18. 18. <ul><ul><li>Module 2 </li></ul></ul><ul><ul><li>Decision taking software engine – an expert system </li></ul></ul><ul><li>The brain of the system– responsible for the actual “monitoring” </li></ul><ul><ul><li>Decides when to turn off what </li></ul></ul><ul><li>Expert System : </li></ul><ul><ul><li>Defining classes for rules </li></ul></ul><ul><ul><li>Having defined facts in a relational database </li></ul></ul><ul><ul><li>Using inference techniques to judge which rules, based on user activity, stand, and hence which devices are to be respectively switched off </li></ul></ul><ul><ul><li>Rules and Facts subject to changes and modifications based on user behavior </li></ul></ul><ul><li>Overview : </li></ul><ul><ul><ul><li>Small scale expert system with a dynamically adjusting knowledge base </li></ul></ul></ul>
  19. 19. <ul><li>System Architecture </li></ul>MODULE 3 MODULE 3
  20. 20. <ul><ul><li>Module 3 </li></ul></ul><ul><ul><li>Serially interfaced appliance control mechanism </li></ul></ul><ul><li>Connection to Devices : </li></ul><ul><ul><li>Serial port communication via RS232 </li></ul></ul><ul><ul><li>Microcontroller </li></ul></ul><ul><ul><li>Interface circuitry </li></ul></ul><ul><ul><li>Device Model House. </li></ul></ul><ul><ul><li>Microcontroller </li></ul></ul><ul><ul><li>Interface </li></ul></ul><ul><ul><li>Electronic Devices </li></ul></ul><ul><ul><li>Computer </li></ul></ul><ul><ul><li>RS232 </li></ul></ul>
  21. 21. <ul><ul><li>Module 3 </li></ul></ul><ul><ul><li>Serially interfaced appliance control mechanism </li></ul></ul><ul><ul><li>Trainer Board Circuitry </li></ul></ul><ul><ul><li>Vero Board Circuitry </li></ul></ul>
  22. 22. <ul><ul><li>Module 3 </li></ul></ul><ul><ul><li>Serially interfaced appliance control mechanism </li></ul></ul>
  23. 23. <ul><ul><li>Module 3 </li></ul></ul><ul><ul><li>Serially interfaced appliance control mechanism </li></ul></ul><ul><li>Serial Communication </li></ul><ul><ul><li>Data is transmitted to the microcontroller via RS-232 standard </li></ul></ul><ul><ul><li>DB- 9 connector is used to connect to the microcontroller </li></ul></ul><ul><li>Hardware circuitry </li></ul><ul><ul><li>ATMEL 89C51 </li></ul></ul><ul><ul><li>MAX 233 </li></ul></ul><ul><ul><li>2n222 Transistors </li></ul></ul><ul><ul><li>Diodes </li></ul></ul><ul><ul><li>6 volt relays </li></ul></ul><ul><ul><li>Capacitors </li></ul></ul><ul><ul><li>Resistors </li></ul></ul>
  24. 24. <ul><ul><li>Module 3 </li></ul></ul><ul><ul><li>Serially interfaced appliance control mechanism </li></ul></ul><ul><ul><li>Circuit : Part I </li></ul></ul>
  25. 26. <ul><ul><li>Module 3 </li></ul></ul><ul><ul><li>Serially interfaced appliance control mechanism </li></ul></ul><ul><ul><li>Circuit : Part II (implemented on Veroboard) </li></ul></ul>
  26. 28. <ul><ul><li>Module 3 (cntd..) </li></ul></ul><ul><ul><li>Serially interfaced appliance control mechanism </li></ul></ul><ul><li>Microcontroller ( ATMEL 89C51): </li></ul><ul><ul><li>Receives data serially from computer port </li></ul></ul><ul><ul><li>Processes the data </li></ul></ul><ul><ul><li>Sends data to its port to which devices are connected </li></ul></ul><ul><ul><li>Turning relays on and off </li></ul></ul><ul><li>MAX 233 </li></ul><ul><ul><li>RS-232 not compatible with today’s microcontrollers </li></ul></ul><ul><ul><li>Line driver to convert RS-232 signal to TTL logic levels </li></ul></ul><ul><li>Interface Circuit : </li></ul><ul><ul><li>BJT based Relay-Driver (2n222) : </li></ul></ul><ul><ul><ul><li>It provides sufficient current to drive the relay </li></ul></ul></ul><ul><ul><li>Diode : </li></ul></ul><ul><ul><ul><li>When the relay is switched off, magnetic field generated inside produces a high voltage, which can damage circuit </li></ul></ul></ul><ul><ul><ul><li>Diode prevents short circuiting when the relay is switched off </li></ul></ul></ul>
  27. 29. <ul><ul><li>Module 3 (cntd..) </li></ul></ul><ul><ul><li>Serially interfaced appliance control mechanism </li></ul></ul><ul><li>Interface Circuit (cntd..) : </li></ul><ul><ul><li>Resistor : </li></ul></ul><ul><ul><ul><li>It prevents flow of high current from the transistor to the ground on the application of VCC </li></ul></ul></ul><ul><ul><li>Relay : </li></ul></ul><ul><ul><ul><li>Mechanical relay is used to switch device off </li></ul></ul></ul>
  28. 30. <ul><ul><li>Modeling the Prototype </li></ul></ul><ul><ul><li>The Model House ( realistic cut-scale ) </li></ul></ul><ul><li>Model Specifications: </li></ul><ul><ul><li>3.5‘ x 3.5‘ x (equivalent height) </li></ul></ul><ul><ul><li>Two bedroom house (1.5‘ x 1.5') </li></ul></ul><ul><ul><li>Double-walled structure with the outer walls removable </li></ul></ul><ul><ul><li>The house is raised 1 feet in height, by supports, for magnet movements </li></ul></ul><ul><ul><li>Test Men with magnets are used to depict movements in the household </li></ul></ul>Outer Slide-Up-and-Removable Walls Normal Walls Wiring concealed in between by the removable Outer Wall ROOM
  29. 31. <ul><ul><li>Modeling the Prototype (cntd..) </li></ul></ul><ul><ul><li>The Model House </li></ul></ul><ul><ul><li>House Dimensions: 3.5’ x 3.5’ x 2’ Room Dimensions: 1.5’ x 1.5’ x 8” </li></ul></ul>
  30. 32. <ul><ul><li>Modeling the Prototype (cntd..) </li></ul></ul><ul><ul><li>The Model House with Domestic Appliances Installed </li></ul></ul><ul><ul><li>Installed Appliances: Room Lights, Room Fan, Bed-side Lamp & Study-table Lamp </li></ul></ul>
  31. 33. <ul><ul><li>(Work-based) Modular Completion Status </li></ul></ul><ul><li>Module 1 : Motion detection and respective human activity monitoring </li></ul><ul><ul><li>System Deployment </li></ul></ul><ul><ul><ul><ul><li>Multi-Camera Registration & Deployment </li></ul></ul></ul></ul><ul><ul><ul><ul><li>HotSpot Marking Utility </li></ul></ul></ul></ul><ul><ul><ul><ul><li>System GUI </li></ul></ul></ul></ul><ul><ul><li>System Initialization </li></ul></ul><ul><ul><ul><ul><li>Motion Detection </li></ul></ul></ul></ul><ul><ul><ul><ul><li>MER Formation </li></ul></ul></ul></ul><ul><ul><li>Multi-Threading ( debugging issues! ) </li></ul></ul><ul><li>Module 2 : Decision taking software engine – an expert system </li></ul><ul><ul><li>Action Triggering </li></ul></ul><ul><ul><ul><ul><li>Overlap Calculations </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Other Parameter Calculations </li></ul></ul></ul></ul><ul><ul><li>Knowledge Base Design </li></ul></ul><ul><ul><li>Reaction Generation </li></ul></ul><ul><ul><li>Serial Transmission </li></ul></ul><ul><li>Module 3 : Serially interfaced appliance control mechanism </li></ul><ul><ul><li>Trainer/Vero-board Circuit Designing </li></ul></ul><ul><ul><li>Microcontroller Interpretation </li></ul></ul><ul><ul><li>Electrical Interfacing of Appliance </li></ul></ul><ul><ul><li>System Optimization </li></ul></ul>
  32. 34. <ul><ul><li>Envisioning Ahead </li></ul></ul><ul><li>Microsoft Imagine Cup 2008 </li></ul><ul><li>GIKI Participation @ Different Technology Competitions ~ Softec ’08 </li></ul><ul><li>Submissions on Various Research-based Platforms for Domotics </li></ul><ul><li>Video Documentation </li></ul>
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×