SlideShare a Scribd company logo
HASL : HIGHLY AUTONOUMOUS
SELF-LEARNING AI AGENT
1
OBJECTIVE
• To build a real-time occupancy detection system using machine
learning neural network
• Remotely recognize people’s emotions from video feed and perform
prediction analysis
• Communicate with security system including CCTV, audio feeds
2
IDEA AND SCOPE
3
• The detection system recognizes occupants inside an environment with
the help of CCTV footages and also camera feeds from occupants smartpho
• The system also utilizes machine learning technology to deeply understand
the occupants’ emotions, their actions and predict their actions.
ARCHITECTURE
4
CCTV
FOOTAGE
SMARTPHONE
CAMERA
FACIAL
RECOGNITION
SPEECH
RECOGNITION
ENVIRONMENT
ANALYSIS
LEARNING
SYSTEM
GAIT ANALYSIS
PATTERN
RECOGNITION
PREDICTION
SYSTEM
SMS, PHONE
CALL AND EMAIL
5
USER SCHEMA
• MongoDB – NoSQL Distributed Database
• Contains all user information such as
– Name
– ID
– Last Seen
– Seen with
– Emotion
– Status
– Location
6
SAMPLE USER SCHEMA
{
"userID": "UID0001",
"name": "Raghav",
"location": "",
"seen with": {
"userID": "UID0003,
"name": "Vijay",
"location": "Tambaram"
},
"last seen": "21:01:25 PM",
"emotion": "neutral"
}
REQUIREMENTS - HARDWARE
• 2.1 GHz or above Intel Quad Core processors ( Quantity – 5 )
• 4 GB RAM ( Quantity – 5 )
• 500GB HDD ( Quantity – 4 )
• NVIDIA 2GB GPU ( Quantity – 2 )
• Network Switch ( Quantity – 1 )
7
PERFORMANCE ESTIMATION
CPU Clock Speed - 2.1 GHz
Operations / Cycle - 4
Cores / Processor - 4
Processors / Node - 2
No. of Nodes - 5
Efficiency ~ 85 %
FLOPS Estimate:
Theoretical - 0.336 Tflops
Real – world - 0.29 Tflops
8
REQUIREMENTS - SOFTWARE
• Unix – based OS ( Ubuntu / CentOS )
•Apache UIMA – content analysis of unstructured data
• ConceptNet4, DBPedia, WordNet - for Ontological data
• Ngnix / HAProxy – for load balancing
• Languages – Java, Python, NodeJS, Haskell, C++
9
ALGORITHMS AND FRAMEWORKS
• Multimodal Recurrent Neural Networks
• Viola-Jones Object detection
• Bayesian Networks and Support Vector machines
10
11
ARCHITECTURE - NETWORK
CAMERA
FEEDS
MEMCACHED
LOAD BALANCER
NODE
1
NODE
2
NODE
3
NODE
4
NODE
5
12
REFERENCES
[1] Probabilistic Modeling of Failure Dependencies Using Markov Logic Networks -
Ghosh, S, Steiner.W,, Denker, G - 2013 IEEE 19th Pacific Rim International Conference
[2] Probabilistic Logic Networks, A Comprehensive Framework for Uncertain Inference
- Goertzel, B., Iklé, M., Goertzel, I.F., Heljakka
[3] OpenCog: A Software Framework for Integrative Artificial General Intelligence -
Hart, D; B Goertzel (2008).
[4] ArtMap: Supervised Real-time learning and classification of non-stationary data by
self-organizing neural network – Gail A. Carpenter, Stephen Gossberg
[5] ConceptNet 3: a Flexible, Multilingual Semantic Network for Common Sense
Knowledge - Catherine Havasi, Rob Speer and Jason Alonso
13
THANK YOU !

More Related Content

Viewers also liked

E learning agents
E learning agentsE learning agents
E learning agents
ghasaq82
 
Learning Agents by Prof G. Tecuci
Learning Agents by Prof G. TecuciLearning Agents by Prof G. Tecuci
Learning Agents by Prof G. Tecuci
butest
 
Agents of Learning
Agents of LearningAgents of Learning
Agents of Learning
Angela Housand
 
#3 formal methods – propositional logic
#3 formal methods – propositional logic#3 formal methods – propositional logic
#3 formal methods – propositional logic
Sharif Omar Salem
 
Learning agents
Learning agentsLearning agents
Learning agents
Vostrikov Arkady
 
Syntax and semantics of propositional logic
Syntax and semantics of propositional logicSyntax and semantics of propositional logic
Syntax and semantics of propositional logic
Janet Stemwedel
 
Planning
PlanningPlanning
Planning
ahmad bassiouny
 
AI: Planning and AI
AI: Planning and AIAI: Planning and AI
AI: Planning and AI
DataminingTools Inc
 
AI: Learning in AI
AI: Learning in AI AI: Learning in AI
AI: Learning in AI
DataminingTools Inc
 
Propositional And First-Order Logic
Propositional And First-Order LogicPropositional And First-Order Logic
Propositional And First-Order Logic
ankush_kumar
 

Viewers also liked (10)

E learning agents
E learning agentsE learning agents
E learning agents
 
Learning Agents by Prof G. Tecuci
Learning Agents by Prof G. TecuciLearning Agents by Prof G. Tecuci
Learning Agents by Prof G. Tecuci
 
Agents of Learning
Agents of LearningAgents of Learning
Agents of Learning
 
#3 formal methods – propositional logic
#3 formal methods – propositional logic#3 formal methods – propositional logic
#3 formal methods – propositional logic
 
Learning agents
Learning agentsLearning agents
Learning agents
 
Syntax and semantics of propositional logic
Syntax and semantics of propositional logicSyntax and semantics of propositional logic
Syntax and semantics of propositional logic
 
Planning
PlanningPlanning
Planning
 
AI: Planning and AI
AI: Planning and AIAI: Planning and AI
AI: Planning and AI
 
AI: Learning in AI
AI: Learning in AI AI: Learning in AI
AI: Learning in AI
 
Propositional And First-Order Logic
Propositional And First-Order LogicPropositional And First-Order Logic
Propositional And First-Order Logic
 

Similar to Highly Autonomous Self Learning AI Agent

Hadoop-Automation-Tool_RamkishorTak
Hadoop-Automation-Tool_RamkishorTakHadoop-Automation-Tool_RamkishorTak
Hadoop-Automation-Tool_RamkishorTak
Ram Kishor Tak
 
Cumulus networks - Overcoming traditional network limitations with open source
Cumulus networks - Overcoming traditional network limitations with open sourceCumulus networks - Overcoming traditional network limitations with open source
Cumulus networks - Overcoming traditional network limitations with open source
Nat Morris
 
honeypots.ppt
honeypots.ppthoneypots.ppt
honeypots.ppt
DetSersi
 
AI on the Edge
AI on the EdgeAI on the Edge
AI on the Edge
Jared Rhodes
 
Backtrack os 5
Backtrack os 5Backtrack os 5
Backtrack os 5
Ayush Goyal
 
Open Source Cyber Weaponry
Open Source Cyber WeaponryOpen Source Cyber Weaponry
Open Source Cyber Weaponry
Joshua L. Davis
 
Real-Time Streaming Data Analysis with HTM
Real-Time Streaming Data Analysis with HTMReal-Time Streaming Data Analysis with HTM
Real-Time Streaming Data Analysis with HTM
Numenta
 
The DemaWare Service-Oriented AAL Platform for People with Dementia
The DemaWare Service-Oriented AAL Platform for People with DementiaThe DemaWare Service-Oriented AAL Platform for People with Dementia
The DemaWare Service-Oriented AAL Platform for People with Dementia
Yiannis Kompatsiaris
 
Designing High performance & Scalable Middleware for HPC
Designing High performance & Scalable Middleware for HPCDesigning High performance & Scalable Middleware for HPC
Designing High performance & Scalable Middleware for HPC
Object Automation
 
Senslab - open hardware - fossa2010
Senslab - open hardware - fossa2010Senslab - open hardware - fossa2010
Senslab - open hardware - fossa2010
fOSSa - Free Open Source Software Academia Conference
 
Software Defined Network - SDN
Software Defined Network - SDNSoftware Defined Network - SDN
Software Defined Network - SDN
Venkata Naga Ravi
 
Using Eclipse and Lua for the Internet of Things - JAX2013
Using Eclipse and Lua for the Internet of Things - JAX2013Using Eclipse and Lua for the Internet of Things - JAX2013
Using Eclipse and Lua for the Internet of Things - JAX2013
Benjamin Cabé
 
Designing High-Performance and Scalable Middleware for HPC, AI and Data Science
Designing High-Performance and Scalable Middleware for HPC, AI and Data ScienceDesigning High-Performance and Scalable Middleware for HPC, AI and Data Science
Designing High-Performance and Scalable Middleware for HPC, AI and Data Science
Object Automation
 
2nd sdn interest group session2 (121218)
2nd sdn interest group   session2 (121218)2nd sdn interest group   session2 (121218)
2nd sdn interest group session2 (121218)
NAIM Networks, Inc.
 
Khan farhan cv
Khan farhan cvKhan farhan cv
Khan farhan cv
farhan0039
 
Geek Night 15.0 - Touring the Dark-Side of the Internet
Geek Night 15.0 - Touring the Dark-Side of the InternetGeek Night 15.0 - Touring the Dark-Side of the Internet
Geek Night 15.0 - Touring the Dark-Side of the Internet
GeekNightHyderabad
 
Network Situational Awareness with d00gle
Network Situational Awareness with d00gleNetwork Situational Awareness with d00gle
Network Situational Awareness with d00gle
Dug Song
 
INSECS: Intelligent networks security system
INSECS: Intelligent networks security systemINSECS: Intelligent networks security system
INSECS: Intelligent networks security system
Nadun Rajasinghe
 
A Framework for Context-aware applications for Smart Spaces. ruSmart 2011 St ...
A Framework for Context-aware applications for Smart Spaces. ruSmart 2011 St ...A Framework for Context-aware applications for Smart Spaces. ruSmart 2011 St ...
A Framework for Context-aware applications for Smart Spaces. ruSmart 2011 St ...
Natalia Díaz Rodríguez
 
A Deeper Dive into Apache MXNet - March 2017 AWS Online Tech Talks
A Deeper Dive into Apache MXNet - March 2017 AWS Online Tech TalksA Deeper Dive into Apache MXNet - March 2017 AWS Online Tech Talks
A Deeper Dive into Apache MXNet - March 2017 AWS Online Tech Talks
Amazon Web Services
 

Similar to Highly Autonomous Self Learning AI Agent (20)

Hadoop-Automation-Tool_RamkishorTak
Hadoop-Automation-Tool_RamkishorTakHadoop-Automation-Tool_RamkishorTak
Hadoop-Automation-Tool_RamkishorTak
 
Cumulus networks - Overcoming traditional network limitations with open source
Cumulus networks - Overcoming traditional network limitations with open sourceCumulus networks - Overcoming traditional network limitations with open source
Cumulus networks - Overcoming traditional network limitations with open source
 
honeypots.ppt
honeypots.ppthoneypots.ppt
honeypots.ppt
 
AI on the Edge
AI on the EdgeAI on the Edge
AI on the Edge
 
Backtrack os 5
Backtrack os 5Backtrack os 5
Backtrack os 5
 
Open Source Cyber Weaponry
Open Source Cyber WeaponryOpen Source Cyber Weaponry
Open Source Cyber Weaponry
 
Real-Time Streaming Data Analysis with HTM
Real-Time Streaming Data Analysis with HTMReal-Time Streaming Data Analysis with HTM
Real-Time Streaming Data Analysis with HTM
 
The DemaWare Service-Oriented AAL Platform for People with Dementia
The DemaWare Service-Oriented AAL Platform for People with DementiaThe DemaWare Service-Oriented AAL Platform for People with Dementia
The DemaWare Service-Oriented AAL Platform for People with Dementia
 
Designing High performance & Scalable Middleware for HPC
Designing High performance & Scalable Middleware for HPCDesigning High performance & Scalable Middleware for HPC
Designing High performance & Scalable Middleware for HPC
 
Senslab - open hardware - fossa2010
Senslab - open hardware - fossa2010Senslab - open hardware - fossa2010
Senslab - open hardware - fossa2010
 
Software Defined Network - SDN
Software Defined Network - SDNSoftware Defined Network - SDN
Software Defined Network - SDN
 
Using Eclipse and Lua for the Internet of Things - JAX2013
Using Eclipse and Lua for the Internet of Things - JAX2013Using Eclipse and Lua for the Internet of Things - JAX2013
Using Eclipse and Lua for the Internet of Things - JAX2013
 
Designing High-Performance and Scalable Middleware for HPC, AI and Data Science
Designing High-Performance and Scalable Middleware for HPC, AI and Data ScienceDesigning High-Performance and Scalable Middleware for HPC, AI and Data Science
Designing High-Performance and Scalable Middleware for HPC, AI and Data Science
 
2nd sdn interest group session2 (121218)
2nd sdn interest group   session2 (121218)2nd sdn interest group   session2 (121218)
2nd sdn interest group session2 (121218)
 
Khan farhan cv
Khan farhan cvKhan farhan cv
Khan farhan cv
 
Geek Night 15.0 - Touring the Dark-Side of the Internet
Geek Night 15.0 - Touring the Dark-Side of the InternetGeek Night 15.0 - Touring the Dark-Side of the Internet
Geek Night 15.0 - Touring the Dark-Side of the Internet
 
Network Situational Awareness with d00gle
Network Situational Awareness with d00gleNetwork Situational Awareness with d00gle
Network Situational Awareness with d00gle
 
INSECS: Intelligent networks security system
INSECS: Intelligent networks security systemINSECS: Intelligent networks security system
INSECS: Intelligent networks security system
 
A Framework for Context-aware applications for Smart Spaces. ruSmart 2011 St ...
A Framework for Context-aware applications for Smart Spaces. ruSmart 2011 St ...A Framework for Context-aware applications for Smart Spaces. ruSmart 2011 St ...
A Framework for Context-aware applications for Smart Spaces. ruSmart 2011 St ...
 
A Deeper Dive into Apache MXNet - March 2017 AWS Online Tech Talks
A Deeper Dive into Apache MXNet - March 2017 AWS Online Tech TalksA Deeper Dive into Apache MXNet - March 2017 AWS Online Tech Talks
A Deeper Dive into Apache MXNet - March 2017 AWS Online Tech Talks
 

Recently uploaded

Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)
Jakub Marek
 
Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Biomedical Knowledge Graphs for Data Scientists and BioinformaticiansBiomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Neo4j
 
Dandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity serverDandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity server
Antonios Katsarakis
 
Digital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe
Digital Banking in the Cloud: How Citizens Bank Unlocked Their MainframeDigital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe
Digital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe
Precisely
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Safe Software
 
The Microsoft 365 Migration Tutorial For Beginner.pptx
The Microsoft 365 Migration Tutorial For Beginner.pptxThe Microsoft 365 Migration Tutorial For Beginner.pptx
The Microsoft 365 Migration Tutorial For Beginner.pptx
operationspcvita
 
Apps Break Data
Apps Break DataApps Break Data
Apps Break Data
Ivo Velitchkov
 
June Patch Tuesday
June Patch TuesdayJune Patch Tuesday
June Patch Tuesday
Ivanti
 
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-EfficiencyFreshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
ScyllaDB
 
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024
Jason Packer
 
Harnessing the Power of NLP and Knowledge Graphs for Opioid Research
Harnessing the Power of NLP and Knowledge Graphs for Opioid ResearchHarnessing the Power of NLP and Knowledge Graphs for Opioid Research
Harnessing the Power of NLP and Knowledge Graphs for Opioid Research
Neo4j
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
Zilliz
 
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectorsConnector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
DianaGray10
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
ssuserfac0301
 
"Choosing proper type of scaling", Olena Syrota
"Choosing proper type of scaling", Olena Syrota"Choosing proper type of scaling", Olena Syrota
"Choosing proper type of scaling", Olena Syrota
Fwdays
 
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
akankshawande
 
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAUHCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
panagenda
 
Leveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and StandardsLeveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and Standards
Neo4j
 
GNSS spoofing via SDR (Criptored Talks 2024)
GNSS spoofing via SDR (Criptored Talks 2024)GNSS spoofing via SDR (Criptored Talks 2024)
GNSS spoofing via SDR (Criptored Talks 2024)
Javier Junquera
 

Recently uploaded (20)

Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)
 
Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Biomedical Knowledge Graphs for Data Scientists and BioinformaticiansBiomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
 
Dandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity serverDandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity server
 
Digital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe
Digital Banking in the Cloud: How Citizens Bank Unlocked Their MainframeDigital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe
Digital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
 
The Microsoft 365 Migration Tutorial For Beginner.pptx
The Microsoft 365 Migration Tutorial For Beginner.pptxThe Microsoft 365 Migration Tutorial For Beginner.pptx
The Microsoft 365 Migration Tutorial For Beginner.pptx
 
Apps Break Data
Apps Break DataApps Break Data
Apps Break Data
 
June Patch Tuesday
June Patch TuesdayJune Patch Tuesday
June Patch Tuesday
 
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-EfficiencyFreshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
 
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024
 
Artificial Intelligence and Electronic Warfare
Artificial Intelligence and Electronic WarfareArtificial Intelligence and Electronic Warfare
Artificial Intelligence and Electronic Warfare
 
Harnessing the Power of NLP and Knowledge Graphs for Opioid Research
Harnessing the Power of NLP and Knowledge Graphs for Opioid ResearchHarnessing the Power of NLP and Knowledge Graphs for Opioid Research
Harnessing the Power of NLP and Knowledge Graphs for Opioid Research
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
 
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectorsConnector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
 
"Choosing proper type of scaling", Olena Syrota
"Choosing proper type of scaling", Olena Syrota"Choosing proper type of scaling", Olena Syrota
"Choosing proper type of scaling", Olena Syrota
 
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
 
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAUHCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
 
Leveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and StandardsLeveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and Standards
 
GNSS spoofing via SDR (Criptored Talks 2024)
GNSS spoofing via SDR (Criptored Talks 2024)GNSS spoofing via SDR (Criptored Talks 2024)
GNSS spoofing via SDR (Criptored Talks 2024)
 

Highly Autonomous Self Learning AI Agent

  • 1. HASL : HIGHLY AUTONOUMOUS SELF-LEARNING AI AGENT 1
  • 2. OBJECTIVE • To build a real-time occupancy detection system using machine learning neural network • Remotely recognize people’s emotions from video feed and perform prediction analysis • Communicate with security system including CCTV, audio feeds 2
  • 3. IDEA AND SCOPE 3 • The detection system recognizes occupants inside an environment with the help of CCTV footages and also camera feeds from occupants smartpho • The system also utilizes machine learning technology to deeply understand the occupants’ emotions, their actions and predict their actions.
  • 5. 5 USER SCHEMA • MongoDB – NoSQL Distributed Database • Contains all user information such as – Name – ID – Last Seen – Seen with – Emotion – Status – Location
  • 6. 6 SAMPLE USER SCHEMA { "userID": "UID0001", "name": "Raghav", "location": "", "seen with": { "userID": "UID0003, "name": "Vijay", "location": "Tambaram" }, "last seen": "21:01:25 PM", "emotion": "neutral" }
  • 7. REQUIREMENTS - HARDWARE • 2.1 GHz or above Intel Quad Core processors ( Quantity – 5 ) • 4 GB RAM ( Quantity – 5 ) • 500GB HDD ( Quantity – 4 ) • NVIDIA 2GB GPU ( Quantity – 2 ) • Network Switch ( Quantity – 1 ) 7
  • 8. PERFORMANCE ESTIMATION CPU Clock Speed - 2.1 GHz Operations / Cycle - 4 Cores / Processor - 4 Processors / Node - 2 No. of Nodes - 5 Efficiency ~ 85 % FLOPS Estimate: Theoretical - 0.336 Tflops Real – world - 0.29 Tflops 8
  • 9. REQUIREMENTS - SOFTWARE • Unix – based OS ( Ubuntu / CentOS ) •Apache UIMA – content analysis of unstructured data • ConceptNet4, DBPedia, WordNet - for Ontological data • Ngnix / HAProxy – for load balancing • Languages – Java, Python, NodeJS, Haskell, C++ 9
  • 10. ALGORITHMS AND FRAMEWORKS • Multimodal Recurrent Neural Networks • Viola-Jones Object detection • Bayesian Networks and Support Vector machines 10
  • 11. 11 ARCHITECTURE - NETWORK CAMERA FEEDS MEMCACHED LOAD BALANCER NODE 1 NODE 2 NODE 3 NODE 4 NODE 5
  • 12. 12 REFERENCES [1] Probabilistic Modeling of Failure Dependencies Using Markov Logic Networks - Ghosh, S, Steiner.W,, Denker, G - 2013 IEEE 19th Pacific Rim International Conference [2] Probabilistic Logic Networks, A Comprehensive Framework for Uncertain Inference - Goertzel, B., Iklé, M., Goertzel, I.F., Heljakka [3] OpenCog: A Software Framework for Integrative Artificial General Intelligence - Hart, D; B Goertzel (2008). [4] ArtMap: Supervised Real-time learning and classification of non-stationary data by self-organizing neural network – Gail A. Carpenter, Stephen Gossberg [5] ConceptNet 3: a Flexible, Multilingual Semantic Network for Common Sense Knowledge - Catherine Havasi, Rob Speer and Jason Alonso