SlideShare a Scribd company logo
1 of 27
DIPLOMA THESIS DESIGN
VOICE INTERACTIONS IN A SMART HOME
Budapest University of Technology and Economics
Author: KARIM NAIRI
Supervisor: Dr Gabor Feher
11 January 2021
Presentation plan:
2
1- Project display:
• Introduction
• Problem
• Requirements specification
2- Proposed solution:
• Traitement card
• Voice interaction card
• Block diagram of the system
3- Planning:
4- Work done
Conclusion
Project
display
3
Introduction:
■ Voice control was a dream
■ Currently voice control is a reality and is accessible to the general public
■ Many manufacturers are trying to position themselves in the market
■ Google Home, Amazon Alexa, Apple Siri …
■ Speech Recognition and Speech Synthesis APIs have been developed
■ All the proposed systems are based on internet connection
4
Voice Interaction in a smart house:
■ A smart person is someone who has the information and knowledge to solve a
problem.
■ A smart home needs the availability of information from its environment.
■ Depending on a given situation, actions are taken.
To have this we need:
 A set of sensors are available according to user needs.
 A program is designed to handle different cases.
5
Problem:
6
How to make a voice response system in a smart home?
Requirements specification:
7
Voice to
interaction
card
Treatment
card
 Tool able to hear voice commands and to speak.
 Device able to convert voice commands and to
realise an action over the Appliance.
 Microphone and speakers .
Peripheral
Proposed
solution
8
9
Introduction:
Most of the Voice Interactive Response (VIR) applications use an Internet
connection.
During the search I discovered the MOVI: My Own Voice Interface card. It is a card
that allows recognition and speech synthesis based on a memory card without the
need for an internet connection.
This board will be the core for the realization of the project.
 No internet connexion
 Cheap
 Scalable according to user needs
 Security
Block diagram of the system:
10
Traitement Board:
Arduino Simple to program
Open-source software
and hardware
flexible
Not expensive
11
MOVI Shield:
MOVI
SHIELD Simplicity of
implementation
Data Security and Safety
No internet needed
Low energy
consumption
12
SD Card:
■ The SD card is the essential part of the MOVI card
■ Training: MOVI’s Arduino library sends the training sentences in textual form
over the serial connection to the shield. The shield phonetizes the words in
each sentences using a 2 GB English dictionary that knows spelling rules and
approximates even for proper names.
■ Recognition: During recognition, a waveform comes in over the microphone
and is broken down into speech and non-speech regions. The speech regions of
the signal are then passed to a classifier that has been trained on hundreds of
adult speakers.
13
Planning
14
System components:
15
DHT11
Operating flow diagram:
16
Arduino board with components:
17
www.TheEngineeringProjects.com
Vcc
OUT
GND
TestPin
PIR
PIR SENSOR
80
27
%RH
>
°C
DATA
2
VDD
1
GND
4
U2
DHT11
D1
LED=PIR
R1
220
R2
220
D2
LIGHT or DARK
DIGITAL
(~PWM)
ANALOG
IN
ATMEGA328P-PU
1121
~
~
~
~
~
~
microcontrolandos.blogspot.com
TX
RX
PD0/RXD
0
PD1/TXD
1
PD2/INT0
2
PD3/INT1
3
PD4/T0/XCK
4
PD5/T1
5
PD6/AIN0
6
PD7/AIN1
7
PB0/ICP1/CLKO
8
PB1/OC1A
9
PB2/SS/OC1B
10
PB3/MOSI/OC2A
11
PB4/MISO
12
PB5/SCK
13
AREF
PC5/ADC5/SCL
A5
PC4/ADC4/SDA
A4
PC3/ADC3
A3
PC2/ADC2
A2
PC1/ADC1
A1
PC0/ADC0
A0
RESET
ARDUINO UNO
ARDUINO UNO R3
R3
4.7K
1.0
LDR
LDR
R5
5k
U2(VDD)
PIR(PB5/SCK)
LDR(2)
R4
10k
SECURITY
R4(1)
Light test:
18
LDR light test:
19
We tried to introduce the possibility of artificial intelligence (AI)
DHT11 test:
20
If the sensor is incorrectly connected or not functional, the system informs the
user.
PIR test:
21
In this part we used the state of the PIR to light a lamp when
it is active, and do say ‘’Can I help you? ‘’ Except at the rising
front.
Security Test:
22
In this essay we read a digital data
23
Result
Result:
24
■Vidéo
25
Conclusion:
■ Discovery of speech recognition and speech synthesis
■ Creation of a VIR system without an internet connection
■ The cost is about
■ The system can be used as:
 A security system
 A regulation system to control humidity, temperature, light,,,
 …
26
THANK YOU FOR YOUR
ATTENTION
27

More Related Content

Similar to thesisV4.pptx

Similar to thesisV4.pptx (20)

Voice Control Home Automation
Voice Control Home AutomationVoice Control Home Automation
Voice Control Home Automation
 
Arduino presentation by_warishusain
Arduino presentation by_warishusainArduino presentation by_warishusain
Arduino presentation by_warishusain
 
Iot based garbage monitoring system
Iot based garbage monitoring systemIot based garbage monitoring system
Iot based garbage monitoring system
 
Iot based digital notice board with arduino
Iot based digital notice board with arduinoIot based digital notice board with arduino
Iot based digital notice board with arduino
 
Presentation.pptx
Presentation.pptxPresentation.pptx
Presentation.pptx
 
Introduction to Arduino & Raspberry Pi
Introduction to Arduino & Raspberry PiIntroduction to Arduino & Raspberry Pi
Introduction to Arduino & Raspberry Pi
 
Eyes of things
Eyes of thingsEyes of things
Eyes of things
 
ArduRadio
ArduRadio ArduRadio
ArduRadio
 
Arduino, Open Source and The Internet of Things Landscape
Arduino, Open Source and The Internet of Things LandscapeArduino, Open Source and The Internet of Things Landscape
Arduino, Open Source and The Internet of Things Landscape
 
Raspberry Pi
Raspberry PiRaspberry Pi
Raspberry Pi
 
Hello World - Introduction to coding.pptx
Hello World - Introduction to coding.pptxHello World - Introduction to coding.pptx
Hello World - Introduction to coding.pptx
 
Home automation through android mobile 1
Home automation through android mobile 1Home automation through android mobile 1
Home automation through android mobile 1
 
ARTIFICIAL INTELLIGENCE DESKTOP VOICE ASSISTANT IN PYTHON
ARTIFICIAL INTELLIGENCE DESKTOP VOICE ASSISTANT IN PYTHONARTIFICIAL INTELLIGENCE DESKTOP VOICE ASSISTANT IN PYTHON
ARTIFICIAL INTELLIGENCE DESKTOP VOICE ASSISTANT IN PYTHON
 
Report
ReportReport
Report
 
DIGITAL LOGIC DESIGN (1) PROJECT REPORT.docx
DIGITAL LOGIC DESIGN (1) PROJECT REPORT.docxDIGITAL LOGIC DESIGN (1) PROJECT REPORT.docx
DIGITAL LOGIC DESIGN (1) PROJECT REPORT.docx
 
IoT Session Thomas More
IoT Session Thomas MoreIoT Session Thomas More
IoT Session Thomas More
 
Cc internet of things @ Thomas More
Cc internet of things @ Thomas MoreCc internet of things @ Thomas More
Cc internet of things @ Thomas More
 
Comparison of ESP programming platforms
Comparison of ESP programming platformsComparison of ESP programming platforms
Comparison of ESP programming platforms
 
Type 2 final project list 15 16
Type 2 final project list 15 16Type 2 final project list 15 16
Type 2 final project list 15 16
 
IRJET- Smart Home: Speech Recognition based Home Automation using IoT
IRJET-  	  Smart Home: Speech Recognition based Home Automation using IoTIRJET-  	  Smart Home: Speech Recognition based Home Automation using IoT
IRJET- Smart Home: Speech Recognition based Home Automation using IoT
 

Recently uploaded

INTERRUPT CONTROLLER 8259 MICROPROCESSOR
INTERRUPT CONTROLLER 8259 MICROPROCESSORINTERRUPT CONTROLLER 8259 MICROPROCESSOR
INTERRUPT CONTROLLER 8259 MICROPROCESSOR
TanishkaHira1
 
Standard vs Custom Battery Packs - Decoding the Power Play
Standard vs Custom Battery Packs - Decoding the Power PlayStandard vs Custom Battery Packs - Decoding the Power Play
Standard vs Custom Battery Packs - Decoding the Power Play
Epec Engineered Technologies
 
Hospital management system project report.pdf
Hospital management system project report.pdfHospital management system project report.pdf
Hospital management system project report.pdf
Kamal Acharya
 

Recently uploaded (20)

Fundamentals of Internet of Things (IoT) Part-2
Fundamentals of Internet of Things (IoT) Part-2Fundamentals of Internet of Things (IoT) Part-2
Fundamentals of Internet of Things (IoT) Part-2
 
Autodesk Construction Cloud (Autodesk Build).pptx
Autodesk Construction Cloud (Autodesk Build).pptxAutodesk Construction Cloud (Autodesk Build).pptx
Autodesk Construction Cloud (Autodesk Build).pptx
 
INTERRUPT CONTROLLER 8259 MICROPROCESSOR
INTERRUPT CONTROLLER 8259 MICROPROCESSORINTERRUPT CONTROLLER 8259 MICROPROCESSOR
INTERRUPT CONTROLLER 8259 MICROPROCESSOR
 
Standard vs Custom Battery Packs - Decoding the Power Play
Standard vs Custom Battery Packs - Decoding the Power PlayStandard vs Custom Battery Packs - Decoding the Power Play
Standard vs Custom Battery Packs - Decoding the Power Play
 
Fundamentals of Structure in C Programming
Fundamentals of Structure in C ProgrammingFundamentals of Structure in C Programming
Fundamentals of Structure in C Programming
 
Computer Graphics Introduction To Curves
Computer Graphics Introduction To CurvesComputer Graphics Introduction To Curves
Computer Graphics Introduction To Curves
 
Working Principle of Echo Sounder and Doppler Effect.pdf
Working Principle of Echo Sounder and Doppler Effect.pdfWorking Principle of Echo Sounder and Doppler Effect.pdf
Working Principle of Echo Sounder and Doppler Effect.pdf
 
S1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptx
S1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptxS1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptx
S1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptx
 
Call for Papers - Journal of Electrical Systems (JES), E-ISSN: 1112-5209, ind...
Call for Papers - Journal of Electrical Systems (JES), E-ISSN: 1112-5209, ind...Call for Papers - Journal of Electrical Systems (JES), E-ISSN: 1112-5209, ind...
Call for Papers - Journal of Electrical Systems (JES), E-ISSN: 1112-5209, ind...
 
Hospital management system project report.pdf
Hospital management system project report.pdfHospital management system project report.pdf
Hospital management system project report.pdf
 
Computer Networks Basics of Network Devices
Computer Networks  Basics of Network DevicesComputer Networks  Basics of Network Devices
Computer Networks Basics of Network Devices
 
Path loss model, OKUMURA Model, Hata Model
Path loss model, OKUMURA Model, Hata ModelPath loss model, OKUMURA Model, Hata Model
Path loss model, OKUMURA Model, Hata Model
 
Theory of Time 2024 (Universal Theory for Everything)
Theory of Time 2024 (Universal Theory for Everything)Theory of Time 2024 (Universal Theory for Everything)
Theory of Time 2024 (Universal Theory for Everything)
 
Danikor Product Catalog- Screw Feeder.pdf
Danikor Product Catalog- Screw Feeder.pdfDanikor Product Catalog- Screw Feeder.pdf
Danikor Product Catalog- Screw Feeder.pdf
 
Adsorption (mass transfer operations 2) ppt
Adsorption (mass transfer operations 2) pptAdsorption (mass transfer operations 2) ppt
Adsorption (mass transfer operations 2) ppt
 
PE 459 LECTURE 2- natural gas basic concepts and properties
PE 459 LECTURE 2- natural gas basic concepts and propertiesPE 459 LECTURE 2- natural gas basic concepts and properties
PE 459 LECTURE 2- natural gas basic concepts and properties
 
Max. shear stress theory-Maximum Shear Stress Theory ​ Maximum Distortional ...
Max. shear stress theory-Maximum Shear Stress Theory ​  Maximum Distortional ...Max. shear stress theory-Maximum Shear Stress Theory ​  Maximum Distortional ...
Max. shear stress theory-Maximum Shear Stress Theory ​ Maximum Distortional ...
 
Introduction to Artificial Intelligence ( AI)
Introduction to Artificial Intelligence ( AI)Introduction to Artificial Intelligence ( AI)
Introduction to Artificial Intelligence ( AI)
 
Signal Processing and Linear System Analysis
Signal Processing and Linear System AnalysisSignal Processing and Linear System Analysis
Signal Processing and Linear System Analysis
 
Lect.1: Getting Started (CS771: Machine Learning by Prof. Purushottam Kar, II...
Lect.1: Getting Started (CS771: Machine Learning by Prof. Purushottam Kar, II...Lect.1: Getting Started (CS771: Machine Learning by Prof. Purushottam Kar, II...
Lect.1: Getting Started (CS771: Machine Learning by Prof. Purushottam Kar, II...
 

thesisV4.pptx

  • 1. DIPLOMA THESIS DESIGN VOICE INTERACTIONS IN A SMART HOME Budapest University of Technology and Economics Author: KARIM NAIRI Supervisor: Dr Gabor Feher 11 January 2021
  • 2. Presentation plan: 2 1- Project display: • Introduction • Problem • Requirements specification 2- Proposed solution: • Traitement card • Voice interaction card • Block diagram of the system 3- Planning: 4- Work done Conclusion
  • 4. Introduction: ■ Voice control was a dream ■ Currently voice control is a reality and is accessible to the general public ■ Many manufacturers are trying to position themselves in the market ■ Google Home, Amazon Alexa, Apple Siri … ■ Speech Recognition and Speech Synthesis APIs have been developed ■ All the proposed systems are based on internet connection 4
  • 5. Voice Interaction in a smart house: ■ A smart person is someone who has the information and knowledge to solve a problem. ■ A smart home needs the availability of information from its environment. ■ Depending on a given situation, actions are taken. To have this we need:  A set of sensors are available according to user needs.  A program is designed to handle different cases. 5
  • 6. Problem: 6 How to make a voice response system in a smart home?
  • 7. Requirements specification: 7 Voice to interaction card Treatment card  Tool able to hear voice commands and to speak.  Device able to convert voice commands and to realise an action over the Appliance.  Microphone and speakers . Peripheral
  • 9. 9 Introduction: Most of the Voice Interactive Response (VIR) applications use an Internet connection. During the search I discovered the MOVI: My Own Voice Interface card. It is a card that allows recognition and speech synthesis based on a memory card without the need for an internet connection. This board will be the core for the realization of the project.  No internet connexion  Cheap  Scalable according to user needs  Security
  • 10. Block diagram of the system: 10
  • 11. Traitement Board: Arduino Simple to program Open-source software and hardware flexible Not expensive 11
  • 12. MOVI Shield: MOVI SHIELD Simplicity of implementation Data Security and Safety No internet needed Low energy consumption 12
  • 13. SD Card: ■ The SD card is the essential part of the MOVI card ■ Training: MOVI’s Arduino library sends the training sentences in textual form over the serial connection to the shield. The shield phonetizes the words in each sentences using a 2 GB English dictionary that knows spelling rules and approximates even for proper names. ■ Recognition: During recognition, a waveform comes in over the microphone and is broken down into speech and non-speech regions. The speech regions of the signal are then passed to a classifier that has been trained on hundreds of adult speakers. 13
  • 17. Arduino board with components: 17 www.TheEngineeringProjects.com Vcc OUT GND TestPin PIR PIR SENSOR 80 27 %RH > °C DATA 2 VDD 1 GND 4 U2 DHT11 D1 LED=PIR R1 220 R2 220 D2 LIGHT or DARK DIGITAL (~PWM) ANALOG IN ATMEGA328P-PU 1121 ~ ~ ~ ~ ~ ~ microcontrolandos.blogspot.com TX RX PD0/RXD 0 PD1/TXD 1 PD2/INT0 2 PD3/INT1 3 PD4/T0/XCK 4 PD5/T1 5 PD6/AIN0 6 PD7/AIN1 7 PB0/ICP1/CLKO 8 PB1/OC1A 9 PB2/SS/OC1B 10 PB3/MOSI/OC2A 11 PB4/MISO 12 PB5/SCK 13 AREF PC5/ADC5/SCL A5 PC4/ADC4/SDA A4 PC3/ADC3 A3 PC2/ADC2 A2 PC1/ADC1 A1 PC0/ADC0 A0 RESET ARDUINO UNO ARDUINO UNO R3 R3 4.7K 1.0 LDR LDR R5 5k U2(VDD) PIR(PB5/SCK) LDR(2) R4 10k SECURITY R4(1)
  • 19. LDR light test: 19 We tried to introduce the possibility of artificial intelligence (AI)
  • 20. DHT11 test: 20 If the sensor is incorrectly connected or not functional, the system informs the user.
  • 21. PIR test: 21 In this part we used the state of the PIR to light a lamp when it is active, and do say ‘’Can I help you? ‘’ Except at the rising front.
  • 22. Security Test: 22 In this essay we read a digital data
  • 26. Conclusion: ■ Discovery of speech recognition and speech synthesis ■ Creation of a VIR system without an internet connection ■ The cost is about ■ The system can be used as:  A security system  A regulation system to control humidity, temperature, light,,,  … 26
  • 27. THANK YOU FOR YOUR ATTENTION 27