SlideShare a Scribd company logo
1 of 14
Download to read offline
Ilya Siganov
PhD student in Informatics
at FCS, OmSU
About me
● Graduated from the OmSU, FCS,
Computer Security (specialty)
● Ph.D. student in Informatics and
Computer Engineering Techniques
● Developer at 7bits
About supervisor
Lavrov Dmitry Nikolayevich
● Associate Professor
● PhD in Engineering Science
● Head of Department of Computer
Technologies and Networks
● Deputy Chief Editor of the journal
“Mathematical Structures and
Modeling”
Projects
● Flash Transmitter
● Research on security of personal data in browsers
● Audio Thermometer
● Zero knowledge proof authentication in Web applications
● Research of ability to apply “Mafia fraud attack” against WhatsApp
Scientific interest
● Machine learning
● Data analysis
● Artificial neural networks
● Audio analysis
● Software architecture
● Distributed systems
● Security
PhD topic & problems to solve
● “Cocktail party” problem - how to extract a sound object of
interest
PhD topic & problems to solve
● Decomposing speech of a speakers group.
Problem
a + b = 5
a, b - unknown values
We have to find a, b!!
How to solve?
How to decompose a real world sound mixture into
individual audio objects?
● Blind source separation
● Beamforming
● Combination of BSS and Beamforming
● Build artificial human-like ear
● Study how human brain does sound decomposition
Expectation
a + b = 5
a is probably 3
b is probably 2 or 1
We have to find a, b!!
Subtasks
● Develop an environment simulator (room, valley, hall, etc.)
● Determine the direction to the source-signal
● Subtract a known background sound(music) from some mix
of voice and music
● Synchronize almost the same clips but not quite
● Build a Male/Female voice recognition and classification app.
● Extract a single voice from music
Experiments
● Decompose linearly synthetic mixed sounds with ICA -
success
● Decompose a real mixture - fail
● Synchronize sounds of a real mixture - fail
● Cancel background music in synthetic and real mixture -
success
● Simulate sound propagation - in progress
Application in real life
● Dramatically improve noise suppression
● Effective sound compression
● Sound decomposition for speech recognition systems
● Environment describing software
● Subtract music from sound to avoid problems with
right-holders
Who need this?

More Related Content

Similar to About my research in english

Machine learning for creative AI applications in music (2018 nov)
Machine learning for creative AI applications in music (2018 nov)Machine learning for creative AI applications in music (2018 nov)
Machine learning for creative AI applications in music (2018 nov)Yi-Hsuan Yang
 
Artificial Intelligence in Music, Mick Grierson, Reader, Director of Computin...
Artificial Intelligence in Music, Mick Grierson, Reader, Director of Computin...Artificial Intelligence in Music, Mick Grierson, Reader, Director of Computin...
Artificial Intelligence in Music, Mick Grierson, Reader, Director of Computin...MME 4.5 / Music 4.5 / 2Pears
 
The Next-Gen Dynamic Sound System of Killzone Shadow Fall
The Next-Gen Dynamic Sound System of Killzone Shadow FallThe Next-Gen Dynamic Sound System of Killzone Shadow Fall
The Next-Gen Dynamic Sound System of Killzone Shadow FallGuerrilla
 
Week1- Introduction.pptx
Week1- Introduction.pptxWeek1- Introduction.pptx
Week1- Introduction.pptxfahmi324663
 
Today is all about AI
Today is all about AIToday is all about AI
Today is all about AIPetru Cioată
 
Artificial intelligence and Music
Artificial intelligence and MusicArtificial intelligence and Music
Artificial intelligence and MusicJehoshaphat Abu
 
IG2 Task 1 Work Sheet
IG2 Task 1 Work SheetIG2 Task 1 Work Sheet
IG2 Task 1 Work Sheetwallinplanet
 
Presentation1
Presentation1Presentation1
Presentation1Syed Afiq
 
7-200404101602.pdf
7-200404101602.pdf7-200404101602.pdf
7-200404101602.pdfssuser07e9f2
 
Intro to Auto Speech Recognition -- How ML Learns Speech-to-Text
Intro to Auto Speech Recognition -- How ML Learns Speech-to-TextIntro to Auto Speech Recognition -- How ML Learns Speech-to-Text
Intro to Auto Speech Recognition -- How ML Learns Speech-to-TextYoshiyuki Igarashi
 
How Deep Learning Changes the Design Process #NEXT17
How Deep Learning Changes the Design Process #NEXT17How Deep Learning Changes the Design Process #NEXT17
How Deep Learning Changes the Design Process #NEXT17Alexander Meinhardt
 
Natural language Analysis
Natural language AnalysisNatural language Analysis
Natural language AnalysisRudradeb Mitra
 
IV_WORKSHOP_NVIDIA-Audio_Processing
IV_WORKSHOP_NVIDIA-Audio_ProcessingIV_WORKSHOP_NVIDIA-Audio_Processing
IV_WORKSHOP_NVIDIA-Audio_Processingdiegogee
 
Understanding Artificial Intelligence
Understanding Artificial Intelligence Understanding Artificial Intelligence
Understanding Artificial Intelligence St. Petersburg College
 
UX STRAT Europe 2019: Zhaochang He, VMware
UX STRAT Europe 2019: Zhaochang He, VMwareUX STRAT Europe 2019: Zhaochang He, VMware
UX STRAT Europe 2019: Zhaochang He, VMwareUX STRAT
 
Making Audio Engineering Learning & Practice Accessible in Virtual Reality
Making Audio Engineering Learning & Practice Accessible in Virtual RealityMaking Audio Engineering Learning & Practice Accessible in Virtual Reality
Making Audio Engineering Learning & Practice Accessible in Virtual RealitySamuel Fisher
 

Similar to About my research in english (20)

BLUE BRAIN.ppt
BLUE BRAIN.pptBLUE BRAIN.ppt
BLUE BRAIN.ppt
 
Machine learning for creative AI applications in music (2018 nov)
Machine learning for creative AI applications in music (2018 nov)Machine learning for creative AI applications in music (2018 nov)
Machine learning for creative AI applications in music (2018 nov)
 
Artificial Intelligence in Music, Mick Grierson, Reader, Director of Computin...
Artificial Intelligence in Music, Mick Grierson, Reader, Director of Computin...Artificial Intelligence in Music, Mick Grierson, Reader, Director of Computin...
Artificial Intelligence in Music, Mick Grierson, Reader, Director of Computin...
 
The Next-Gen Dynamic Sound System of Killzone Shadow Fall
The Next-Gen Dynamic Sound System of Killzone Shadow FallThe Next-Gen Dynamic Sound System of Killzone Shadow Fall
The Next-Gen Dynamic Sound System of Killzone Shadow Fall
 
Week1- Introduction.pptx
Week1- Introduction.pptxWeek1- Introduction.pptx
Week1- Introduction.pptx
 
Today is all about AI
Today is all about AIToday is all about AI
Today is all about AI
 
Artificial intelligence and Music
Artificial intelligence and MusicArtificial intelligence and Music
Artificial intelligence and Music
 
Dm
DmDm
Dm
 
IG2 Task 1 Work Sheet
IG2 Task 1 Work SheetIG2 Task 1 Work Sheet
IG2 Task 1 Work Sheet
 
Presentation1
Presentation1Presentation1
Presentation1
 
Generative models
Generative modelsGenerative models
Generative models
 
7-200404101602.pdf
7-200404101602.pdf7-200404101602.pdf
7-200404101602.pdf
 
Intro to Auto Speech Recognition -- How ML Learns Speech-to-Text
Intro to Auto Speech Recognition -- How ML Learns Speech-to-TextIntro to Auto Speech Recognition -- How ML Learns Speech-to-Text
Intro to Auto Speech Recognition -- How ML Learns Speech-to-Text
 
How Deep Learning Changes the Design Process #NEXT17
How Deep Learning Changes the Design Process #NEXT17How Deep Learning Changes the Design Process #NEXT17
How Deep Learning Changes the Design Process #NEXT17
 
Natural language Analysis
Natural language AnalysisNatural language Analysis
Natural language Analysis
 
Lec11cgu_10.ppt
Lec11cgu_10.pptLec11cgu_10.ppt
Lec11cgu_10.ppt
 
IV_WORKSHOP_NVIDIA-Audio_Processing
IV_WORKSHOP_NVIDIA-Audio_ProcessingIV_WORKSHOP_NVIDIA-Audio_Processing
IV_WORKSHOP_NVIDIA-Audio_Processing
 
Understanding Artificial Intelligence
Understanding Artificial Intelligence Understanding Artificial Intelligence
Understanding Artificial Intelligence
 
UX STRAT Europe 2019: Zhaochang He, VMware
UX STRAT Europe 2019: Zhaochang He, VMwareUX STRAT Europe 2019: Zhaochang He, VMware
UX STRAT Europe 2019: Zhaochang He, VMware
 
Making Audio Engineering Learning & Practice Accessible in Virtual Reality
Making Audio Engineering Learning & Practice Accessible in Virtual RealityMaking Audio Engineering Learning & Practice Accessible in Virtual Reality
Making Audio Engineering Learning & Practice Accessible in Virtual Reality
 

More from Ilya Siganov

Методы декомпозиции звукового сигнала.
Методы декомпозиции звукового сигнала.Методы декомпозиции звукового сигнала.
Методы декомпозиции звукового сигнала.Ilya Siganov
 
Зачем учить машины?
Зачем учить машины?Зачем учить машины?
Зачем учить машины?Ilya Siganov
 
Что такое машинное обучение - Happydev lite 2017
Что такое машинное обучение - Happydev lite 2017Что такое машинное обучение - Happydev lite 2017
Что такое машинное обучение - Happydev lite 2017Ilya Siganov
 
Защита личных данных пользователя в современных браузерах
Защита личных данных пользователя в современных браузерахЗащита личных данных пользователя в современных браузерах
Защита личных данных пользователя в современных браузерахIlya Siganov
 
Linux Terminal Server Project
 Linux Terminal Server Project Linux Terminal Server Project
Linux Terminal Server ProjectIlya Siganov
 
АудиоТермометр
АудиоТермометрАудиоТермометр
АудиоТермометрIlya Siganov
 

More from Ilya Siganov (9)

Методы декомпозиции звукового сигнала.
Методы декомпозиции звукового сигнала.Методы декомпозиции звукового сигнала.
Методы декомпозиции звукового сигнала.
 
Зачем учить машины?
Зачем учить машины?Зачем учить машины?
Зачем учить машины?
 
Что такое машинное обучение - Happydev lite 2017
Что такое машинное обучение - Happydev lite 2017Что такое машинное обучение - Happydev lite 2017
Что такое машинное обучение - Happydev lite 2017
 
Защита личных данных пользователя в современных браузерах
Защита личных данных пользователя в современных браузерахЗащита личных данных пользователя в современных браузерах
Защита личных данных пользователя в современных браузерах
 
Flash transmitter
Flash transmitterFlash transmitter
Flash transmitter
 
Summaryapp
SummaryappSummaryapp
Summaryapp
 
Linux Terminal Server Project
 Linux Terminal Server Project Linux Terminal Server Project
Linux Terminal Server Project
 
Dyn DNS story
Dyn DNS storyDyn DNS story
Dyn DNS story
 
АудиоТермометр
АудиоТермометрАудиоТермометр
АудиоТермометр
 

Recently uploaded

Russian Call Girls in Kolkata Vaishnavi 🤌 8250192130 🚀 Vip Call Girls Kolkata
Russian Call Girls in Kolkata Vaishnavi 🤌  8250192130 🚀 Vip Call Girls KolkataRussian Call Girls in Kolkata Vaishnavi 🤌  8250192130 🚀 Vip Call Girls Kolkata
Russian Call Girls in Kolkata Vaishnavi 🤌 8250192130 🚀 Vip Call Girls Kolkataanamikaraghav4
 
OSCamp Kubernetes 2024 | A Tester's Guide to CI_CD as an Automated Quality Co...
OSCamp Kubernetes 2024 | A Tester's Guide to CI_CD as an Automated Quality Co...OSCamp Kubernetes 2024 | A Tester's Guide to CI_CD as an Automated Quality Co...
OSCamp Kubernetes 2024 | A Tester's Guide to CI_CD as an Automated Quality Co...NETWAYS
 
NATIONAL ANTHEMS OF AFRICA (National Anthems of Africa)
NATIONAL ANTHEMS OF AFRICA (National Anthems of Africa)NATIONAL ANTHEMS OF AFRICA (National Anthems of Africa)
NATIONAL ANTHEMS OF AFRICA (National Anthems of Africa)Basil Achie
 
WhatsApp 📞 9892124323 ✅Call Girls In Juhu ( Mumbai )
WhatsApp 📞 9892124323 ✅Call Girls In Juhu ( Mumbai )WhatsApp 📞 9892124323 ✅Call Girls In Juhu ( Mumbai )
WhatsApp 📞 9892124323 ✅Call Girls In Juhu ( Mumbai )Pooja Nehwal
 
call girls in delhi malviya nagar @9811711561@
call girls in delhi malviya nagar @9811711561@call girls in delhi malviya nagar @9811711561@
call girls in delhi malviya nagar @9811711561@vikas rana
 
Call Girls in Sarojini Nagar Market Delhi 💯 Call Us 🔝8264348440🔝
Call Girls in Sarojini Nagar Market Delhi 💯 Call Us 🔝8264348440🔝Call Girls in Sarojini Nagar Market Delhi 💯 Call Us 🔝8264348440🔝
Call Girls in Sarojini Nagar Market Delhi 💯 Call Us 🔝8264348440🔝soniya singh
 
Open Source Strategy in Logistics 2015_Henrik Hankedvz-d-nl-log-conference.pdf
Open Source Strategy in Logistics 2015_Henrik Hankedvz-d-nl-log-conference.pdfOpen Source Strategy in Logistics 2015_Henrik Hankedvz-d-nl-log-conference.pdf
Open Source Strategy in Logistics 2015_Henrik Hankedvz-d-nl-log-conference.pdfhenrik385807
 
Open Source Camp Kubernetes 2024 | Running WebAssembly on Kubernetes by Alex ...
Open Source Camp Kubernetes 2024 | Running WebAssembly on Kubernetes by Alex ...Open Source Camp Kubernetes 2024 | Running WebAssembly on Kubernetes by Alex ...
Open Source Camp Kubernetes 2024 | Running WebAssembly on Kubernetes by Alex ...NETWAYS
 
Open Source Camp Kubernetes 2024 | Monitoring Kubernetes With Icinga by Eric ...
Open Source Camp Kubernetes 2024 | Monitoring Kubernetes With Icinga by Eric ...Open Source Camp Kubernetes 2024 | Monitoring Kubernetes With Icinga by Eric ...
Open Source Camp Kubernetes 2024 | Monitoring Kubernetes With Icinga by Eric ...NETWAYS
 
Exploring protein-protein interactions by Weak Affinity Chromatography (WAC) ...
Exploring protein-protein interactions by Weak Affinity Chromatography (WAC) ...Exploring protein-protein interactions by Weak Affinity Chromatography (WAC) ...
Exploring protein-protein interactions by Weak Affinity Chromatography (WAC) ...Salam Al-Karadaghi
 
The 3rd Intl. Workshop on NL-based Software Engineering
The 3rd Intl. Workshop on NL-based Software EngineeringThe 3rd Intl. Workshop on NL-based Software Engineering
The 3rd Intl. Workshop on NL-based Software EngineeringSebastiano Panichella
 
CTAC 2024 Valencia - Sven Zoelle - Most Crucial Invest to Digitalisation_slid...
CTAC 2024 Valencia - Sven Zoelle - Most Crucial Invest to Digitalisation_slid...CTAC 2024 Valencia - Sven Zoelle - Most Crucial Invest to Digitalisation_slid...
CTAC 2024 Valencia - Sven Zoelle - Most Crucial Invest to Digitalisation_slid...henrik385807
 
Presentation for the Strategic Dialogue on the Future of Agriculture, Brussel...
Presentation for the Strategic Dialogue on the Future of Agriculture, Brussel...Presentation for the Strategic Dialogue on the Future of Agriculture, Brussel...
Presentation for the Strategic Dialogue on the Future of Agriculture, Brussel...Krijn Poppe
 
Navi Mumbai Call Girls Service Pooja 9892124323 Real Russian Girls Looking Mo...
Navi Mumbai Call Girls Service Pooja 9892124323 Real Russian Girls Looking Mo...Navi Mumbai Call Girls Service Pooja 9892124323 Real Russian Girls Looking Mo...
Navi Mumbai Call Girls Service Pooja 9892124323 Real Russian Girls Looking Mo...Pooja Nehwal
 
SBFT Tool Competition 2024 -- Python Test Case Generation Track
SBFT Tool Competition 2024 -- Python Test Case Generation TrackSBFT Tool Competition 2024 -- Python Test Case Generation Track
SBFT Tool Competition 2024 -- Python Test Case Generation TrackSebastiano Panichella
 
Simulation-based Testing of Unmanned Aerial Vehicles with Aerialist
Simulation-based Testing of Unmanned Aerial Vehicles with AerialistSimulation-based Testing of Unmanned Aerial Vehicles with Aerialist
Simulation-based Testing of Unmanned Aerial Vehicles with AerialistSebastiano Panichella
 
Microsoft Copilot AI for Everyone - created by AI
Microsoft Copilot AI for Everyone - created by AIMicrosoft Copilot AI for Everyone - created by AI
Microsoft Copilot AI for Everyone - created by AITatiana Gurgel
 
LANDMARKS AND MONUMENTS IN NIGERIA.pptx
LANDMARKS  AND MONUMENTS IN NIGERIA.pptxLANDMARKS  AND MONUMENTS IN NIGERIA.pptx
LANDMARKS AND MONUMENTS IN NIGERIA.pptxBasil Achie
 
Genesis part 2 Isaiah Scudder 04-24-2024.pptx
Genesis part 2 Isaiah Scudder 04-24-2024.pptxGenesis part 2 Isaiah Scudder 04-24-2024.pptx
Genesis part 2 Isaiah Scudder 04-24-2024.pptxFamilyWorshipCenterD
 
OSCamp Kubernetes 2024 | Zero-Touch OS-Infrastruktur für Container und Kubern...
OSCamp Kubernetes 2024 | Zero-Touch OS-Infrastruktur für Container und Kubern...OSCamp Kubernetes 2024 | Zero-Touch OS-Infrastruktur für Container und Kubern...
OSCamp Kubernetes 2024 | Zero-Touch OS-Infrastruktur für Container und Kubern...NETWAYS
 

Recently uploaded (20)

Russian Call Girls in Kolkata Vaishnavi 🤌 8250192130 🚀 Vip Call Girls Kolkata
Russian Call Girls in Kolkata Vaishnavi 🤌  8250192130 🚀 Vip Call Girls KolkataRussian Call Girls in Kolkata Vaishnavi 🤌  8250192130 🚀 Vip Call Girls Kolkata
Russian Call Girls in Kolkata Vaishnavi 🤌 8250192130 🚀 Vip Call Girls Kolkata
 
OSCamp Kubernetes 2024 | A Tester's Guide to CI_CD as an Automated Quality Co...
OSCamp Kubernetes 2024 | A Tester's Guide to CI_CD as an Automated Quality Co...OSCamp Kubernetes 2024 | A Tester's Guide to CI_CD as an Automated Quality Co...
OSCamp Kubernetes 2024 | A Tester's Guide to CI_CD as an Automated Quality Co...
 
NATIONAL ANTHEMS OF AFRICA (National Anthems of Africa)
NATIONAL ANTHEMS OF AFRICA (National Anthems of Africa)NATIONAL ANTHEMS OF AFRICA (National Anthems of Africa)
NATIONAL ANTHEMS OF AFRICA (National Anthems of Africa)
 
WhatsApp 📞 9892124323 ✅Call Girls In Juhu ( Mumbai )
WhatsApp 📞 9892124323 ✅Call Girls In Juhu ( Mumbai )WhatsApp 📞 9892124323 ✅Call Girls In Juhu ( Mumbai )
WhatsApp 📞 9892124323 ✅Call Girls In Juhu ( Mumbai )
 
call girls in delhi malviya nagar @9811711561@
call girls in delhi malviya nagar @9811711561@call girls in delhi malviya nagar @9811711561@
call girls in delhi malviya nagar @9811711561@
 
Call Girls in Sarojini Nagar Market Delhi 💯 Call Us 🔝8264348440🔝
Call Girls in Sarojini Nagar Market Delhi 💯 Call Us 🔝8264348440🔝Call Girls in Sarojini Nagar Market Delhi 💯 Call Us 🔝8264348440🔝
Call Girls in Sarojini Nagar Market Delhi 💯 Call Us 🔝8264348440🔝
 
Open Source Strategy in Logistics 2015_Henrik Hankedvz-d-nl-log-conference.pdf
Open Source Strategy in Logistics 2015_Henrik Hankedvz-d-nl-log-conference.pdfOpen Source Strategy in Logistics 2015_Henrik Hankedvz-d-nl-log-conference.pdf
Open Source Strategy in Logistics 2015_Henrik Hankedvz-d-nl-log-conference.pdf
 
Open Source Camp Kubernetes 2024 | Running WebAssembly on Kubernetes by Alex ...
Open Source Camp Kubernetes 2024 | Running WebAssembly on Kubernetes by Alex ...Open Source Camp Kubernetes 2024 | Running WebAssembly on Kubernetes by Alex ...
Open Source Camp Kubernetes 2024 | Running WebAssembly on Kubernetes by Alex ...
 
Open Source Camp Kubernetes 2024 | Monitoring Kubernetes With Icinga by Eric ...
Open Source Camp Kubernetes 2024 | Monitoring Kubernetes With Icinga by Eric ...Open Source Camp Kubernetes 2024 | Monitoring Kubernetes With Icinga by Eric ...
Open Source Camp Kubernetes 2024 | Monitoring Kubernetes With Icinga by Eric ...
 
Exploring protein-protein interactions by Weak Affinity Chromatography (WAC) ...
Exploring protein-protein interactions by Weak Affinity Chromatography (WAC) ...Exploring protein-protein interactions by Weak Affinity Chromatography (WAC) ...
Exploring protein-protein interactions by Weak Affinity Chromatography (WAC) ...
 
The 3rd Intl. Workshop on NL-based Software Engineering
The 3rd Intl. Workshop on NL-based Software EngineeringThe 3rd Intl. Workshop on NL-based Software Engineering
The 3rd Intl. Workshop on NL-based Software Engineering
 
CTAC 2024 Valencia - Sven Zoelle - Most Crucial Invest to Digitalisation_slid...
CTAC 2024 Valencia - Sven Zoelle - Most Crucial Invest to Digitalisation_slid...CTAC 2024 Valencia - Sven Zoelle - Most Crucial Invest to Digitalisation_slid...
CTAC 2024 Valencia - Sven Zoelle - Most Crucial Invest to Digitalisation_slid...
 
Presentation for the Strategic Dialogue on the Future of Agriculture, Brussel...
Presentation for the Strategic Dialogue on the Future of Agriculture, Brussel...Presentation for the Strategic Dialogue on the Future of Agriculture, Brussel...
Presentation for the Strategic Dialogue on the Future of Agriculture, Brussel...
 
Navi Mumbai Call Girls Service Pooja 9892124323 Real Russian Girls Looking Mo...
Navi Mumbai Call Girls Service Pooja 9892124323 Real Russian Girls Looking Mo...Navi Mumbai Call Girls Service Pooja 9892124323 Real Russian Girls Looking Mo...
Navi Mumbai Call Girls Service Pooja 9892124323 Real Russian Girls Looking Mo...
 
SBFT Tool Competition 2024 -- Python Test Case Generation Track
SBFT Tool Competition 2024 -- Python Test Case Generation TrackSBFT Tool Competition 2024 -- Python Test Case Generation Track
SBFT Tool Competition 2024 -- Python Test Case Generation Track
 
Simulation-based Testing of Unmanned Aerial Vehicles with Aerialist
Simulation-based Testing of Unmanned Aerial Vehicles with AerialistSimulation-based Testing of Unmanned Aerial Vehicles with Aerialist
Simulation-based Testing of Unmanned Aerial Vehicles with Aerialist
 
Microsoft Copilot AI for Everyone - created by AI
Microsoft Copilot AI for Everyone - created by AIMicrosoft Copilot AI for Everyone - created by AI
Microsoft Copilot AI for Everyone - created by AI
 
LANDMARKS AND MONUMENTS IN NIGERIA.pptx
LANDMARKS  AND MONUMENTS IN NIGERIA.pptxLANDMARKS  AND MONUMENTS IN NIGERIA.pptx
LANDMARKS AND MONUMENTS IN NIGERIA.pptx
 
Genesis part 2 Isaiah Scudder 04-24-2024.pptx
Genesis part 2 Isaiah Scudder 04-24-2024.pptxGenesis part 2 Isaiah Scudder 04-24-2024.pptx
Genesis part 2 Isaiah Scudder 04-24-2024.pptx
 
OSCamp Kubernetes 2024 | Zero-Touch OS-Infrastruktur für Container und Kubern...
OSCamp Kubernetes 2024 | Zero-Touch OS-Infrastruktur für Container und Kubern...OSCamp Kubernetes 2024 | Zero-Touch OS-Infrastruktur für Container und Kubern...
OSCamp Kubernetes 2024 | Zero-Touch OS-Infrastruktur für Container und Kubern...
 

About my research in english

  • 1. Ilya Siganov PhD student in Informatics at FCS, OmSU
  • 2. About me ● Graduated from the OmSU, FCS, Computer Security (specialty) ● Ph.D. student in Informatics and Computer Engineering Techniques ● Developer at 7bits
  • 3. About supervisor Lavrov Dmitry Nikolayevich ● Associate Professor ● PhD in Engineering Science ● Head of Department of Computer Technologies and Networks ● Deputy Chief Editor of the journal “Mathematical Structures and Modeling”
  • 4. Projects ● Flash Transmitter ● Research on security of personal data in browsers ● Audio Thermometer ● Zero knowledge proof authentication in Web applications ● Research of ability to apply “Mafia fraud attack” against WhatsApp
  • 5. Scientific interest ● Machine learning ● Data analysis ● Artificial neural networks ● Audio analysis ● Software architecture ● Distributed systems ● Security
  • 6. PhD topic & problems to solve ● “Cocktail party” problem - how to extract a sound object of interest
  • 7. PhD topic & problems to solve ● Decomposing speech of a speakers group.
  • 8. Problem a + b = 5 a, b - unknown values We have to find a, b!!
  • 9. How to solve? How to decompose a real world sound mixture into individual audio objects? ● Blind source separation ● Beamforming ● Combination of BSS and Beamforming ● Build artificial human-like ear ● Study how human brain does sound decomposition
  • 10. Expectation a + b = 5 a is probably 3 b is probably 2 or 1 We have to find a, b!!
  • 11. Subtasks ● Develop an environment simulator (room, valley, hall, etc.) ● Determine the direction to the source-signal ● Subtract a known background sound(music) from some mix of voice and music ● Synchronize almost the same clips but not quite ● Build a Male/Female voice recognition and classification app. ● Extract a single voice from music
  • 12. Experiments ● Decompose linearly synthetic mixed sounds with ICA - success ● Decompose a real mixture - fail ● Synchronize sounds of a real mixture - fail ● Cancel background music in synthetic and real mixture - success ● Simulate sound propagation - in progress
  • 13. Application in real life ● Dramatically improve noise suppression ● Effective sound compression ● Sound decomposition for speech recognition systems ● Environment describing software ● Subtract music from sound to avoid problems with right-holders