Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Similar to Architecting an audio plugin host as web extension
Similar to Architecting an audio plugin host as web extension (20)
Recently uploaded
Recently uploaded (20)
Architecting an audio plugin host as web extension
- 1. 9th Panhellenic Conference «Acoustics 2018», October 8th-9th 2018, University of Patras 1 / 22 Architecting an audio plugin host as web extension Christos Tsakostas Electrical and Computer Engineer, Software Architect
- 2. 2 9th Panhellenic Conference «Acoustics 2018», October 8th-9th 2018, University of Patras Goal Easy and flexible adjustment of sound produced by the browser
- 3. 3 9th Panhellenic Conference «Acoustics 2018», October 8th-9th 2018, University of Patras Christos Tsakostas? ● 1998: Electrical Engineer (Patras) ● 1998 – 2001: Ph.D. Candidate in Psychoacoustics (Professors: J. Mourjopoulos, J.Blauert) ● 2001 – today: Independent researcher on 3D audio. Author of ARIA-3D ● 2001 – today: Software Engineer / Architect in enterprise projects
- 4. 4 9th Panhellenic Conference «Acoustics 2018», October 8th-9th 2018, University of Patras 2016: ARIA-3D Player
- 5. 5 9th Panhellenic Conference «Acoustics 2018», October 8th-9th 2018, University of Patras 2017: ARIA-3D Extension
- 6. 6 9th Panhellenic Conference «Acoustics 2018», October 8th-9th 2018, University of Patras The web sound problem ● No sound control in browsers. Possible through web extensions, but... ● Existing extensions offer limited audio processing ● Only one extension active at a time
- 7. 7 9th Panhellenic Conference «Acoustics 2018», October 8th-9th 2018, University of Patras What are people doing now? ● Limited or no control ● Basic web extensions – one at a time ● External hardware ● Sophisticated software
- 8. 8 9th Panhellenic Conference «Acoustics 2018», October 8th-9th 2018, University of Patras The ideal solution ● Both simple and advanced audio processors ● Any number of processors ● Audio templates (i.e. virtual surround, etc.) ● No external hardware
- 9. 9 9th Panhellenic Conference «Acoustics 2018», October 8th-9th 2018, University of Patras The proposed solution ● Web extension as audio plugin host ● A set of audio plugins / processors ● Arbitrary connections between plugins
- 10. 10 9th Panhellenic Conference «Acoustics 2018», October 8th-9th 2018, University of Patras Host
- 11. 11 9th Panhellenic Conference «Acoustics 2018», October 8th-9th 2018, University of Patras Plugins
- 12. 12 9th Panhellenic Conference «Acoustics 2018», October 8th-9th 2018, University of Patras Workbench
- 13. 13 9th Panhellenic Conference «Acoustics 2018», October 8th-9th 2018, University of Patras Plugin settings
- 14. 14 9th Panhellenic Conference «Acoustics 2018», October 8th-9th 2018, University of Patras Plugin settings
- 15. 15 9th Panhellenic Conference «Acoustics 2018», October 8th-9th 2018, University of Patras Visualizations
- 16. 16 9th Panhellenic Conference «Acoustics 2018», October 8th-9th 2018, University of Patras How? ● Web extension anatomy ● Proposed architecture
- 17. 17 9th Panhellenic Conference «Acoustics 2018», October 8th-9th 2018, University of Patras Web extension anatomy
- 18. 18 9th Panhellenic Conference «Acoustics 2018», October 8th-9th 2018, University of Patras Challenges ● Foreground (UI) and background (actual audio processing) live in different processes ● Data sharing between foreground & background ● Performance
- 19. 19 9th Panhellenic Conference «Acoustics 2018», October 8th-9th 2018, University of Patras High level architecture
- 20. 20 9th Panhellenic Conference «Acoustics 2018», October 8th-9th 2018, University of Patras Potential? Sky is the limit ● Advanced processing such as Crosstalk cancellation, HRTF, Virtual Acoustics, Stereo EQ, Stereo wideners, 5.1 to 2-channel audio etc. ● Usage of plugins from remote servers ● Research & Collaboration ● Education ● More?
- 21. 21 9th Panhellenic Conference «Acoustics 2018», October 8th-9th 2018, University of Patras Take away ● Asynchronous communication of background and foreground processing ● State management (i.e. REDUX) ● Use Web Audio API as much as you can ● For performant custom processing use C++ , converted to Web Assembly Javascript
- 22. 22 9th Panhellenic Conference «Acoustics 2018», October 8th-9th 2018, University of Patras Thank you! Christos Tsakostas Electrical and Computer Engineer, Software Architect https://www.polyfono.com