Advancing Concatenative Sound Synthesis Technology Noris Mohd Norowi
Introduction <ul><li>To create music by assembling unrelated sound snippets in the database according to a ‘target’ specif...
Concatenative Sound Synthesis Model
Concatenative Sound Synthesis Model QUERY
Objectives <ul><li>to solve issues in CSS, </li></ul><ul><li>by providing more flexibility and user options, </li></ul><ul...
What Affects Concatenation Results? <ul><li>Number of segments </li></ul><ul><li>Source files </li></ul><ul><li>Target Fil...
Dataset <ul><li>Source (Animal & Nature sounds) </li></ul><ul><ul><li>Lemurs </li></ul></ul><ul><ul><li>Indris </li></ul><...
Example 1: Country song <ul><li>onset_indris_country_ctd </li></ul><ul><li>onset_siamang_country_ctd </li></ul><ul><li>ons...
Result: Segmentation Mode
Result: Features
Basis of Similarity <ul><li>Loudness? </li></ul><ul><li>Timbral? </li></ul><ul><li>Melody? </li></ul><ul><li>Rhythm? </li>...
Potential Application EXACT EXPLORATORY INFORMATION RETRIEVAL
Example: Potential Applications <ul><li>onset_indris_country_ctd_reverse </li></ul><ul><li>onset_siamang_country_ctd_doubt...
Work in Progress: Other CSS Issues <ul><li>Forced match or no match? </li></ul><ul><li>Taboo list </li></ul><ul><li>Length...
Upcoming SlideShare
Loading in …5
×

Advancing concatenative sound synthesis technology

641 views

Published on

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
641
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
4
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Advancing concatenative sound synthesis technology

  1. 1. Advancing Concatenative Sound Synthesis Technology Noris Mohd Norowi
  2. 2. Introduction <ul><li>To create music by assembling unrelated sound snippets in the database according to a ‘target’ specification – audio mosaic </li></ul><ul><li>http://www.picturemosaics.com/idol2006/ </li></ul>
  3. 3. Concatenative Sound Synthesis Model
  4. 4. Concatenative Sound Synthesis Model QUERY
  5. 5. Objectives <ul><li>to solve issues in CSS, </li></ul><ul><li>by providing more flexibility and user options, </li></ul><ul><li>through the use of query, so that it minimizes the need of transformation and editing </li></ul>
  6. 6. What Affects Concatenation Results? <ul><li>Number of segments </li></ul><ul><li>Source files </li></ul><ul><li>Target Files </li></ul><ul><li>Segmentation Mode </li></ul><ul><li>Unit Selection Method </li></ul><ul><li>Audio Features </li></ul>
  7. 7. Dataset <ul><li>Source (Animal & Nature sounds) </li></ul><ul><ul><li>Lemurs </li></ul></ul><ul><ul><li>Indris </li></ul></ul><ul><ul><li>Siamang </li></ul></ul><ul><ul><li>Whales </li></ul></ul><ul><ul><li>Rainforest </li></ul></ul><ul><li>Target </li></ul><ul><ul><li>Classical </li></ul></ul><ul><ul><li>Country </li></ul></ul>http://www.youtube.com/watch?v=34z5DGZMf_s
  8. 8. Example 1: Country song <ul><li>onset_indris_country_ctd </li></ul><ul><li>onset_siamang_country_ctd </li></ul><ul><li>onset_whales_country_ctd </li></ul><ul><li>onset_indris_country_zcr </li></ul><ul><li>onset_indris_country_pch </li></ul><ul><li>onset_indris_country_flx </li></ul><ul><li>onset_indris_country_ALL </li></ul>
  9. 9. Result: Segmentation Mode
  10. 10. Result: Features
  11. 11. Basis of Similarity <ul><li>Loudness? </li></ul><ul><li>Timbral? </li></ul><ul><li>Melody? </li></ul><ul><li>Rhythm? </li></ul>
  12. 12. Potential Application EXACT EXPLORATORY INFORMATION RETRIEVAL
  13. 13. Example: Potential Applications <ul><li>onset_indris_country_ctd_reverse </li></ul><ul><li>onset_siamang_country_ctd_doubtemp </li></ul><ul><li>Woes of Wailing Whales </li></ul>
  14. 14. Work in Progress: Other CSS Issues <ul><li>Forced match or no match? </li></ul><ul><li>Taboo list </li></ul><ul><li>Length </li></ul><ul><li>Segments with same values </li></ul>

×