SlideShare a Scribd company logo
1 of 12
Abstraction
         Layer

                     Audio
MIDI
Isomer-Symbolic



Description
Ingests single or multiple MIDI files (in
parallel) from a specified directory and
populates a MySQL database with a
symbolic model and associated raw MIDI
data. While the raw MIDI data remains
uninterpreted, it is organized into individual
streams (based on MIDI track) containing
collections of raw NodeEvents.
Isomer-Audio
               Description
               Isomer-Audio ingests single or multiple
               audio files (in parallel) from a specific
               directory and populates a MySQL
               database with an audio model and
               associated raw audio data. While the raw
               audio data remains uninterpreted, it is
               organized into separate streams
               depending on the type of preprocessing
               (e.g. source separation) employed.

                                 Externals
                                   SMS
                                   MEAPsoft
                                   openBliSSART
                                   SIMM
                                   JAFE
Isomer-A.R.E.
A.R.E. is an acronym defined as: Abstracted Representation Engine. The A.R.E. parses
ingested raw symbolic and audio data and populates a MySQL database with abstraction
layer data in a cartesian coordinate format. This allows input from various sources to
combine in a single representation suitable for further analysis and transformation.

                        slice

                                                   segment
streams




                                                                      stream

                                          time
2ms

                  melody
stream 1




                 harmony
                  rhythm
                  timbre

                  melody
stream 2




                 harmony
                  rhythm
                  timbre

                  time
melody




          A.R.E. Data
         (single point)
harmony




           A.R.E. Data
          (single point)
rhythm




          A.R.E. Data
         (single point)
timbre




          A.R.E. Data
         (single point)
Isomer-Query
Isomer-Query allows users to retrieve Isomer-generated A.R.E. data (above) and mine that
data for musically relevant trends. Displays analyzed A.R.E. data as time points (X-axis)
and streams/sub-streams (Y-axis) for a given model and allows on-demand calculation of
any/all of the following data for any grid coordinates or range of coordinates:



 melody                harmony                    timbre                 rhythm
                                                                     Temporal Direction
Registral Direction
                       Tension Direction                             Temporal Instability
 Registral Return
                       Tension Instability    Textural Fingerprint      IOI Range
 Proximity Ratio
                       Average Tension         Dynamic Accent            NPVI IOI
 Interval Range
                                                                       NPVI Duration
 Melodic Accent
                                                                       Agogic Accent
Event Trends
                                          Event Properties
 Event Properties   Registral Direction
                     Registral Return           RMS
      Pitch          Proximity Ratio      Spectral Stability
     Pitch IR         Interval Range      Spectral Flatness       Event Trends
    IR Equity        Melodic Accent         MFCC (13)
 Proximity Equity                                              Textural Fingerprint
 Registral Return                                               Dynamic Accent
                      melody              timbre

Event Properties
                       rhythm             harmony
                                                                   Event Trends
                      Event Trends
   N1 Onset
                                          Event Properties       Tension Direction
   N2 Onset        Temporal Direction
      Offset                                   Tension           Tension Instability
                   Temporal Instability
 Onset Delta (p)                           Pitch Collection      Average Tension
                      IOI Range
Duration Delta (p)     NPVI IOI           Average Chroma
                     NPVI Duration          Chroma (12)
                     Agogic Accent

More Related Content

Featured

2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by HubspotMarius Sescu
 
Everything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTEverything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTExpeed Software
 
Product Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsProduct Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsPixeldarts
 
How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthThinkNow
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfmarketingartwork
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024Neil Kimberley
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)contently
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024Albert Qian
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsKurio // The Social Media Age(ncy)
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Search Engine Journal
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summarySpeakerHub
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next Tessa Mero
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentLily Ray
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best PracticesVit Horky
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project managementMindGenius
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...RachelPearson36
 

Featured (20)

2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot
 
Everything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTEverything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPT
 
Product Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsProduct Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage Engineerings
 
How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental Health
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
 
Skeleton Culture Code
Skeleton Culture CodeSkeleton Culture Code
Skeleton Culture Code
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 

A.R.E. data abstraction and query

  • 1.
  • 2. Abstraction Layer Audio MIDI
  • 3. Isomer-Symbolic Description Ingests single or multiple MIDI files (in parallel) from a specified directory and populates a MySQL database with a symbolic model and associated raw MIDI data. While the raw MIDI data remains uninterpreted, it is organized into individual streams (based on MIDI track) containing collections of raw NodeEvents.
  • 4. Isomer-Audio Description Isomer-Audio ingests single or multiple audio files (in parallel) from a specific directory and populates a MySQL database with an audio model and associated raw audio data. While the raw audio data remains uninterpreted, it is organized into separate streams depending on the type of preprocessing (e.g. source separation) employed. Externals SMS MEAPsoft openBliSSART SIMM JAFE
  • 5. Isomer-A.R.E. A.R.E. is an acronym defined as: Abstracted Representation Engine. The A.R.E. parses ingested raw symbolic and audio data and populates a MySQL database with abstraction layer data in a cartesian coordinate format. This allows input from various sources to combine in a single representation suitable for further analysis and transformation. slice segment streams stream time
  • 6. 2ms melody stream 1 harmony rhythm timbre melody stream 2 harmony rhythm timbre time
  • 7. melody A.R.E. Data (single point)
  • 8. harmony A.R.E. Data (single point)
  • 9. rhythm A.R.E. Data (single point)
  • 10. timbre A.R.E. Data (single point)
  • 11. Isomer-Query Isomer-Query allows users to retrieve Isomer-generated A.R.E. data (above) and mine that data for musically relevant trends. Displays analyzed A.R.E. data as time points (X-axis) and streams/sub-streams (Y-axis) for a given model and allows on-demand calculation of any/all of the following data for any grid coordinates or range of coordinates: melody harmony timbre rhythm Temporal Direction Registral Direction Tension Direction Temporal Instability Registral Return Tension Instability Textural Fingerprint IOI Range Proximity Ratio Average Tension Dynamic Accent NPVI IOI Interval Range NPVI Duration Melodic Accent Agogic Accent
  • 12. Event Trends Event Properties Event Properties Registral Direction Registral Return RMS Pitch Proximity Ratio Spectral Stability Pitch IR Interval Range Spectral Flatness Event Trends IR Equity Melodic Accent MFCC (13) Proximity Equity Textural Fingerprint Registral Return Dynamic Accent melody timbre Event Properties rhythm harmony Event Trends Event Trends N1 Onset Event Properties Tension Direction N2 Onset Temporal Direction Offset Tension Tension Instability Temporal Instability Onset Delta (p) Pitch Collection Average Tension IOI Range Duration Delta (p) NPVI IOI Average Chroma NPVI Duration Chroma (12) Agogic Accent