QMUL C4DM API Presentation @ BCN Music Hack Day

•

1 like•825 views

The document discusses APIs and data from C4DM that can be used for music analysis and creation. It describes Vamp plugins that can extract features like tempo, key, beats from audio. Vamp also has a plugin SDK and Python bindings called VamPy. It lists tools like Sonic Annotator and SAWA that can utilize Vamp plugins. DBTune exposes music metadata from sources as Linked Data via SPARQL endpoints. Potential hack ideas are also outlined that could make use of these APIs and data to analyze and generate music.

Technology

APIs and Data from C4DM
• Vamp Feature extractor plugins:
Tempo, Key, Beats, Bars, Note Onsets, Audio Alignment ...

• Vamp plugin SDK:
for writing your own plugins or host

• VamPy: Python bindings for Vamp API

• SAWA: Web demonstration of Vamp plugins

• Sonic Annotator: command line Vamp host

• DBTune: SPARQL-endpoints of music related data

Vamp plugins
• List of available plugins:
http://vamp-plugins.org/download.html

Ecosystem

• A set of tools to mash-
up Content-based
features and data from
the Semantic Web

• Sonic Annotator: a
command line host to
extract Vamp features
from audio

VamPy 2.0
• Write Vamp feature extractor plugins in Python

Vamp Host Programs

• Sonic Visualiser (cross-platform GUI app)

• Sonic Annotator (command line batch feature extractor)

• Vamp Simple Host (command line tool for testing)

• SAWA (Web application)

• Audacity (Audio editor)

The Music Ontology
• RDF data published using the Music Ontology*

* Source: http://dbtune.org/

DBTune
• A set of SPARQL-endpoints exposing music
related data as Linked-data. Examples include:

• Jamendo, Magnetune (labels)

• BBC John Peel sessions

• Last.fm

• MySpace

• MusicBrainz

Hack Ideas
• Does your music sound like your friends’ music?

• Which friend’s iPod should I borrow to get energised/to
cool down? (tempo)

• I’m in a A minor mood today (key)

• Is the music I make depressing? (tempo, key)

• Identify the songs that are part of the same 4-chord
songs, align them, take the verse of one, the chorus of
another and create a new song that should sound great

All this and more on the Web
www.isophonics.net/content/
hackday

Come see us,
or chat on irc or twitter:
mathieub georgef sefkik utstikkar

A Drupal case study on developing the Australian Broadcasting Corporation's Dig Music website. I gave this talk at Drupal Downunder #ddu2011 in Brisbane, Australia (Jan 23, 2011). I discuss how the Semantic Web was used to create a real time snapshot of a musical artist that is pulled live from the digital radio broadcast. I also talk about performance issues we encountered and ways that they were overcome.

Music in the Metaverse

Richard Elen

Machine learning for creative AI applications in music (2018 nov)

Yi-Hsuan Yang

An up-to-date overview of our recent research on music/audio and AI. It contains four parts: * AI Listener: source separation (ICMLA'18a) and sound event detection (IJCAI'18) * AI DJ: music thumbnailing (TISMIR'18) and music sequencing (AAAI'18a) * AI Composer: melody generation (ISMIR'17), lead sheet generation (ICMLA'18b), multitrack pianoroll generation (AAAI'18b), and instrumentation generation (arxiv) * AI Performer: CNN-based score-to-audio generation (AAAI'19)

After buying a set of Sonos-compatible speakers at IKEA, I was disappointed there's no support for playing audio from a popular video streaming service. They stream Internet radio, podcasts and what not. Well, not that service I want it to play! Determined - and not knowing how deep the rabbit hole would be - I ventured on a trip that included network sniffing on my access point, learning about UPnP and running a web server on my phone (without knowing how to write anything Android), learning how MP4 audio is packaged (and has to be re-packaged). This ultimately resulted in an Android app for personal use, which does what I initially wanted: play audio from that popular video streaming service on Sonos. Join me for this story about an adventure that has no practical use, probably violates Terms of Service, but was fun to build!

Producing a Killer Podcast

Eric Andrade

FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf

FIDO Alliance

UiPath Test Automation using UiPath Test Suite series, part 4

DianaGray10

Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap. The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies. Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques What will you get from this session? 1. Insights into SAP testing best practices 2. Heatmap utilization for testing 3. Optimization of testing processes 4. Demo Topics covered: Execution from the test manager Orchestrator execution result Defect reporting SAP heatmap example with demo Speaker: Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP

GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...

Sri Ambati

FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf

FIDO Alliance

Connector Corner: Automate dynamic content and events by pushing a button

DianaGray10

Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to: Create a campaign using Mailchimp with merge tags/fields Send an interactive Slack channel message (using buttons) Have the message received by managers and peers along with a test email for review But there’s more: In a second workflow supporting the same use case, you’ll see: Your campaign sent to target colleagues for approval If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team But—if the “Reject” button is pushed, colleagues will be alerted via Slack message Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors. And... Speakers: Akshay Agnihotri, Product Manager Charlie Greenberg, Host

Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...

Ramesh Iyer

In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.

Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...

UiPathCommunity

💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™: See how to accelerate model training and optimize model performance with active learning Learn about the latest enhancements to out-of-the-box document processing – with little to no training required Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath. Speakers: 👨‍🏫 Andras Palfi, Senior Product Manager, UiPath 👩‍🏫 Lenka Dulovicova, Product Program Manager, UiPath

State of ICS and IoT Cyber Threat Landscape Report 2024 preview

Prayukth K V

The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development. The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers: State of global ICS asset and network exposure Sectoral targets and attacks as well as the cost of ransom Global APT activity, AI usage, actor and tactic profiles, and implications Rise in volumes of AI-powered cyberattacks Major cyber events in 2024 Malware and malicious payload trends Cyberattack types and targets Vulnerability exploit attempts on CVEs Attacks on counties – USA Expansion of bot farms – how, where, and why In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East Why are attacks on smart factories rising? Cyber risk predictions Axis of attacks – Europe Systemic attacks in the Middle East Download the full report from here: https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/

Recently uploaded (20)

FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf

UiPath Test Automation using UiPath Test Suite series, part 4

Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024

Essentials of Automations: Optimizing FME Workflows with Parameters

Assuring Contact Center Experiences for Your Customers With ThousandEyes

De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...

Elevating Tactical DDD Patterns Through Object Calisthenics

Bits & Pixels using AI for Good.........

Encryption in Microsoft 365 - ExpertsLive Netherlands 2024

JMeter webinar - integration with InfluxDB and Grafana

Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...

From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...

FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf

FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf

GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...

FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf

Connector Corner: Automate dynamic content and events by pushing a button

Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...

Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...

State of ICS and IoT Cyber Threat Landscape Report 2024 preview

QMUL C4DM API Presentation @ BCN Music Hack Day

1. APIs and Data from C4DM • Vamp Feature extractor plugins: Tempo, Key, Beats, Bars, Note Onsets, Audio Alignment ... • Vamp plugin SDK: for writing your own plugins or host • VamPy: Python bindings for Vamp API • SAWA: Web demonstration of Vamp plugins • Sonic Annotator: command line Vamp host • DBTune: SPARQL-endpoints of music related data

2. Vamp plugins • List of available plugins: http://vamp-plugins.org/download.html

3. Ecosystem • A set of tools to mash- up Content-based features and data from the Semantic Web • Sonic Annotator: a command line host to extract Vamp features from audio

4. VamPy 2.0 • Write Vamp feature extractor plugins in Python

5. Vamp Host Programs • Sonic Visualiser (cross-platform GUI app) • Sonic Annotator (command line batch feature extractor) • Vamp Simple Host (command line tool for testing) • SAWA (Web application) • Audacity (Audio editor)

6. SAWA

7. The Music Ontology • RDF data published using the Music Ontology* * Source: http://dbtune.org/

8. DBTune • A set of SPARQL-endpoints exposing music related data as Linked-data. Examples include: • Jamendo, Magnetune (labels) • BBC John Peel sessions • Last.fm • MySpace • MusicBrainz

9. Hack Ideas

10. Hack Ideas • Does your music sound like your friends’ music? • Which friend’s iPod should I borrow to get energised/to cool down? (tempo) • I’m in a A minor mood today (key) • Is the music I make depressing? (tempo, key) • Identify the songs that are part of the same 4-chord songs, align them, take the verse of one, the chorus of another and create a new song that should sound great

11. All this and more on the Web www.isophonics.net/content/ hackday Come see us, or chat on irc or twitter: mathieub georgef sefkik utstikkar

QMUL C4DM API Presentation @ BCN Music Hack Day

Recommended

Recommended

More Related Content

Similar to QMUL C4DM API Presentation @ BCN Music Hack Day

Similar to QMUL C4DM API Presentation @ BCN Music Hack Day (20)

Recently uploaded

Recently uploaded (20)

QMUL C4DM API Presentation @ BCN Music Hack Day