SG
Uploaded bySten Govaerts
KEY, PDF634 views

Using mashup technology to improve findability

The document discusses using mashup technology to improve findability by combining data from multiple online sources to create new results. It describes a project called Rockanango that uses musical metadata from expert sources and applies it to hospitality contexts by developing musical contexts and schemas. Finally, it evaluates generating metadata for songs using various sources and techniques to classify artists by origin and genre.

Embed presentation

Downloaded 23 times
USING MASHUP TECHNOLOGY TO IMPROVE FINDABILITY Sten Govaerts Promotor: Erik Duval Co-promotor: Katrien Verbert
OVERVIEW • Research outline • Music • Technology Enhanced Learning • Publication list • Further planning
FINDABILITY Findability is the ability of users to identify an appropriate website and navigate the pages of the site to discover and retrieve relevant information resources. Peter Morville (2005)
MASHUPS
MASHUPS • mashups in music: re-mixing multiple existing songs to create a new one.
MASHUPS • mashups in music: re-mixing multiple existing songs to create a new one. •amashup is an application that combines data from multiple online sources to create a new result which was not the original intend of the data.
MASHUPS • mashups in music: re-mixing multiple existing songs to create a new one. •amashup is an application that combines data from multiple online sources to create a new result which was not the original intend of the data. • data is key! • tweaking and enriching data is important • interesting data makes an interesting mashup
THE ROCKANANGO PROJECT
SCOPE.
SCOPE. • roots in HORECA.
SCOPE. • roots in HORECA. • how does a bartender select his music?
SCOPE. • roots in HORECA. • how does a bartender select his music? • how does an expert select his music?
SCOPE. • roots in HORECA. • how does a bartender select his music? • how does an expert select his music? • makingthe expert data accessible in a usable way for a bartender
SCOPE. • roots in HORECA. • how does a bartender select his music? • how does an expert select his music? • making the expert data accessible in a usable way for a bartender A musical context is a musical description for situations based on atmospheres and musical properties.
SCOPE. • roots in HORECA. • how does a bartender select his music? • how does an expert select his music? • making the expert data accessible in a usable way for a bartender A musical context is a musical description for situations based on atmospheres and musical properties.
SCOPE. • roots in HORECA. • how does a bartender select his music? • how does an expert select his music? • making the expert data accessible in a usable way for a bartender A musical context is a musical description for situations based on atmospheres and musical properties.
METADATA SCHEMAS
Corthaut, Nik; Govaerts, Sten; Verbert, Katrien; Duval, Erik. Connecting the dots: music metadata generation, schemas and applications, Bello, Juan Pablo; Chew, Elaine; Turnbull, Douglas (eds.), ISMIR, Philadelphia, USA, 14-18 September 2008, Proceedings of the 9th International Conference on Music Information Retrieval, pages 249-254
context subcontext A subcontext B songs with songs with subgenre(easy listening genre(pop) OR pop café) + + 75 25 songs with songs with mood(intimate OR mood(relax OR tasteful OR stylish) + romantic OR sensual) + + songs with songs with popularity(5 UNTIL 7) popularity(6 UNTIL 7) Govaerts, Sten; Corthaut, Nik; Duval, Erik. Moody tunes: the rockanango project, Lemström, Kjell; Tindale, Adam; Dannenberg, Roger (eds.), International Conference on Music Information Retrieval, ISMIR, Victoria, BC, 8-12 October 2006, pages 308-313, University of Victoria
APPLICATIONS.
APPLICATIONS. • HORECA (+1000 pubs & restaurants) • Retail (Fun, Prémaman, Carrefour,...) • Banks (Dexia & Fortis) • Webradio (HUMO, TMF, Mars, Overtoom, ...)
GENERATE THE METADATA • from different sources: • the audio signal • web sources • the Aristo database • attention metadata • using our metadata generation framework: SamgI
ORIGIN OF AN ARTIST
METADATA GENERATION: COUNTRY & CONTINENT • why is it useful? • subgenres • popularity • recommendations • expensive to annotate • very few existing research • very hard with signal processing
METADATA GENERATION: COUNTRY & CONTINENT • why is it useful? • subgenres • popularity • recommendations • expensive to annotate • very few existing research ! • very hard with signal processing
IN THE BACKGROUND... google maps freebase last.fm google app engine twitter last.fm last.fm yahoo! pipes last on am/fm website dapper youtube
Coverage
http://www.cs.kuleuven.be/~sten/lastonamfm
LAST.FM MASHUP http://www.cs.kuleuven.be/~sten/lastonamfm
FUTURE • follow up research by Markus Schedl • want to test our algorithm on his data set Govaerts, Sten; Duval, Erik. A Web-based approach to determine the origin of an artist, ISMIR, Kobe, Japan, 26-30 October 2009, Proceedings of ISMIR2009: 10th International Society for Music Information Retrieval Conference, pages 261-266, ISMIR-The International Society for Music Information Retrieval
CLASSIFY BY SEARCH ENGINE
ONE APPROACH... • can classify Genre and more! • M. Schedl, T. Pohle, P. Knees, G. Widmer, “Assigning and Visualizing Music Genres by Web-based Co-occurrence Analysis”, Proceedings of the 7th International Conference on Music Information Retrieval, 2006, pp. 260-265. • G. Geleijnse, J. Korst, "Web-based Artist Categorization", Proceedings of the 7th International Conference on Music Information Retrieval, 2006, pp. 266 - 271.
CLASSIFICATION WITH SEARCH ENGINES using co-occurrence
CLASSIFICATION WITH SEARCH ENGINES using co-occurrence Artist + Genre + Schema
CLASSIFICATION WITH SEARCH ENGINES using co-occurrence Artist + Genre + Schema
Rock: Jazz: Blues: Pop: Country: Metal:
Rock: Jazz: 0,013 0,013 Blues: Pop: 0,009 0,015 Country: Metal: 0,009 0,005
RESULTS • 1st results were much worse • what happened? • re-run the original experiment • evaluate on the same data set: 1995 artists and 9 genres. • different search engines: Google,Yahoo! and Live! Search. • over time: 8 times over a period of 36 days.
WHAT TO USE? • use Google when it’s stable else rely on Yahoo! • when is it stable? test with a small set • some artists get classified incorrectly on bad days • compare the accuracy achieved with the test set to the average. Govaerts, Sten; Corthaut, Nik; Duval, Erik. Using search engine for classification: does it still work?, AdMIRe: International Workshop on Advances in Music Information Research 2009, San Diego, USA, 14-16 December 2009, Proceedings of AdMIRe: International Workshop on Advances in Music Information Research 2009, pages 483-488, IEEE
STUDENT ACTIVITY METER
PROBLEM
PROBLEM
PROBLEM
PROBLEM
PROBLEM
OBJECTIVES • self-monitoring for learners • awareness for teachers • time tracking • learning resource recommendation
STUDENT ACTIVITY MONITOR
STUDENT ACTIVITY MONITOR
STUDENT ACTIVITY MONITOR
3 EVALUATIONS • with CS students • withCGIAR courses and teachers • with Learning and Knowledge Analytics course participants
CS STUDENTS CASE STUDY • usability and user satisfaction evaluation • 12 CS students •2 evaluation sessions: • task based interview with think aloud (after 1 week of tracking) • user satisfaction (SUS & MSDT) (after 1 month) Govaerts, Sten; Verbert, Katrien; Klerkx, Joris; Duval, Erik. Visualizing activities for self-reflection and awareness, ICWL10: International Conference on Web based Learning, Shanghai, China, 7-11 December 2010, Lecture Notes in Computer Science, volume 6483, pages 91-100, Springer
USABILITY & USER SATISFACTION • in general, people understand the visualizations well! • some small issues were uncovered... • average SUS score: 73% (stdv: 9,35)
USABILITY & USER SATISFACTION
USABILITY & USER SATISFACTION
USABILITY & USER SATISFACTION
USABILITY & USER SATISFACTION
CGIAR CASE STUDY
CGIAR CASE STUDY
CGIAR CASE STUDY wants to more details search for detect outliers on student students good indicator for effort understand the workload more metrics use for course design optimization obtain course overview compare students increase awareness want better 1 to 1 progress evolution comparison tool
LAK CASE STUDY • open course on learning and knowledge analytics • visual analytics enthousiasts + experts (who can also teach)
LAK CASE STUDY • open course on learning and knowledge analytics • visual analytics enthousiasts + experts (who can also teach)
LAK CASE STUDY verify the status of the more metrics classroom activity chronological course dwell time self-reflection to measure progress and increase motivation find students experiencing problems and low engagement more data
FEDERATED SEARCH AND SOCIAL RECOMMENDATION WIDGET
WHAT’S A WIDGET ?!?
WHAT’S A WIDGET ?!?
WHAT’S A WIDGET ?!?
WHAT’S A WIDGET ?!?
CONTEXT • Personal Learning Environment: • customizable • re-use, creation & mashup of tools, resources • enable users to access content • in different contexts
CONTEXT • Personal Learning Environment: • customizable • re-use, creation & mashup of tools, resources • enable users to access content • in different contexts
CONTEXT • Personal Learning Environment: • customizable • re-use, creation & mashup of tools, resources • enable users to access content • in different contexts
ARCHITECTURE
WIDGET
WIDGET
WIDGET
EXTENDED PAGERANK hare d R1 d /s save saved/shared d en tion Sten R2 fri ec dis n like c on d lik ed R3 d n Sandy ien ctio fr e c on n lik ed R4 Erik R5
EVALUATION • 15 PhD students at K.U. Leuven and EPFL. • What? • usability • user satisfaction • usefulness
FIRST PHASE • current media search tool: Google & YouTube • understanding recommendations: 6/15 from like/dislike
SECOND PHASE
SECOND PHASE • only 14 participants (one less) • open questions • usefulness of recommendations: 11/14 pro. • user satisfaction: System Usability Scale (SUS) & MS Desirability Toolkit • SUS score: 66,25% •2 groups
SECOND PHASE • only 14 participants (one less) • open questions • usefulness of recommendations: 11/14 pro. • user satisfaction: System Usability Scale (SUS) & MS Desirability Toolkit • SUS score: 66,25% •2 K.U. Leuven: high (75%) groups EPFL + one K.U.Leuven: low (50%)
WHY THE DIFFERENT SUS? • 1st phase by 2 interviewers • issues: • distracts of unrelated widget’s UI updates. • layout too dense • height of widgets too small • KULeuven student had prior experience with iGoogle. • not evaluating the widget but the whole experience...
DESIRABILITY...
DESIRABILITY...
DESIRABILITY...
FURTHER EVALUATION • evaluation at a company and university
PUBLICATIONS: MUSIC • Govaerts, Sten; Corthaut, Nik; Duval, Erik. Moody tunes: the rockanango project, Lemström, Kjell; Tindale, Adam; Dannenberg, Roger (eds.), International Conference on Music Information Retrieval, ISMIR, Victoria, BC, 8-12 October 2006, International Conference on Music Information Retrieval, ISMIR, pages 308-313, University of Victoria • Govaerts, Sten; Corthaut, Nik; Duval, Erik. Mood-ex-machina: towards automation of moody tunes, Dixon, Simon; Bainbridge, David; Typke, Rainer (eds.), International Conference on Music Information Retrieval, ISMIR, Vienna, Austria, 23-27 September 2007, Proceedings of the 8th International Conference on Music Information Retrieval, ISMIR 2007, pages 347-350, Österreichische Computer Gesellschaft • Corthaut, Nik; Govaerts, Sten; Verbert, Katrien; Duval, Erik. Connecting the dots: music metadata generation, schemas and applications, Bello, Juan Pablo; Chew, Elaine; Turnbull, Douglas (eds.), ISMIR, Philadelphia, USA, 14-18 September 2008, Proceedings of the 9th International Conference on Music Information Retrieval, pages 249-254 • Corthaut, Nik; Lippens, Stefaan; Govaerts, Sten; Duval, Erik; Martens, Jean-Pierre. The integration of a metadata generation framework in a music annotation workflow, ISMIR, Kobe, Japan, 26-30 October 2009, Proceedings of ISMIR2009: 10th International Society for Music Information Retrieval Conference, ISMIR-The International Society for Music Information Retrieval • Govaerts, Sten; Duval, Erik. A Web-based approach to determine the origin of an artist, ISMIR, Kobe, Japan, 26-30 October 2009, Proceedings of ISMIR2009: 10th International Society for Music Information Retrieval Conference, pages 261-266, ISMIR-The International Society for Music Information Retrieval • Govaerts, Sten; Corthaut, Nik; Duval, Erik. Using search engine for classification: does it still work?, AdMIRe: International Workshop on Advances in Music Information Research 2009, San Diego, USA, 14-16 December 2009, Proceedings of AdMIRe: International Workshop on Advances in Music Information Research 2009, pages 483-488, IEEE
ISMIR I think ISMIR was motivated from two directions: the desire for a focus on music indexing, search, and retrieval, which cuts across many disciplines, and a desire for a focused technical and scientific forum for music research. -Roger Dannenberg It is not just statistics and computer science (as Wikipedia explains for "bioinformatics") but also many other aspects, including social, musicological, perceptual etc. ones. -Michael Fingerhut
PUBLICATIONS: TEL • Parra Chico, Gonzalo; Govaerts, Sten; Duval, Erik. More! a social discovery tool for researchers, DIR 2010: Dutch- Belgian Information Retrieval Workshop, Nijmegen, Nederland, 25 January 2010, DIR 2010: 10th Dutch-Belgian Information Retrieval Workshop • Renzel, D.; Hobelt, C.; Dahrendorf, D.; Friedrich, M.; Modritscher, F.; Verbert, Katrien; Govaerts, Sten; Palmer, M.; Bogdanov, E.. Collaborative development of a PLE for language learning, International Journal of Emerging Technologies in Learning, volume 5, 2010 • Govaerts, Sten; Verbert, Katrien; Klerkx, Joris; Duval, Erik. Visualizing activities for self-reflection and awareness, ICWL10: International Conference on Web based Learning, Shanghai, China, 7-11 December 2010, Lecture Notes in Computer Science, volume 6483, pages 91-100, Springer • Govaerts, Sten; El Helou, Sandy; Duval, Erik; Gillet, Denis. A federated search and social recommendation widget, Proceedings of the 2nd International Workshop on Social Recommender Systems (SRS 2011) in conjunction with the 2011 ACM Conference on Computer Supported Cooperative Work (CSCW 2011), Hangzhou, China, 19-23 March 2011, pages 1-8.
PUBLICATIONS IN THE PIPELINE • Felix Mödritscher, Barbara Krumay, Sten Govaerts, Erik Duval, Sandy El Helou, Denis Gillet, Alexander Nussbaumer, Dietrich Albert, Carsten Ullrich. May I suggest? Three PLE recommender strategies in comparison, PLE Conference 2011, Southampthon, UK. => ACCEPTED, not a core part of my PhD. • Govaerts, Sten; Verbert, Katrien; Duval, Erik. Visualizing student activities for teachers, IEEE Conference on Visual Analytics Science and Technology (IEEE VAST), Providence, USA => UNDER REVIEW, notification 8 June. • Sten Govaerts, Katrien Verbert, Daniel Dahrendorf, Carsten Ullrich, Manuel Schmidt, Michael Werkle, Arunangsu Chatterjee, Alexander Nussbaumer, Dominik Renzel, Maren Scheffel, Martin Friedrich, Jose Luis Santos, Effie L-C Law, Erik Duval. Towards reponsive open learning environments: the ROLE interoperability framework. The 6th European Conference on Technology Enhanced Learning Towards Ubiquitous Learning, Lecture Notes of Computer Science. => UNDER REVIEW, notification 31 May.
FUTURE PLANNING • Ph.D. on papers • if 2 papers under review are accepted => FINISH. • potential for writing (a) journal article(s): •0 articles: submit end September •1 article: submit end November •2 articles: submit Xmas.
THANK YOU! QUESTIONS? slides will appear on http://www.slideshare.net/stengovaerts

More Related Content

PDF
20211026 taicca 1 intro to mir
byYi-Hsuan Yang
 
PDF
MOODetector: Automatic Music Emotion Recognition
byRui Pedro Paiva
 
PDF
From Music Information Retrieval to Music Emotion Recognition
byRui Pedro Paiva
 
PDF
machine learning x music
byYi-Hsuan Yang
 
PDF
Machine learning for creative AI applications in music (2018 nov)
byYi-Hsuan Yang
 
PDF
FindStream investor deck
byFindStream
 
PDF
Using search engines for classification: does it still work?
bySten Govaerts
 
PDF
20190625 Research at Taiwan AI Labs: Music and Speech AI
byYi-Hsuan Yang
 
20211026 taicca 1 intro to mir
byYi-Hsuan Yang
 
MOODetector: Automatic Music Emotion Recognition
byRui Pedro Paiva
 
From Music Information Retrieval to Music Emotion Recognition
byRui Pedro Paiva
 
machine learning x music
byYi-Hsuan Yang
 
Machine learning for creative AI applications in music (2018 nov)
byYi-Hsuan Yang
 
FindStream investor deck
byFindStream
 
Using search engines for classification: does it still work?
bySten Govaerts
 
20190625 Research at Taiwan AI Labs: Music and Speech AI
byYi-Hsuan Yang
 

What's hot

PDF
Understanding Music Playlists
byKeunwoo Choi
 
PDF
Random Forests R vs Python by Linda Uruchurtu
byPyData
 
PDF
Research at MAC Lab, Academia Sincia, in 2017
byYi-Hsuan Yang
 
PDF
楊奕軒/音樂資料檢索
by台灣資料科學年會
 
PDF
"All you need is AI and music" by Keunwoo Choi
byKeunwoo Choi
 
ODP
Social Tags and Music Information Retrieval (Part I)
byPaul Lamere
 
PDF
ISMIR 2019 tutorial: Generating music with generative adverairal networks (GANs)
byYi-Hsuan Yang
 
PDF
Metadata for musicians: discovery, attribution and payment
byKristin Thomson
 
PDF
20211026 taicca 2 music generation
byYi-Hsuan Yang
 
PDF
Research on Automatic Music Composition at the Taiwan AI Labs, April 2020
byYi-Hsuan Yang
 
PDF
Learning to Generate Jazz & Pop Piano Music from Audio via MIR Techniques
byYi-Hsuan Yang
 
PPTX
Music Objects to Social Machines
byDavid De Roure
 
PDF
Music Information Retrieval: Overview and Current Trends 2008
byRui Pedro Paiva
 
PPTX
CU Boulder Music Education Presentation
byRichard Clarke
 
PDF
Music Information Retrieval: A Literature Review
byJane Frazier
 
PDF
Project overview eng
byWonyoung Lucas SEO
 
PDF
RichardsLaman_2.3.15
byLaman Richards
 
PPT
I've Got a Key to Your API, Now What? (Joint PBS and NPR API Presentation Giv...
byPublic Broadcasting Service
 
Understanding Music Playlists
byKeunwoo Choi
 
Random Forests R vs Python by Linda Uruchurtu
byPyData
 
Research at MAC Lab, Academia Sincia, in 2017
byYi-Hsuan Yang
 
楊奕軒/音樂資料檢索
by台灣資料科學年會
 
"All you need is AI and music" by Keunwoo Choi
byKeunwoo Choi
 
Social Tags and Music Information Retrieval (Part I)
byPaul Lamere
 
ISMIR 2019 tutorial: Generating music with generative adverairal networks (GANs)
byYi-Hsuan Yang
 
Metadata for musicians: discovery, attribution and payment
byKristin Thomson
 
20211026 taicca 2 music generation
byYi-Hsuan Yang
 
Research on Automatic Music Composition at the Taiwan AI Labs, April 2020
byYi-Hsuan Yang
 
Learning to Generate Jazz & Pop Piano Music from Audio via MIR Techniques
byYi-Hsuan Yang
 
Music Objects to Social Machines
byDavid De Roure
 
Music Information Retrieval: Overview and Current Trends 2008
byRui Pedro Paiva
 
CU Boulder Music Education Presentation
byRichard Clarke
 
Music Information Retrieval: A Literature Review
byJane Frazier
 
Project overview eng
byWonyoung Lucas SEO
 
RichardsLaman_2.3.15
byLaman Richards
 
I've Got a Key to Your API, Now What? (Joint PBS and NPR API Presentation Giv...
byPublic Broadcasting Service
 

Viewers also liked

PPS
Sistema Macro Micro
byMente Cuantica
 
PPTX
6 cable directo, cruzado y rollover
byJorge Isai Alvarez
 
PDF
UF1 NF3. FORNS
byPilar Gonzalez
 
PDF
Tasca 1.3.canvi d'unitats i factors de conversió
byRafael Alvarez Alonso
 
DOCX
Examen ud1 la materia
byJuanjo Monferrer Altava
 
PDF
Evaluating the Student Activity Meter: Two Case Studies.
bySten Govaerts
 
PPT
Pantalles2012
byJordi Bernabeu Farrús
 
PPTX
cable directo cruzado y rollover
byIsabel Guadalupe Gonzalez Cruz
 
DOC
De los orígenes de roma a las invasiones bárbaras.
byleandro bascuñan
 
Sistema Macro Micro
byMente Cuantica
 
6 cable directo, cruzado y rollover
byJorge Isai Alvarez
 
UF1 NF3. FORNS
byPilar Gonzalez
 
Tasca 1.3.canvi d'unitats i factors de conversió
byRafael Alvarez Alonso
 
Examen ud1 la materia
byJuanjo Monferrer Altava
 
Evaluating the Student Activity Meter: Two Case Studies.
bySten Govaerts
 
Pantalles2012
byJordi Bernabeu Farrús
 
cable directo cruzado y rollover
byIsabel Guadalupe Gonzalez Cruz
 
De los orígenes de roma a las invasiones bárbaras.
byleandro bascuñan
 

Similar to Using mashup technology to improve findability

PDF
Music Recommendation 2018
byFabien Gouyon
 
KEY
Finding a Path Through the Juke Box: The Playlist Tutorial
byBen Fields
 
PPTX
Music recognition
byaaronloklok
 
PDF
Virginie Berger: New Digital Music Tools for New Needs - midem white paper
bymidem
 
PPT
Musicovery in B2B
byVincent Castaignet
 
PPTX
Genre Classification and Analysis
byAnat Gilboa
 
PDF
Mobile App Project Proposal: L. Sayles
byAmber
 
PDF
Drupal case study: ABC Dig Music
byDavid Peterson
 
PDF
Music discovery on the net
byguestbf080
 
PDF
Social music slides4
byMME 4.5 / Music 4.5 / 2Pears
 
PDF
Trends in Music Recommendations 2018
byKarthik Murugesan
 
PDF
[JAM 2.0] Music API (Paul Malikov)
byjam_team
 
PDF
Music Recommendation and Discovery in...which Web?
byOscar Celma
 
PDF
J-P. Fauconnier, J. Roumier. Musonto - A Semantic Search Engine Dedicated to ...
byMusicNet
 
PDF
Hypergraph Models of Playlist Dialects
byBrian McFee
 
PDF
SSSW2007 Social Web Baumann
byStephan Baumann
 
PDF
CSTalks - Music Information Retrieval - 23 Feb
bycstalks
 
PDF
Entity Spotting in Informal Text
byMeena Nagarajan
 
PDF
BBCSoundIndex
byMeena Nagarajan
 
PDF
Music SEO - 7 Lessons in Brand Optimization for 2015
byluckydemography03
 
Music Recommendation 2018
byFabien Gouyon
 
Finding a Path Through the Juke Box: The Playlist Tutorial
byBen Fields
 
Music recognition
byaaronloklok
 
Virginie Berger: New Digital Music Tools for New Needs - midem white paper
bymidem
 
Musicovery in B2B
byVincent Castaignet
 
Genre Classification and Analysis
byAnat Gilboa
 
Mobile App Project Proposal: L. Sayles
byAmber
 
Drupal case study: ABC Dig Music
byDavid Peterson
 
Music discovery on the net
byguestbf080
 
Social music slides4
byMME 4.5 / Music 4.5 / 2Pears
 
Trends in Music Recommendations 2018
byKarthik Murugesan
 
[JAM 2.0] Music API (Paul Malikov)
byjam_team
 
Music Recommendation and Discovery in...which Web?
byOscar Celma
 
J-P. Fauconnier, J. Roumier. Musonto - A Semantic Search Engine Dedicated to ...
byMusicNet
 
Hypergraph Models of Playlist Dialects
byBrian McFee
 
SSSW2007 Social Web Baumann
byStephan Baumann
 
CSTalks - Music Information Retrieval - 23 Feb
bycstalks
 
Entity Spotting in Informal Text
byMeena Nagarajan
 
BBCSoundIndex
byMeena Nagarajan
 
Music SEO - 7 Lessons in Brand Optimization for 2015
byluckydemography03
 

More from Sten Govaerts

PDF
Learning Analytics Dashboards
bySten Govaerts
 
PDF
The Go-Lab project at the REACT Research Days
bySten Govaerts
 
PDF
Learning Dashboards & Learnscapes
bySten Govaerts
 
PDF
The Student Activity Meter
bySten Govaerts
 
PDF
Learning Analytics at KULeuven by the team of Erik Duval
bySten Govaerts
 
PDF
The Go-Lab portal
bySten Govaerts
 
KEY
An introduction to Git.
bySten Govaerts
 
KEY
Winter School defense simulation: Visualizing Activities for Self-reflection ...
bySten Govaerts
 
PDF
Speakup - in NordiCHI2014 Personal or Social workshop.
bySten Govaerts
 
PDF
Towards an online lab portal for inquiry-based STEM learning at school.
bySten Govaerts
 
KEY
Towards Responsive Open Learning Environments: the ROLE Interoperability Fram...
bySten Govaerts
 
PDF
Learning Dashboards and Learnscapes
bySten Govaerts
 
PDF
The Student Activity Meter for Awareness and Self-reflection
bySten Govaerts
 
PDF
SpeakUp – A Mobile App Facilitating Audience Interaction
bySten Govaerts
 
PDF
A Federated Search and Social Recommendation Widget
bySten Govaerts
 
PDF
From Findability to Awareness: Metadata in Music and Technology Enhanced Lear...
bySten Govaerts
 
PDF
The Student Activity Meter for Awareness and Self-reflection
bySten Govaerts
 
PDF
Learning Analytics & Learnscapes.
bySten Govaerts
 
PDF
Quantified Self in the Multimedia course.
bySten Govaerts
 
PDF
The Smart Device Specification for Remote Labs
bySten Govaerts
 
Learning Analytics Dashboards
bySten Govaerts
 
The Go-Lab project at the REACT Research Days
bySten Govaerts
 
Learning Dashboards & Learnscapes
bySten Govaerts
 
The Student Activity Meter
bySten Govaerts
 
Learning Analytics at KULeuven by the team of Erik Duval
bySten Govaerts
 
The Go-Lab portal
bySten Govaerts
 
An introduction to Git.
bySten Govaerts
 
Winter School defense simulation: Visualizing Activities for Self-reflection ...
bySten Govaerts
 
Speakup - in NordiCHI2014 Personal or Social workshop.
bySten Govaerts
 
Towards an online lab portal for inquiry-based STEM learning at school.
bySten Govaerts
 
Towards Responsive Open Learning Environments: the ROLE Interoperability Fram...
bySten Govaerts
 
Learning Dashboards and Learnscapes
bySten Govaerts
 
The Student Activity Meter for Awareness and Self-reflection
bySten Govaerts
 
SpeakUp – A Mobile App Facilitating Audience Interaction
bySten Govaerts
 
A Federated Search and Social Recommendation Widget
bySten Govaerts
 
From Findability to Awareness: Metadata in Music and Technology Enhanced Lear...
bySten Govaerts
 
The Student Activity Meter for Awareness and Self-reflection
bySten Govaerts
 
Learning Analytics & Learnscapes.
bySten Govaerts
 
Quantified Self in the Multimedia course.
bySten Govaerts
 
The Smart Device Specification for Remote Labs
bySten Govaerts
 

Recently uploaded

PDF
How to Evaluate a High Performance Database
byScyllaDB
 
PDF
Workshop on Sustaining & Growing Open Source Communities - GAS2025
bySammy Fung
 
PPTX
Emancipatory Information Retrieval: Radically Reorienting Information Retriev...
byBhaskar Mitra
 
PDF
WHITE PAPER_ Ransomware Payment Policy and Resilience Strategy_ A Framework f...
byssuser0d171c
 
PDF
What Is a Private LLM and Why Enterprises Need It
byAivada
 
PDF
Lab 1.5 - Sharing Secrets with GPG ~ 2nd Sight Lab Cloud Security Class
by2nd Sight Lab
 
PPTX
Technology Consulting _ by Slidesgo.pptx
byfh82277
 
PDF
Day 4 - Access, Deployments, and Monitoring - 2nd Sight Lab Cloud Security Class
by2nd Sight Lab
 
PDF
Day 5 - Red Team + Blue Team in the Cloud - 2nd Sight Lab Cloud Security Class
by2nd Sight Lab
 
PPTX
From Backup to Resilience: How MSPs Are Preparing for 2026
byMSP360
 
PPTX
DYNAMICALLY.pptx good for the teachers or students to do seminars and for tea...
bympoorvika031
 
PDF
Real-Time Data Insight Using Microsoft Forms for Business
byElevate
 
PDF
Our Digital Tribe_ Cultivating Connection and Growth in Our Slack Community 🌿...
bysanjeetmishra30
 
PDF
Data Virtualization in Action: Scaling APIs and Apps with FME
bySafe Software
 
PDF
API-First Architecture in Financial Systems
bycyy111112
 
PDF
Internet_of_Things_IoT_for_Next_Generation_Smart_Systems_Utilizing.pdf
byRoshanSyed12
 
PPTX
Software Analysis &Design ethiopia chap-2.pptx
byAbbas484771
 
PDF
Dev Dives: AI that builds with you - UiPath Autopilot for effortless RPA & AP...
byUiPathCommunity
 
PDF
TrustArc Webinar - Looking Ahead: The 2026 Privacy Landscape
byTrustArc
 
PDF
Unlocking the Power of Salesforce Architecture: Frameworks for Effective Solu...
byvarsha30tiwari
 
How to Evaluate a High Performance Database
byScyllaDB
 
Workshop on Sustaining & Growing Open Source Communities - GAS2025
bySammy Fung
 
Emancipatory Information Retrieval: Radically Reorienting Information Retriev...
byBhaskar Mitra
 
WHITE PAPER_ Ransomware Payment Policy and Resilience Strategy_ A Framework f...
byssuser0d171c
 
What Is a Private LLM and Why Enterprises Need It
byAivada
 
Lab 1.5 - Sharing Secrets with GPG ~ 2nd Sight Lab Cloud Security Class
by2nd Sight Lab
 
Technology Consulting _ by Slidesgo.pptx
byfh82277
 
Day 4 - Access, Deployments, and Monitoring - 2nd Sight Lab Cloud Security Class
by2nd Sight Lab
 
Day 5 - Red Team + Blue Team in the Cloud - 2nd Sight Lab Cloud Security Class
by2nd Sight Lab
 
From Backup to Resilience: How MSPs Are Preparing for 2026
byMSP360
 
DYNAMICALLY.pptx good for the teachers or students to do seminars and for tea...
bympoorvika031
 
Real-Time Data Insight Using Microsoft Forms for Business
byElevate
 
Our Digital Tribe_ Cultivating Connection and Growth in Our Slack Community 🌿...
bysanjeetmishra30
 
Data Virtualization in Action: Scaling APIs and Apps with FME
bySafe Software
 
API-First Architecture in Financial Systems
bycyy111112
 
Internet_of_Things_IoT_for_Next_Generation_Smart_Systems_Utilizing.pdf
byRoshanSyed12
 
Software Analysis &Design ethiopia chap-2.pptx
byAbbas484771
 
Dev Dives: AI that builds with you - UiPath Autopilot for effortless RPA & AP...
byUiPathCommunity
 
TrustArc Webinar - Looking Ahead: The 2026 Privacy Landscape
byTrustArc
 
Unlocking the Power of Salesforce Architecture: Frameworks for Effective Solu...
byvarsha30tiwari
 

Using mashup technology to improve findability

  • 1.
    USING MASHUP TECHNOLOGY TOIMPROVE FINDABILITY Sten Govaerts Promotor: Erik Duval Co-promotor: Katrien Verbert
  • 2.
    OVERVIEW • Research outline • Music • Technology Enhanced Learning • Publication list • Further planning
  • 3.
    FINDABILITY Findability is theability of users to identify an appropriate website and navigate the pages of the site to discover and retrieve relevant information resources. Peter Morville (2005)
  • 4.
  • 5.
    MASHUPS • mashups in music: re-mixing multiple existing songs to create a new one.
  • 6.
    MASHUPS • mashups in music: re-mixing multiple existing songs to create a new one. •amashup is an application that combines data from multiple online sources to create a new result which was not the original intend of the data.
  • 7.
    MASHUPS • mashups in music: re-mixing multiple existing songs to create a new one. •amashup is an application that combines data from multiple online sources to create a new result which was not the original intend of the data. • data is key! • tweaking and enriching data is important • interesting data makes an interesting mashup
  • 8.
  • 9.
  • 10.
  • 11.
    SCOPE. • roots in HORECA. • how does a bartender select his music?
  • 12.
    SCOPE. • roots in HORECA. • how does a bartender select his music? • how does an expert select his music?
  • 13.
    SCOPE. • roots in HORECA. • how does a bartender select his music? • how does an expert select his music? • makingthe expert data accessible in a usable way for a bartender
  • 14.
    SCOPE. • roots in HORECA. • how does a bartender select his music? • how does an expert select his music? • making the expert data accessible in a usable way for a bartender A musical context is a musical description for situations based on atmospheres and musical properties.
  • 15.
    SCOPE. • roots in HORECA. • how does a bartender select his music? • how does an expert select his music? • making the expert data accessible in a usable way for a bartender A musical context is a musical description for situations based on atmospheres and musical properties.
  • 16.
    SCOPE. • roots in HORECA. • how does a bartender select his music? • how does an expert select his music? • making the expert data accessible in a usable way for a bartender A musical context is a musical description for situations based on atmospheres and musical properties.
  • 17.
  • 18.
    Corthaut, Nik; Govaerts,Sten; Verbert, Katrien; Duval, Erik. Connecting the dots: music metadata generation, schemas and applications, Bello, Juan Pablo; Chew, Elaine; Turnbull, Douglas (eds.), ISMIR, Philadelphia, USA, 14-18 September 2008, Proceedings of the 9th International Conference on Music Information Retrieval, pages 249-254
  • 19.
    context subcontext A subcontext B songs with songs with subgenre(easy listening genre(pop) OR pop café) + + 75 25 songs with songs with mood(intimate OR mood(relax OR tasteful OR stylish) + romantic OR sensual) + + songs with songs with popularity(5 UNTIL 7) popularity(6 UNTIL 7) Govaerts, Sten; Corthaut, Nik; Duval, Erik. Moody tunes: the rockanango project, Lemström, Kjell; Tindale, Adam; Dannenberg, Roger (eds.), International Conference on Music Information Retrieval, ISMIR, Victoria, BC, 8-12 October 2006, pages 308-313, University of Victoria
  • 20.
  • 21.
    APPLICATIONS. • HORECA (+1000 pubs & restaurants) • Retail (Fun, Prémaman, Carrefour,...) • Banks (Dexia & Fortis) • Webradio (HUMO, TMF, Mars, Overtoom, ...)
  • 22.
    GENERATE THE METADATA •from different sources: • the audio signal • web sources • the Aristo database • attention metadata • using our metadata generation framework: SamgI
  • 23.
  • 24.
    METADATA GENERATION: COUNTRY & CONTINENT • why is it useful? • subgenres • popularity • recommendations • expensive to annotate • very few existing research • very hard with signal processing
  • 25.
    METADATA GENERATION: COUNTRY & CONTINENT • why is it useful? • subgenres • popularity • recommendations • expensive to annotate • very few existing research ! • very hard with signal processing
  • 26.
    IN THE BACKGROUND... google maps freebase last.fm google app engine twitter last.fm last.fm yahoo! pipes last on am/fm website dapper youtube
  • 27.
  • 29.
  • 30.
  • 31.
    FUTURE • follow upresearch by Markus Schedl • want to test our algorithm on his data set Govaerts, Sten; Duval, Erik. A Web-based approach to determine the origin of an artist, ISMIR, Kobe, Japan, 26-30 October 2009, Proceedings of ISMIR2009: 10th International Society for Music Information Retrieval Conference, pages 261-266, ISMIR-The International Society for Music Information Retrieval
  • 32.
  • 33.
    ONE APPROACH... • can classify Genre and more! • M. Schedl, T. Pohle, P. Knees, G. Widmer, “Assigning and Visualizing Music Genres by Web-based Co-occurrence Analysis”, Proceedings of the 7th International Conference on Music Information Retrieval, 2006, pp. 260-265. • G. Geleijnse, J. Korst, "Web-based Artist Categorization", Proceedings of the 7th International Conference on Music Information Retrieval, 2006, pp. 266 - 271.
  • 34.
    CLASSIFICATION WITH SEARCH ENGINES using co-occurrence
  • 35.
    CLASSIFICATION WITH SEARCH ENGINES using co-occurrence Artist + Genre + Schema
  • 36.
    CLASSIFICATION WITH SEARCH ENGINES using co-occurrence Artist + Genre + Schema
  • 38.
    Rock: Jazz: Blues: Pop: Country: Metal:
  • 39.
    Rock: Jazz: 0,013 0,013 Blues: Pop: 0,009 0,015 Country: Metal: 0,009 0,005
  • 40.
    RESULTS • 1st results were much worse • what happened? • re-run the original experiment • evaluate on the same data set: 1995 artists and 9 genres. • different search engines: Google,Yahoo! and Live! Search. • over time: 8 times over a period of 36 days.
  • 45.
    WHAT TO USE? •use Google when it’s stable else rely on Yahoo! • when is it stable? test with a small set • some artists get classified incorrectly on bad days • compare the accuracy achieved with the test set to the average. Govaerts, Sten; Corthaut, Nik; Duval, Erik. Using search engine for classification: does it still work?, AdMIRe: International Workshop on Advances in Music Information Research 2009, San Diego, USA, 14-16 December 2009, Proceedings of AdMIRe: International Workshop on Advances in Music Information Research 2009, pages 483-488, IEEE
  • 46.
  • 47.
  • 48.
  • 49.
  • 50.
  • 51.
  • 52.
    OBJECTIVES • self-monitoring for learners • awareness for teachers • time tracking • learning resource recommendation
  • 53.
  • 54.
  • 55.
  • 56.
    3 EVALUATIONS • with CS students • withCGIAR courses and teachers • with Learning and Knowledge Analytics course participants
  • 57.
    CS STUDENTS CASESTUDY • usability and user satisfaction evaluation • 12 CS students •2 evaluation sessions: • task based interview with think aloud (after 1 week of tracking) • user satisfaction (SUS & MSDT) (after 1 month) Govaerts, Sten; Verbert, Katrien; Klerkx, Joris; Duval, Erik. Visualizing activities for self-reflection and awareness, ICWL10: International Conference on Web based Learning, Shanghai, China, 7-11 December 2010, Lecture Notes in Computer Science, volume 6483, pages 91-100, Springer
  • 58.
    USABILITY & USER SATISFACTION • in general, people understand the visualizations well! • some small issues were uncovered... • average SUS score: 73% (stdv: 9,35)
  • 59.
    USABILITY & USER SATISFACTION
  • 60.
    USABILITY & USER SATISFACTION
  • 61.
    USABILITY & USER SATISFACTION
  • 62.
    USABILITY & USER SATISFACTION
  • 63.
  • 64.
  • 65.
    CGIAR CASE STUDY wants to more details search for detect outliers on student students good indicator for effort understand the workload more metrics use for course design optimization obtain course overview compare students increase awareness want better 1 to 1 progress evolution comparison tool
  • 66.
    LAK CASE STUDY •open course on learning and knowledge analytics • visual analytics enthousiasts + experts (who can also teach)
  • 67.
    LAK CASE STUDY •open course on learning and knowledge analytics • visual analytics enthousiasts + experts (who can also teach)
  • 68.
    LAK CASE STUDY verify the status of the more metrics classroom activity chronological course dwell time self-reflection to measure progress and increase motivation find students experiencing problems and low engagement more data
  • 69.
    FEDERATED SEARCH AND SOCIALRECOMMENDATION WIDGET
  • 70.
  • 71.
  • 72.
  • 73.
  • 74.
    CONTEXT • Personal Learning Environment: • customizable • re-use, creation & mashup of tools, resources • enable users to access content • in different contexts
  • 75.
    CONTEXT • Personal Learning Environment: • customizable • re-use, creation & mashup of tools, resources • enable users to access content • in different contexts
  • 76.
    CONTEXT • Personal Learning Environment: • customizable • re-use, creation & mashup of tools, resources • enable users to access content • in different contexts
  • 77.
  • 78.
  • 79.
  • 80.
  • 81.
    EXTENDED PAGERANK hare d R1 d /s save saved/shared d en tion Sten R2 fri ec dis n like c on d lik ed R3 d n Sandy ien ctio fr e c on n lik ed R4 Erik R5
  • 82.
    EVALUATION • 15 PhD students at K.U. Leuven and EPFL. • What? • usability • user satisfaction • usefulness
  • 83.
    FIRST PHASE • current media search tool: Google & YouTube • understanding recommendations: 6/15 from like/dislike
  • 84.
  • 85.
    SECOND PHASE • only 14 participants (one less) • open questions • usefulness of recommendations: 11/14 pro. • user satisfaction: System Usability Scale (SUS) & MS Desirability Toolkit • SUS score: 66,25% •2 groups
  • 86.
    SECOND PHASE • only 14 participants (one less) • open questions • usefulness of recommendations: 11/14 pro. • user satisfaction: System Usability Scale (SUS) & MS Desirability Toolkit • SUS score: 66,25% •2 K.U. Leuven: high (75%) groups EPFL + one K.U.Leuven: low (50%)
  • 87.
    WHY THE DIFFERENTSUS? • 1st phase by 2 interviewers • issues: • distracts of unrelated widget’s UI updates. • layout too dense • height of widgets too small • KULeuven student had prior experience with iGoogle. • not evaluating the widget but the whole experience...
  • 88.
  • 89.
  • 90.
  • 91.
    FURTHER EVALUATION • evaluation at a company and university
  • 92.
    PUBLICATIONS: MUSIC • Govaerts, Sten; Corthaut, Nik; Duval, Erik. Moody tunes: the rockanango project, Lemström, Kjell; Tindale, Adam; Dannenberg, Roger (eds.), International Conference on Music Information Retrieval, ISMIR, Victoria, BC, 8-12 October 2006, International Conference on Music Information Retrieval, ISMIR, pages 308-313, University of Victoria • Govaerts, Sten; Corthaut, Nik; Duval, Erik. Mood-ex-machina: towards automation of moody tunes, Dixon, Simon; Bainbridge, David; Typke, Rainer (eds.), International Conference on Music Information Retrieval, ISMIR, Vienna, Austria, 23-27 September 2007, Proceedings of the 8th International Conference on Music Information Retrieval, ISMIR 2007, pages 347-350, Österreichische Computer Gesellschaft • Corthaut, Nik; Govaerts, Sten; Verbert, Katrien; Duval, Erik. Connecting the dots: music metadata generation, schemas and applications, Bello, Juan Pablo; Chew, Elaine; Turnbull, Douglas (eds.), ISMIR, Philadelphia, USA, 14-18 September 2008, Proceedings of the 9th International Conference on Music Information Retrieval, pages 249-254 • Corthaut, Nik; Lippens, Stefaan; Govaerts, Sten; Duval, Erik; Martens, Jean-Pierre. The integration of a metadata generation framework in a music annotation workflow, ISMIR, Kobe, Japan, 26-30 October 2009, Proceedings of ISMIR2009: 10th International Society for Music Information Retrieval Conference, ISMIR-The International Society for Music Information Retrieval • Govaerts, Sten; Duval, Erik. A Web-based approach to determine the origin of an artist, ISMIR, Kobe, Japan, 26-30 October 2009, Proceedings of ISMIR2009: 10th International Society for Music Information Retrieval Conference, pages 261-266, ISMIR-The International Society for Music Information Retrieval • Govaerts, Sten; Corthaut, Nik; Duval, Erik. Using search engine for classification: does it still work?, AdMIRe: International Workshop on Advances in Music Information Research 2009, San Diego, USA, 14-16 December 2009, Proceedings of AdMIRe: International Workshop on Advances in Music Information Research 2009, pages 483-488, IEEE
  • 93.
    ISMIR I think ISMIRwas motivated from two directions: the desire for a focus on music indexing, search, and retrieval, which cuts across many disciplines, and a desire for a focused technical and scientific forum for music research. -Roger Dannenberg It is not just statistics and computer science (as Wikipedia explains for "bioinformatics") but also many other aspects, including social, musicological, perceptual etc. ones. -Michael Fingerhut
  • 94.
    PUBLICATIONS: TEL • Parra Chico, Gonzalo; Govaerts, Sten; Duval, Erik. More! a social discovery tool for researchers, DIR 2010: Dutch- Belgian Information Retrieval Workshop, Nijmegen, Nederland, 25 January 2010, DIR 2010: 10th Dutch-Belgian Information Retrieval Workshop • Renzel, D.; Hobelt, C.; Dahrendorf, D.; Friedrich, M.; Modritscher, F.; Verbert, Katrien; Govaerts, Sten; Palmer, M.; Bogdanov, E.. Collaborative development of a PLE for language learning, International Journal of Emerging Technologies in Learning, volume 5, 2010 • Govaerts, Sten; Verbert, Katrien; Klerkx, Joris; Duval, Erik. Visualizing activities for self-reflection and awareness, ICWL10: International Conference on Web based Learning, Shanghai, China, 7-11 December 2010, Lecture Notes in Computer Science, volume 6483, pages 91-100, Springer • Govaerts, Sten; El Helou, Sandy; Duval, Erik; Gillet, Denis. A federated search and social recommendation widget, Proceedings of the 2nd International Workshop on Social Recommender Systems (SRS 2011) in conjunction with the 2011 ACM Conference on Computer Supported Cooperative Work (CSCW 2011), Hangzhou, China, 19-23 March 2011, pages 1-8.
  • 95.
    PUBLICATIONS IN THE PIPELINE • Felix Mödritscher, Barbara Krumay, Sten Govaerts, Erik Duval, Sandy El Helou, Denis Gillet, Alexander Nussbaumer, Dietrich Albert, Carsten Ullrich. May I suggest? Three PLE recommender strategies in comparison, PLE Conference 2011, Southampthon, UK. => ACCEPTED, not a core part of my PhD. • Govaerts, Sten; Verbert, Katrien; Duval, Erik. Visualizing student activities for teachers, IEEE Conference on Visual Analytics Science and Technology (IEEE VAST), Providence, USA => UNDER REVIEW, notification 8 June. • Sten Govaerts, Katrien Verbert, Daniel Dahrendorf, Carsten Ullrich, Manuel Schmidt, Michael Werkle, Arunangsu Chatterjee, Alexander Nussbaumer, Dominik Renzel, Maren Scheffel, Martin Friedrich, Jose Luis Santos, Effie L-C Law, Erik Duval. Towards reponsive open learning environments: the ROLE interoperability framework. The 6th European Conference on Technology Enhanced Learning Towards Ubiquitous Learning, Lecture Notes of Computer Science. => UNDER REVIEW, notification 31 May.
  • 96.
    FUTURE PLANNING • Ph.D.on papers • if 2 papers under review are accepted => FINISH. • potential for writing (a) journal article(s): •0 articles: submit end September •1 article: submit end November •2 articles: submit Xmas.
  • 97.
    THANK YOU! QUESTIONS? slides will appear on http://www.slideshare.net/stengovaerts

Editor's Notes