Living Lab and Digital Cultural Heritage


Published on

This presentation of our University of Reunion Island Living Lab for Teaching and Learning was made at the Workshop on Digital Cultural Heritage and LLs, on the 23rd of November 2011 at CitiLab of Barcelona:

Published in: Education, Technology, Business
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • I am Noel Conruyt and I work as a researcher in computer science at the university of Reunionisland in the SW of IndianOcean.I am with Veronique Sebastien who is making a PHD on sign management applied to instrumental e-learning, on the piano.I amalso a biologist and an occasionalguitaristwhen time gives me the opportunity to practice.
  • This workshop is about digital cultural heritage, but the problem is identical when dealing with digital natural heritage, one can preserve the richness of a territory or a culture only by better knowing it!
  • Here are three examples of this cultural heritage in Reunion Island: music, dance and cooking. They share the same gesture management problem for mastering an art: how to apprehend it (apprenticeship by the hand movement in order to get the right sound, taste, gesture).
  • We work at the Laboratory of Mathematics and Informatics in the Technological Park of Saint-Denis on the thematic of Teaching and Learning by Playing.
  • One field of activity is to enhance the environment by better knowing it (volcano, cirques)…
  • But also the living organisms (coral reefs, tropical forest) and the people practicing an art (music) or a science (such as taxonomy)
  • In order to enhance these activities, we designed different tools such as an Iterative Knowledge Base System for helping to describe, classify and identify species names of corals or plants, a virtual ballad in the campus (based on a MMORPG SDK on the left) or in the lagoon (on the right) to access to useful information.These projects form the content of our LL that is at the convergence of bio and cultural diversity and ICT.
  • Here is the vision of our LL that uses the concept of LL for making research with people in the fields.
  • Teaching and Learning by Playing best describes our LL. The sharing of expertise with ICT is our added value in education for some specific domains such as managing biodiversity, performing an art (music, dance, etc.), speaking a language, welcoming tourists, or cooking …These niches can be enhanced with ICT in a sustainable manner by following some innovative methods. For example, sign or know-how management produces sign bases that are made of interpretations for knowing how-to-do things with multimedia content … and not only knowing what are these things in textual Knowledge bases (called Semantic Web).
  • Indeed, we must put the subject rather than the object at the center of the educational process
  • A Sign is the interpretation of an object by a subject at a given time and place, which takes into account its contents (Data, facts, events), its form (Information), and its meaning (Knowledge).We focus now on music, and more precisely on instrumental teaching and learning.
  • By defining Sign management rather than Knowledge management, we want to stress the importance of interpretations that can only be shown by multimedia contents (e.g., see the gesture that produces the right sound) on a vehicle (on/off line). An example will show this:
  • First, a sign is composed of data that are multimedia content of players.There are a lot of interpretations that have been captured on YouTube. One can easily decide which one he or she prefers. And this is the starting point for anybody wanting to play an instrument: we want to reproduce emotions that we experienced when hearing a lovely interpretation.For myself, it was the interpretation of Forbidden Games by N. Yepes that inspired me to play classical guitar.
  • Then, if you want to learn classical guitar, you get the formal notation of the music piece in scores. It is information similar to a cooking recipe.But how to convert it into practical knowledge? You need a Professor.
  • The best way to learn is to access to courses with music teachers that have knowledge.We can notice that Knowledge management with ICT is not the answer because one cannot manage knowledge that is between the ears of individuals. One can only manage know-how and interpretations that are communicated and made explicit between subjects (experts, amateurs).
  • The access to a professor is not easy in music schools, and there are a lot of demand for a few offer.
  • Learning by playing is often based on gesture reproduction by imitating the professor.So, it is important for pedagogy to show how to do the right movement in order to be able to decompose it into instructions and understand the produced result in consequence.
  • Here is the process of learning a piece of music. The fact is that you forget a lot of technical aspects shown by the professor when you come back to your home.
  • A Creativity Platform is a meeting place and communication space for researchers and developers, businesses and users; aimed at collectively defining the characteristics of e-services in order to ensure the most direct correspondence between expectations and use.
  • Our proposed solution is to share live interpretations from different types of subjects and not only transmit objects and knowledge that are found in books or in the head of specialists.
  • The education process must also become bi-directional between teachers and learners to be more attractive and efficient. A famous guitarist, Andrès Segovia, said that in his career students were his best teachers!
  • The musical signs to treat are made of emotional content (performances), technical symbols (scores) and tacit knowledge (rational and cultural know-how). These elements can be manipulated through score annotation, a common practice in music learning.
  • In this context, sign bases are more efficient than knowledge bases because they show examples and not only describe them.Sign bases are made with multimedia technologies (3D, HDTV), which are the best means to show examples from teachers and answer questions of learners for a better education service.Multimedia annotations help to build the sense of objects interpreted by subjects, for example the right motion that produces the beautiful sound …This process is called meaning (sense acquisition) or signification (sign construction) from the human side of learning.On the machine learning side, it is called formalisation (concept acquisition) or classification (class construction).
  • Our LL method makes both human and computer sides converge for co-designing e-services with ICT on a Creativity Platform and so enhance the sharing of interpretations with Semiotic Web.
  • Living Lab and Digital Cultural Heritage

    1. 1. UR.LL.TLUniversity of Reunion Island Living Lab for Teaching and Learning Noël Conruyt & Véronique Sébastien LIM-IREMIA, University of Reunion Island Workshop on Digital Cultural Heritage and LLs, Barcelona, 23rd of November 2011
    2. 2. Where is Reunion Island?Reunion Island is a tropical island in the South West of Indian Ocean
    3. 3. Natural HeritageA Unesco’s world heritage for biodiversity: how to preserve it from human degradations? Digital Cultural Heritage Living Labs 3
    4. 4. Cultural Heritage A regional world heritage but how to preserve it from human globalization?Digital Cultural Heritage Living Labs 4
    5. 5. UR.LL.TL Laboratory Teach Play LearnDigital Cultural Heritage Living Labs 5
    6. 6. UR.LL.TL Laboratory Teach Play Learn PhysicsDigital Cultural Heritage Living Labs 6
    7. 7. UR.LL.TL Laboratory Teach Play Learn Physics LivingDigital Cultural Heritage Living Labs 7
    8. 8. UR.LL.TL Laboratory Virtual Teach Play Learn Physics LivingDigital Cultural Heritage Living Labs 8
    9. 9. Territorial innovation Game-based learning Expertise Diversity Collaborative platform Common goodsKnow-how enhancement Signs Creativity Web Teach Play Serious games Learn Virtual communities Multimedia Living Labs ICT Content management User-driven innovation Co-designing Reunion Island as a Living Lab of the World Digital Cultural Heritage Living Labs 9
    10. 10. Description of our Living Lab • Teaching & Learning by Playing • Education (environment, arts, languages, …) • Sign Bases: know-how management • Multimedia content engineering • Classification and signification processes • E-services on a Co-design platform • Sustainable development with ICT • Semiotic Web : Subject interpretationsDigital Cultural Heritage Living Labs 10
    11. 11. Context of a new education paradigm Semiotic Web The Web of Signs rather that the Web of ThingsDigital Cultural Heritage Living Labs 11
    12. 12. What is a sign? Sign Content Form Meaning “There is the first part where the left and right hand play the same notes, namely two fifths (plays). For the right hand, we will develop all notes but for the moment, it is better to play only the fifths, so that the notes are rapidly incorporated (plays the fifths). “ Data Information Knowledge (made explicit) A sign is subjective: there are as many interpretations as subjects (interpreters)Digital Cultural Heritage Living Labs 12
    13. 13. Sign management Sign Cultural Heritage Living Labs 13
    14. 14. Sign management Sign Content DataDigital Cultural Heritage Living Labs 14
    15. 15. Sign management Sign Content Data Form InformationDigital Cultural Heritage Living Labs 15
    16. 16. Sign management“There is the first part where the left and right hand playthe same notes, namely two fifths (plays). For the righthand, we will develop all notes but for the moment, it isbetter to play only the fifths, so that the notes are rapidlyincorporated (plays the fifths). “ Knowledge Sense Sign Content Data Form Information Digital Cultural Heritage Living Labs 16
    17. 17. Sign management Subject Knowledge Communication Sense Sign Content Data Form Information From Knowledge transmission to sign sharingDigital Cultural Heritage Living Labs 17
    18. 18. Knowledge transmission Traditional teaching method in instrumental musicDigital Cultural Heritage Living Labs 18
    19. 19. Instrumental learning Teacher corrects mistakes, gives advices No TechnicalTeacher suggests Student learns Piece presentation aspects a new piece progressively at home solved? Yes Play the piece Focus on in public InterpretationThe idea is to bring the professor at home to learn music pieces with advices from himDigital Cultural Heritage Living Labs 19
    20. 20. Idea - concept Imagine: your guitar resting perfectly on the thigh, you listen to “Forbidden Games” while watching the hands of the teacher on the television. Close-ups, slow motion, back-ups, replays, everything is possible while you can learn to play along with the teacher. In order toassist you, sheet music lights up each note as it is being played: all of this on full screen, high-definition video and natural stereo sound! In addition, the teacher’s advice is associated with the notes and the measures in play, in the form of visual and verbal commentary. A Knowledge base is a qualitative DVD to transmit know-how from Teachers to Learners Digital Cultural Heritage Living Labs 20
    21. 21. Co-design platform A creativity platform for co-designing e-services with lead-usersDigital Cultural Heritage Living Labs 21
    22. 22. Evolving e-servicesDigital Cultural Heritage Living Labs 22
    23. 23. E-guitareMock-up Prototypes Product -ServiceA Knowledge base is a qualitative DVD to transmit know-how from Teachers to LearnersDigital Cultural Heritage Living Labs 23
    24. 24. Interactive DVD (off/line) Cultural Heritage Living Labs 24
    25. 25. From Teachers to learnersMulti-angle, animated scores, auto & custom loops, slow motion, pedagogical advicesDigital Cultural Heritage Living Labs 25
    26. 26. Need of discussion (on/line) Cultural Heritage Living Labs 26
    27. 27. From Learners to TeachersGlosses system, contextual and time-related score discussions, collaborative approachDigital Cultural Heritage Living Labs 27
    28. 28. A mixed solution (DVDs on/line) Cultural Heritage Living Labs 28
    29. 29. Sign sharingSign bases are used by Teachers and Learners to share know-how on a Co-design platform Digital Cultural Heritage Living Labs 29
    30. 30. @-MUSE Music Teaching Learning Playing @nnotation platform for MUSical EducationDigital Cultural Heritage Living Labs 30
    31. 31. Sign management The aim is to play well a piece of music with the help of collaborative sign basesDigital Cultural Heritage Living Labs 31
    32. 32. @-MUSE for E-piano • Music practice community • Multimedia annotation « texte » • Knowledge inference (automatic annotation)Digital Cultural Heritage Living Labs 32
    33. 33. PrototypeDigital Cultural Heritage Living Labs 33
    34. 34. Conclusion Evaluation of a tool with end-users Focus group, questionnaires Qualitative results => Co-designing e-services for them to become instruments Evaluation of users with a tool Surveys, statistical analysis Quantitative results => Focus on the qualitative learning of users Our Teaching-Playing-Learning Living Lab has to tackle both aspects of assessmentDigital Cultural Heritage Living Labs 34