Using mobile devices and augmented reality to support teaching in the recording studio environment.
A presentation detailing the AR project at Leeds College of Music, in collaboration with Jisc Mimas, delivered at the Augmented Planet conference in London on 17th November
Augmented Planet: LCoM and Jisc Mimas Presentation
1. Using mobile devices and augmented
reality to support teaching in the
recording studio environment
Ruth Clark and Craig Golding
Leeds College of Music
Matthew Ramirez
Jisc Mimas
2. Teaching Music Production at
Leeds College of Music
• Specialist Study
Core Module
(30 Credits)
• Taught in small
studio groups
(5-6 students)
• 2 hour highly
practical,
hands-on
learning
experience.
3. Challenges of Studio Learning
Environment
• Large quantities of information to absorb and
retain from week to week
• Limited resources to support highly bespoke
delivery
• Higher expectations from students to be given
high quality resources
4. Interactive Studio Manual
• Collaboration between eLearning and Music Production
• Developed using Articulate Storyline
6. Moving to Augmented Reality
• Interactive manual
useful as a learning
resource but not as a
learning experience
• Augmented reality
would encourage an
immersive learning
experience that can be
used in and out of the
classroom
10. Technology
• Collaboration with
Mimas
• Uses 3D edge based
object tracking to snap
the content to the
music production desk.
• Junaio App
11. 3D Object Tracking considerations
• Traditional 3D tracking not
effective
• Should be effective in
differing environmental
conditions
• Consistent experience
across all studios
CRAIG: to explain Specialist Study concept, core module (in context of the degree)
How taught: 2 hour session within studio, small groups (5-6), highly practical hands on learning experience
CRAIG Practical so therefore difficult for students to make notes of processes
No real resources existed to support them outside contact hours apart from word doc/pdf manual docs on the VLE and some books
Higher expectations from students to be given high quality resources,
RUTH– my role and identified solution
Articulate to develop a studio manual
CRAIG: to talk about student feedback
Use student picture
RUTH: Introduced to AR through various conferences and events and identified it’s use in the studio
The interactive manual useful as a learning resource but not as a learning experience..
Augmented reality would encourage an immersive learning experience that can be used in and out of the classroom
http://youtu.be/i92Diz8G5hY
“Well good”
RUTH Working with MIMAS
Junaio
Uses 3D edge based object tracking to snap the content to the music production desk.
Edge tracking more conducive to variable/ low level light environments.
3D scan of object geometry resulted in more robust tracking model, allowing users to walk towards desk to interact with panel elements while overlay remains fixed in place.
Additional functionality to freeze tracking and provide help added.
RUTH Working with MIMAS
Junaio
Uses 3D edge based object tracking to snap the content to the music production desk.
Edge tracking more conducive to variable/ low level light environments.
3D scan of object geometry resulted in more robust tracking model, allowing users to walk towards desk to interact with panel elements while overlay remains fixed in place.
Manual triggering as contingency for users in case of difficulty initialising
Additional functionality to freeze tracking and provide help added.
Initial 3d models developed in Blender using equipment dimensions only produce satisfactory tracking experience
Structure Sensor (Occipital) provides more accurate geometry mesh to use as tracking file.
Some clean up of raw mesh geometry required
Metaio Creator used to create 3D tracking file.
Much tweeking required to find natural balance between accuracy and robust user experience.
Still a foreign concept for users to get use to so must ensure usability
Jquery Mobile coupled with HTML5 layer to deliver information and instruction on channel load to help create universal experience across platforms
Ability to link to videos, find out more information on different parts of production desk.
Foundation for learning about physical equipment in environments that traditionally offer limited support
Use AR edge tracking to assist students in understanding signal routing of patch cables