Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
<ul><li>P. Ritsos & R. Gittins </li></ul><ul><li>p.ritsos, r.gittins - @bangor.ac.uk </li></ul><ul><li>Creating Second Liv...
THE PROJECT IVY GROUP <ul><ul><ul><li>University of Surrey  (UK) </li></ul></ul></ul><ul><ul><ul><li>Uniwersystet im. Adam...
<ul><li>The rise of migration and multilingualism in Europe requires professional interpreters in business, legal, medical...
<ul><li>A dedicated 3D virtual environment for  </li></ul><ul><ul><li>interpreting students and  </li></ul></ul><ul><ul><l...
<ul><li>To present the technical requirements that have to be met from the IVY Virtual Environment (IVY-VE) </li></ul><ul>...
<ul><li>To provide an intuitive, easy to use interface to a Virtual World where the aforementioned scenarios will reside <...
<ul><li>Dialogues are assembled from  mp3 files , corresponding to the scene participants (denoted A & B) speech </li></ul...
<ul><li>VE Visitors need to be able to roam freely into the areas of Project IVY, without any obtrusive GUI elements or VW...
 
<ul><li>Various Scenarios - Classroom, meeting room, shops, outdoor, community centre etc. </li></ul><ul><li>IVY Virtual E...
<ul><li>Various Scenarios - Classroom, meeting room, shops, outdoor, community centre etc. </li></ul><ul><li>IVY Virtual E...
<ul><li>Various Scenarios - Classroom, meeting room, shops, outdoor, community centre etc. </li></ul><ul><li>IVY Virtual E...
<ul><li>Interpreter students at Surrey University have already trialled basic meetings. </li></ul><ul><li>IVY Virtual Envi...
<ul><li>Courtroom settings are also being developed – multi purpose training scenarios – interpreter and user of interpret...
 
<ul><li>IVY Virtual Environment  –  Architecture </li></ul>
<ul><li>Menu is a Heads-Up display (HUD) with same aesthetics to the SL user interface </li></ul><ul><li>IVY Virtual Envir...
<ul><li>Simple, Intuitive menu for selecting form, language pair and dialogue by title </li></ul><ul><li>Information Pane ...
<ul><li>Once a dialogue is selected a player and a teleportation confirmation window appear </li></ul><ul><li>IVY Virtual ...
<ul><li>Simple audio player with dialogue specific information  </li></ul><ul><li>Returns user to dialogue selection menu ...
<ul><li>Where is the research element?  </li></ul><ul><li>Is it merely a development project, mixing and matching existing...
<ul><li>Thank you! </li></ul>
Upcoming SlideShare
Loading in …5
×

Project IVY- Virtual Environment Development

848 views

Published on

Creating Second Lives 2011, Bangor University, UK

Published in: Technology, Education
  • Be the first to comment

  • Be the first to like this

Project IVY- Virtual Environment Development

  1. 1. <ul><li>P. Ritsos & R. Gittins </li></ul><ul><li>p.ritsos, r.gittins - @bangor.ac.uk </li></ul><ul><li>Creating Second Lives 2011 – Bangor, September 2011 </li></ul>The IVY project has been funded with support from the European Commission. This publication reflects the views only of the authors, and the Commission cannot be held responsible for any use which may be made of the information contained therein.
  2. 2. THE PROJECT IVY GROUP <ul><ul><ul><li>University of Surrey (UK) </li></ul></ul></ul><ul><ul><ul><li>Uniwersystet im. Adama Mickiewicza (Poland) </li></ul></ul></ul><ul><ul><ul><li>University of Cyprus (Cyprus) </li></ul></ul></ul><ul><ul><ul><li>Steinbeis GmbH & Co. KG für Tech-transfer (Germany) </li></ul></ul></ul><ul><ul><ul><li>University of Bangor (UK - Wales) </li></ul></ul></ul><ul><ul><ul><li>. </li></ul></ul></ul><ul><ul><ul><li>Eberhard Karls Universität Tübingen (Germany) </li></ul></ul></ul><ul><ul><ul><li>Bar Ilan University (Israel) </li></ul></ul></ul>
  3. 3. <ul><li>The rise of migration and multilingualism in Europe requires professional interpreters in business, legal, medical and many other settings. </li></ul><ul><li>Future interpreters need to master an ever broadening range of interpreting skills and scenarios – training for which is often difficult to achieve with traditional teaching methods. </li></ul><ul><li>Project IVY employs 3D virtual environment technology to create an virtual educational space that supports the acquisition and application of skills required in interpreter-mediated communication. </li></ul><ul><li>Project IVY Partners provide user interaction and interpreter resources – audio and video material from previous video conferencing research – ‘BACKBONE’. </li></ul><ul><li>IVY Virtual Environment – Scope </li></ul>
  4. 4. <ul><li>A dedicated 3D virtual environment for </li></ul><ul><ul><li>interpreting students and </li></ul></ul><ul><ul><li>future users of interpreters </li></ul></ul><ul><li>A range of virtual interpreting scenarios (e.g. ‘ business meeting ’ ) that can be run in different working modes: simulation , activity / exercise mode, exploration and live interaction mode; </li></ul><ul><li>Multilingual video-/audio-based content for interpreting scenarios, by </li></ul><ul><ul><li>adapting and supplementing the corpora from the LLP project BACKBONE (in EN, DE, ES, FR, PL, TR) and </li></ul></ul><ul><ul><li>adding new corpora (GR and AR, EL or RU). </li></ul></ul><ul><li>Two sets of pedagogical material for interpreter students and (future) ‘ clients ’ , e.g. awareness-raising and interpreting exercises, and explanations. </li></ul><ul><li>Project IVY in a nutshell </li></ul>
  5. 5. <ul><li>To present the technical requirements that have to be met from the IVY Virtual Environment (IVY-VE) </li></ul><ul><li>To present the strategic decisions, resulting design and implementation progress to date, towards the creation of a prototype </li></ul><ul><li>To provide an overview of the main features of our prototype </li></ul><ul><li>To allow for discussion on design aspects which require partner feedback </li></ul><ul><li>Presentation Outline </li></ul>
  6. 6. <ul><li>To provide an intuitive, easy to use interface to a Virtual World where the aforementioned scenarios will reside </li></ul><ul><li>To allow access to existing audio material from BACKBONE of interpreting exercises an scenarios </li></ul><ul><li>To allow easy dialogue management – addition, modification, deletion of existing dialogue scripts </li></ul><ul><li>Dialogues can be synthetised in a limited fashion to provide alternative scripts </li></ul><ul><li>IVY Virtual Environment – Requirements </li></ul>
  7. 7. <ul><li>Dialogues are assembled from mp3 files , corresponding to the scene participants (denoted A & B) speech </li></ul><ul><li>They do not have to be of a particular order – i.e. dialogues can follow a sequence such as `ABBAAABAB ’ </li></ul><ul><li>Audio sequences form a dialogue script … </li></ul><ul><li>… which is accompanied from textual information – title, keywords (domains), description and scene </li></ul><ul><li>In the future we will be able to replace the audio files corresponding to a language in a script with other ones, compliant with the latter… </li></ul><ul><li>… allowing limited dialogue synthesis </li></ul><ul><li>IVY Virtual Environment – Technical Aspects - I </li></ul>
  8. 8. <ul><li>VE Visitors need to be able to roam freely into the areas of Project IVY, without any obtrusive GUI elements or VW noticeboards </li></ul><ul><li>Ideally users need to be able to `jump’ from scenario to scenario without needing to return to a `reception’ area </li></ul><ul><li>Audio controls need to include stop, rewind, fast-forward etc. </li></ul><ul><li>Main challenge is to `match’ audio events to environment events and/or avatar expressions and gestures </li></ul><ul><li>Dialogue management does not need to be performed from within the VE </li></ul><ul><li>IVY Virtual Environment – Technical Aspects - II </li></ul>
  9. 10. <ul><li>Various Scenarios - Classroom, meeting room, shops, outdoor, community centre etc. </li></ul><ul><li>IVY Virtual Environment – Scenarios </li></ul>
  10. 11. <ul><li>Various Scenarios - Classroom, meeting room, shops, outdoor, community centre etc. </li></ul><ul><li>IVY Virtual Environment – Scenarios </li></ul>
  11. 12. <ul><li>Various Scenarios - Classroom, meeting room, shops, outdoor, community centre etc. </li></ul><ul><li>IVY Virtual Environment – Scenarios </li></ul>
  12. 13. <ul><li>Interpreter students at Surrey University have already trialled basic meetings. </li></ul><ul><li>IVY Virtual Environment – Scenarios </li></ul>
  13. 14. <ul><li>Courtroom settings are also being developed – multi purpose training scenarios – interpreter and user of interpreters. </li></ul><ul><li>IVY Virtual Environment – Scenarios </li></ul>
  14. 16. <ul><li>IVY Virtual Environment – Architecture </li></ul>
  15. 17. <ul><li>Menu is a Heads-Up display (HUD) with same aesthetics to the SL user interface </li></ul><ul><li>IVY Virtual Environment – Menu </li></ul>
  16. 18. <ul><li>Simple, Intuitive menu for selecting form, language pair and dialogue by title </li></ul><ul><li>Information Pane and Launcher </li></ul><ul><li>Essentially a Heads-up display object </li></ul><ul><li>Individual per user </li></ul><ul><li>Allows teleportation from scenario to scenario without requiring returning to a reception area </li></ul><ul><li>IVY Virtual Environment – Dialogue HUD </li></ul>
  17. 19. <ul><li>Once a dialogue is selected a player and a teleportation confirmation window appear </li></ul><ul><li>IVY Virtual Environment – Player - Teleportation </li></ul>
  18. 20. <ul><li>Simple audio player with dialogue specific information </li></ul><ul><li>Returns user to dialogue selection menu </li></ul><ul><li>IVY Virtual Environment – Player Detail </li></ul>
  19. 21. <ul><li>Where is the research element? </li></ul><ul><li>Is it merely a development project, mixing and matching existing techniques? </li></ul><ul><li>The research element comes from the `service’ and not the technology… </li></ul><ul><ul><li>User experience assessment of the interface. </li></ul></ul><ul><ul><li>Performance comparison to traditional methods used by interpreters </li></ul></ul><ul><ul><li>Definition of metrics for the above </li></ul></ul><ul><li>IVY Virtual Environment – Research Element </li></ul>
  20. 22. <ul><li>Thank you! </li></ul>

×