Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Immersive and interactive media

622 views

Published on

1. Distributed (networked), Immersive & Interactive Multimedia Systems.
Quality of Service (QoS) & Quality of Experience (QoE).
MulSeMedia: Multi-Sensorial Media experiences.
Stimulation of all senses: olfactory, haptics/touch...
3D AR apps and VR immersive scenarios (E.g. VR games).
Caves, Head Mounted Displays or HMD (e.g., Oculus Rift...)
Motion Capture (MOCAP) & Gesture Interaction.
Professional IR Tracking Systems, and Kinnectv2, Leap Motion…
Distributed, Interactive and Immersive TV (eg. Based on HbbTV).
2. Media Streaming (Multicast, RTP/RTCP, RTSP, HTTP-based Adaptive Streaming).
3. Types and solutions for Media Synchronization (MediaSync).
Inter-Media Sync (lip-sync, subtitles sync…); Inter-Device Sync or IDES (e.g. multi-screen scenarios); Inter-Destination Media Sync or IDMS (e.g. Social TV); and Hybrid Broadcast Broadband Sync (e.g. multi-view hybrid TV)
4. Multi-Touch Collaborative Screens.

Published in: Science
  • Be the first to comment

  • Be the first to like this

Immersive and interactive media

  1. 1. INVESTIGACIÓN EN EL CAMPUS DE GANDIA Immersive and Interactive Media R&D Group (http://iim.webs.upv.es) www.gandia.upv.es/investigacion
  2. 2. IIM (http://iim.webs.upv.es) es un grupo emergente de I+D, integrado en el Departamento de Comunicaciones de la UPV, y localizado en el Campus de Gandia. • Formado por: - Profesores de áreas multidisciplinares. - Personal contratado. - Becarios de investigación. - Alumnos de grado y máster. • Áreas muy relacionadas con la docencia en el Campus: Telecomunicaciones y Electrónica (interconexión, protocolos, diseño de dispositivos); Audiovisuales (contenido, diseño); Matemáticas (algoritmos, modelado y estadística); Informática (programación multi-dispositivo, virtualización...); Turismo (aplicaciones RV, RA, sensoriales...). • Proyectos I+D en vigor: 3 regionales (GV + 2 Polisabios) y 2 locales (Cátedras IVIO y Telefónica). • Colaboraciones externas: CWI y TNO (Holanda); i2CAT y UAB (España). Immersive and Interactive Media R&D Group (IIM) INVESTIGACIÓN www.gandia.upv.es/investigacion
  3. 3. 1. Distributed (networked), Immersive & Interactive Multimedia Systems. • Quality of Service (QoS) & Quality of Experience (QoE). • MulSeMedia: Multi-Sensorial Media experiences. − Stimulation of all senses: olfactory, haptics/touch... • 3D AR apps and VR immersive scenarios (E.g. VR games). − Caves, Head Mounted Displays or HMD (e.g., Oculus Rift...) • Motion Capture (MOCAP) & Gesture Interaction. − Professional IR Tracking Systems, and Kinnectv2, Leap Motion… • Distributed, Interactive and Immersive TV (eg. Based on HbbTV). 2. Media Streaming (Multicast, RTP/RTCP, RTSP, HTTP-based Adaptive Streaming). 3. Types and solutions for Media Synchronization (MediaSync). • Inter-Media Sync (lip-sync, subtitles sync…); Inter-Device Sync or IDES (e.g. multi-screen scenarios); Inter-Destination Media Sync or IDMS (e.g. Social TV); and Hybrid Broadcast Broadband Sync (e.g. multi-view hybrid TV) 4. Multi-Touch Collaborative Screens. Líneas de I+D+i www.gandia.upv.es/investigacion Immersive and Interactive Media R&D Group (IIM)
  4. 4. 1. Distributed (networked), Immersive & Interactive Multimedia Systems Quality of Service (QoS) & Quality of Experience (QoE). • QoS: Network-level and Application-level QoS metrics (delay, jitter, packet loss, throughput, asynchrony…) • QoE: Subjective assessments (performance, usability, usefulness, applicability...) • Market studies (users’ trends, expectations, preferences and needs, interactions with the professional field…) Líneas de I+D+i www.gandia.upv.es/investigacion Immersive and Interactive Media R&D Group (IIM)
  5. 5. 1. Distributed (networked), Immersive & Interactive Multimedia Systems MulSeMedia: Multi-Sensorial Media experiences. • Stimulation of all senses: olfactory, haptics/touch, wind, temperature, humidity, vibration... Olfactory: Touch/force/pressure(Haptics)... Líneas de I+D+i www.gandia.upv.es/investigacion Immersive and Interactive Media R&D Group (IIM) Click for Demo Videos
  6. 6. 1. Distributed (networked), Immersive & Interactive Multimedia Systems 3D AR apps and VR immersive scenarios (E.g. VR games). • Caves, Head Mounted Displays or HMD (e.g., Oculus Rift...): Líneas de I+D+i www.gandia.upv.es/investigacion Immersive and Interactive Media R&D Group (IIM) Click for Demo Videos
  7. 7. 1. Distributed (networked), Immersive & Interactive Multimedia Systems Motion Capture (MOCAP) & Gesture Interaction. • Professional IR Tracking Systems, and no professional systems (Kinnectv2, Leap Motion…): Líneas de I+D+i www.gandia.upv.es/investigacion Immersive and Interactive Media R&D Group (IIM) Click for Demo Videos
  8. 8. 1. Distributed (networked), Immersive & Interactive Multimedia Systems Social TV and synchronous e-Learning Platform Líneas de I+D+i www.gandia.upv.es/investigacion Immersive and Interactive Media R&D Group (IIM) Click for Demo Videos • Cross-platform, cross-device support. • Online Video library. • Distributed Media Sharing, Consumption and Synchronization: ⁻ Inter-Destination and Inter-Media Sync. ⁻ Shared navigation control. ⁻ Master/Slave (M/S) Scheme. ⁻ M/S Role switching. • Social Interaction Channels: ⁻ Synchronized text chat. ⁻ AV conferencing tools. • Presence Mechanisms: ⁻ List of active sessions, members, and media being consumed. ⁻ Twitter (#Wersync, #session_id, #user_nick, URL).
  9. 9. 1. Distributed (networked), Immersive & Interactive Multimedia Systems Interactive and Immersive TV • Immersive TV (VR and 360º) - TV - Tablets, smartphones. - HMD • Interactive displays. • Personalized media experiences (Freeview multicamera TV, adaptive and customizable subtitles…)  Accesibility (impaired) Líneas de I+D+i www.gandia.upv.es/investigacion Immersive and Interactive Media R&D Group (IIM) T V Second screen Click for Demo Videos
  10. 10. 2. Media Streaming (Multicast, RTP/RTCP, RTSP, HTTP-based Adaptive Streaming). Interactive and Immersive TV • Protocols for Multimedia Communications (SIP, SDP, RTSP, RTP/RTCP, RSVP, multicast…). • RTP/RTCP and RTSP based streaming. • HTTP-based Adaptive Streaming (MS Smooth Streaming, HLS, HDS and MPEG-DASH). • Convergence between broadcast and broadband (HbbTV, DVB, IP… Líneas de I+D+i www.gandia.upv.es/investigacion Immersive and Interactive Media R&D Group (IIM) Click for Demo Videos
  11. 11. 3. Media Synchronization (MediaSync) Types and solutions for Media Synchronization (MediaSync) • Inter-Media Sync: lip-sync, subtitles sync. • Inter-Device Sync (IDES): e.g. multi-screen scenarios. • Inter-Destination Media Sync (IDMS): e.g. Social TV. • Hybrid Broadcast Broadband Sync: e.g. multi-view TV Ej: Hybrid and IDES Sync: Adaptive Synchronized Subtitles Líneas de I+D+i www.gandia.upv.es/investigacion Immersive and Interactive Media R&D Group (IIM) Click for demo videos
  12. 12. 4. Multi-Touch Collaborative Screens Líneas de I+D+i www.gandia.upv.es/investigacion Immersive and Interactive Media R&D Group (IIM) Click for Demo Videos
  13. 13. • HbbTV 2.0 compliant and Gstreamer-based testbeds for Hybrid broadcast/broadband media delivery/consumption by using DVB, RTP and HTTP-based adaptive streaming (HLS and MPEG-DASH). • VR immersive collaborative scenarios 3D and VR Lab. • HMDs (e.g. Oculus Rift DK2). • Semi-Cave (L format) 3D projection Lab with movement tracking system. • Gesture Control and Capture Devices (based on IR cameras, Microsoft Kinectv2 for Windows or leap motion) -> Motion Capture Lab. • Generators of multi-sensorial effects (e.g., smell, wind, heat/cold…). • Interactive multi-taction display (e.g. interactive multi-user table-display) • Rpi-based HD Video wall. • Haptic devices (Geomagic Touch-X) • Media and Networking Lab with computers, media and networking devices. • Professional Software. Equipamiento disponible para I+D+i
  14. 14. www.gandia.upv.es/investigacion Muchas Gracias por su atención!!!! Contacto Fernando Boronat Seguí C/Paranimf,1 46730 Grau de Gandia (Valencia, Spain) Teléfono: +34 96 2849341 fboronat@dcom.upv.es http://iim.webs.upv.es/ Youtube Channel Twitter: @ImInMediaGroup

×