Successfully reported this slideshow.
Your SlideShare is downloading. ×
Ad
Ad
Ad
Ad
Ad
Ad
Ad
Ad
Ad
Ad
Ad
Upcoming SlideShare
Lesson 1 multimedia gs
Lesson 1 multimedia gs
Loading in …3
×

Check these out next

1 of 14 Ad

Immersive and interactive media

Download to read offline

1. Distributed (networked), Immersive & Interactive Multimedia Systems.
Quality of Service (QoS) & Quality of Experience (QoE).
MulSeMedia: Multi-Sensorial Media experiences.
Stimulation of all senses: olfactory, haptics/touch...
3D AR apps and VR immersive scenarios (E.g. VR games).
Caves, Head Mounted Displays or HMD (e.g., Oculus Rift...)
Motion Capture (MOCAP) & Gesture Interaction.
Professional IR Tracking Systems, and Kinnectv2, Leap Motion…
Distributed, Interactive and Immersive TV (eg. Based on HbbTV).
2. Media Streaming (Multicast, RTP/RTCP, RTSP, HTTP-based Adaptive Streaming).
3. Types and solutions for Media Synchronization (MediaSync).
Inter-Media Sync (lip-sync, subtitles sync…); Inter-Device Sync or IDES (e.g. multi-screen scenarios); Inter-Destination Media Sync or IDMS (e.g. Social TV); and Hybrid Broadcast Broadband Sync (e.g. multi-view hybrid TV)
4. Multi-Touch Collaborative Screens.

1. Distributed (networked), Immersive & Interactive Multimedia Systems.
Quality of Service (QoS) & Quality of Experience (QoE).
MulSeMedia: Multi-Sensorial Media experiences.
Stimulation of all senses: olfactory, haptics/touch...
3D AR apps and VR immersive scenarios (E.g. VR games).
Caves, Head Mounted Displays or HMD (e.g., Oculus Rift...)
Motion Capture (MOCAP) & Gesture Interaction.
Professional IR Tracking Systems, and Kinnectv2, Leap Motion…
Distributed, Interactive and Immersive TV (eg. Based on HbbTV).
2. Media Streaming (Multicast, RTP/RTCP, RTSP, HTTP-based Adaptive Streaming).
3. Types and solutions for Media Synchronization (MediaSync).
Inter-Media Sync (lip-sync, subtitles sync…); Inter-Device Sync or IDES (e.g. multi-screen scenarios); Inter-Destination Media Sync or IDMS (e.g. Social TV); and Hybrid Broadcast Broadband Sync (e.g. multi-view hybrid TV)
4. Multi-Touch Collaborative Screens.

Advertisement
Advertisement

More Related Content

Similar to Immersive and interactive media (20)

More from Campus de Gandia - Universitat Politècnica de València (20)

Advertisement

Immersive and interactive media

  1. 1. INVESTIGACIÓN EN EL CAMPUS DE GANDIA Immersive and Interactive Media R&D Group (http://iim.webs.upv.es) www.gandia.upv.es/investigacion
  2. 2. IIM (http://iim.webs.upv.es) es un grupo emergente de I+D, integrado en el Departamento de Comunicaciones de la UPV, y localizado en el Campus de Gandia. • Formado por: - Profesores de áreas multidisciplinares. - Personal contratado. - Becarios de investigación. - Alumnos de grado y máster. • Áreas muy relacionadas con la docencia en el Campus: Telecomunicaciones y Electrónica (interconexión, protocolos, diseño de dispositivos); Audiovisuales (contenido, diseño); Matemáticas (algoritmos, modelado y estadística); Informática (programación multi-dispositivo, virtualización...); Turismo (aplicaciones RV, RA, sensoriales...). • Proyectos I+D en vigor: 3 regionales (GV + 2 Polisabios) y 2 locales (Cátedras IVIO y Telefónica). • Colaboraciones externas: CWI y TNO (Holanda); i2CAT y UAB (España). Immersive and Interactive Media R&D Group (IIM) INVESTIGACIÓN www.gandia.upv.es/investigacion
  3. 3. 1. Distributed (networked), Immersive & Interactive Multimedia Systems. • Quality of Service (QoS) & Quality of Experience (QoE). • MulSeMedia: Multi-Sensorial Media experiences. − Stimulation of all senses: olfactory, haptics/touch... • 3D AR apps and VR immersive scenarios (E.g. VR games). − Caves, Head Mounted Displays or HMD (e.g., Oculus Rift...) • Motion Capture (MOCAP) & Gesture Interaction. − Professional IR Tracking Systems, and Kinnectv2, Leap Motion… • Distributed, Interactive and Immersive TV (eg. Based on HbbTV). 2. Media Streaming (Multicast, RTP/RTCP, RTSP, HTTP-based Adaptive Streaming). 3. Types and solutions for Media Synchronization (MediaSync). • Inter-Media Sync (lip-sync, subtitles sync…); Inter-Device Sync or IDES (e.g. multi-screen scenarios); Inter-Destination Media Sync or IDMS (e.g. Social TV); and Hybrid Broadcast Broadband Sync (e.g. multi-view hybrid TV) 4. Multi-Touch Collaborative Screens. Líneas de I+D+i www.gandia.upv.es/investigacion Immersive and Interactive Media R&D Group (IIM)
  4. 4. 1. Distributed (networked), Immersive & Interactive Multimedia Systems Quality of Service (QoS) & Quality of Experience (QoE). • QoS: Network-level and Application-level QoS metrics (delay, jitter, packet loss, throughput, asynchrony…) • QoE: Subjective assessments (performance, usability, usefulness, applicability...) • Market studies (users’ trends, expectations, preferences and needs, interactions with the professional field…) Líneas de I+D+i www.gandia.upv.es/investigacion Immersive and Interactive Media R&D Group (IIM)
  5. 5. 1. Distributed (networked), Immersive & Interactive Multimedia Systems MulSeMedia: Multi-Sensorial Media experiences. • Stimulation of all senses: olfactory, haptics/touch, wind, temperature, humidity, vibration... Olfactory: Touch/force/pressure(Haptics)... Líneas de I+D+i www.gandia.upv.es/investigacion Immersive and Interactive Media R&D Group (IIM) Click for Demo Videos
  6. 6. 1. Distributed (networked), Immersive & Interactive Multimedia Systems 3D AR apps and VR immersive scenarios (E.g. VR games). • Caves, Head Mounted Displays or HMD (e.g., Oculus Rift...): Líneas de I+D+i www.gandia.upv.es/investigacion Immersive and Interactive Media R&D Group (IIM) Click for Demo Videos
  7. 7. 1. Distributed (networked), Immersive & Interactive Multimedia Systems Motion Capture (MOCAP) & Gesture Interaction. • Professional IR Tracking Systems, and no professional systems (Kinnectv2, Leap Motion…): Líneas de I+D+i www.gandia.upv.es/investigacion Immersive and Interactive Media R&D Group (IIM) Click for Demo Videos
  8. 8. 1. Distributed (networked), Immersive & Interactive Multimedia Systems Social TV and synchronous e-Learning Platform Líneas de I+D+i www.gandia.upv.es/investigacion Immersive and Interactive Media R&D Group (IIM) Click for Demo Videos • Cross-platform, cross-device support. • Online Video library. • Distributed Media Sharing, Consumption and Synchronization: ⁻ Inter-Destination and Inter-Media Sync. ⁻ Shared navigation control. ⁻ Master/Slave (M/S) Scheme. ⁻ M/S Role switching. • Social Interaction Channels: ⁻ Synchronized text chat. ⁻ AV conferencing tools. • Presence Mechanisms: ⁻ List of active sessions, members, and media being consumed. ⁻ Twitter (#Wersync, #session_id, #user_nick, URL).
  9. 9. 1. Distributed (networked), Immersive & Interactive Multimedia Systems Interactive and Immersive TV • Immersive TV (VR and 360º) - TV - Tablets, smartphones. - HMD • Interactive displays. • Personalized media experiences (Freeview multicamera TV, adaptive and customizable subtitles…)  Accesibility (impaired) Líneas de I+D+i www.gandia.upv.es/investigacion Immersive and Interactive Media R&D Group (IIM) T V Second screen Click for Demo Videos
  10. 10. 2. Media Streaming (Multicast, RTP/RTCP, RTSP, HTTP-based Adaptive Streaming). Interactive and Immersive TV • Protocols for Multimedia Communications (SIP, SDP, RTSP, RTP/RTCP, RSVP, multicast…). • RTP/RTCP and RTSP based streaming. • HTTP-based Adaptive Streaming (MS Smooth Streaming, HLS, HDS and MPEG-DASH). • Convergence between broadcast and broadband (HbbTV, DVB, IP… Líneas de I+D+i www.gandia.upv.es/investigacion Immersive and Interactive Media R&D Group (IIM) Click for Demo Videos
  11. 11. 3. Media Synchronization (MediaSync) Types and solutions for Media Synchronization (MediaSync) • Inter-Media Sync: lip-sync, subtitles sync. • Inter-Device Sync (IDES): e.g. multi-screen scenarios. • Inter-Destination Media Sync (IDMS): e.g. Social TV. • Hybrid Broadcast Broadband Sync: e.g. multi-view TV Ej: Hybrid and IDES Sync: Adaptive Synchronized Subtitles Líneas de I+D+i www.gandia.upv.es/investigacion Immersive and Interactive Media R&D Group (IIM) Click for demo videos
  12. 12. 4. Multi-Touch Collaborative Screens Líneas de I+D+i www.gandia.upv.es/investigacion Immersive and Interactive Media R&D Group (IIM) Click for Demo Videos
  13. 13. • HbbTV 2.0 compliant and Gstreamer-based testbeds for Hybrid broadcast/broadband media delivery/consumption by using DVB, RTP and HTTP-based adaptive streaming (HLS and MPEG-DASH). • VR immersive collaborative scenarios 3D and VR Lab. • HMDs (e.g. Oculus Rift DK2). • Semi-Cave (L format) 3D projection Lab with movement tracking system. • Gesture Control and Capture Devices (based on IR cameras, Microsoft Kinectv2 for Windows or leap motion) -> Motion Capture Lab. • Generators of multi-sensorial effects (e.g., smell, wind, heat/cold…). • Interactive multi-taction display (e.g. interactive multi-user table-display) • Rpi-based HD Video wall. • Haptic devices (Geomagic Touch-X) • Media and Networking Lab with computers, media and networking devices. • Professional Software. Equipamiento disponible para I+D+i
  14. 14. www.gandia.upv.es/investigacion Muchas Gracias por su atención!!!! Contacto Fernando Boronat Seguí C/Paranimf,1 46730 Grau de Gandia (Valencia, Spain) Teléfono: +34 96 2849341 fboronat@dcom.upv.es http://iim.webs.upv.es/ Youtube Channel Twitter: @ImInMediaGroup

×