VERDIKT conference 2010

1. Verdione
Remote presence in a
World Opera
Carsten Griwodz Jason Geistweidt
griff@simula.no jason@geistweidt.com
November 2010

2. Verdione project relations
Norwegian
Academy of Music Stanford
National University McGill
of Singapore NYU
Univ. Tromsø
Lividi
Verdione The World Opera
Netview The MET New York
Telenor Univ. Oslo Bang &
Olufsen
Simula
Nofima
Matforsk Ilmenau
Univ. of Tech.
NTNU
Perceval Tampere
Univ. of Tech.

3. Verdione project relations
Norwegian
Academy of Music Stanford
National University McGill
of Singapore NYU
Univ. Tromsø
Lividi
Verdione The World Opera
Netview The MET New York
Telenor Univ. Oslo Bang &
Olufsen
Simula
Nofima
Matforsk Ilmenau
Univ. of Tech.
NTNU
Perceval Tampere
Univ. of Tech.

4. Verdione project relations
Microsoft/FAST
Accenture
Univ. Tromsø NTNU
Verdione
Cornell
Netview
iAd
Univ. Oslo DCU
Simula
BI Nor. School of Mgmt.

7. The World Opera
?
? Tromsø - Stockholm - Copenhagen
7

8. Interleaved live performances
Display wall
remote stages as part of
audience a pixel space
audience
Interaction spaces primary stage
secondary stages
surround artists live performance, fully
detect movement, secondary stages –send to
synchronized with artistic
sounds, etc primary stage output from other stages
present on display walls audience see both live
and virtual elements
audience
secondary stages notion of primary and
present a fully virtual secondary stages changes
performance to the audience

10. Cameras
large-scale
camera
arrays
multiple cameras

11. Depth Estimation for Free-View Rendering
Stereo System
• Capture two views
(left and right)
• Depth estimated by
disparity
• Novel view points
by warping
left right
depth
output

12. Depth Estimation for Free-View Rendering
origina
Structured Light l Stage challenges
• Project structured • must use infrared
light on object light
• Depth estimated by illuminated by • handle movement
ray-plane structured light during refinement
intersection
• Novel view points
through warping or
modelling
setup
output

13. Service overlay
Main goal Requirements
• Very low delay (to
Architecting a solution for transporting
support interactivity)
media between opera sites
• Efficient bandwidth
usage (for increased
media quality)
• High reliability (given
by a live audience)
• Handle link and
media router failures
(with minimum impact
for the opera
audience)
Current approach
• An overlay network between operas
• Quickly identify failed links and re-route using "standby" backup routes
• Media forwarding and filtering for very low delay (no media transcoding)
• Routing algorithms for short delay and bandwidth efficiency

14. Multilink proxy
Client (receiver) Proxy Server (sender)
Redirected
Part of Flow
NAT Default
Flow
NAT App
App
Network Interfaces
Transparent load leveling Results
Two or more access networks Compensation for latency variations
Useful for capacity bundling Exploitation of heterogeneous
and transparent backup bandwidth
400x improved tunneling (redirect)
speed

15. Questions