Kiddle Cybera Summit08 Edm

1,228 views

Published on

Cameron Kiddle's presentation on rendering on the cloud from Cybera Summit 08.

0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,228
On SlideShare
0
From Embeds
0
Number of Embeds
5
Actions
Shares
0
Downloads
12
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Kiddle Cybera Summit08 Edm

  1. 1. Rendering on the Cloud: A Cybera Industry Pilot Project with EDM Studio Cameron Kiddle Grid Research Centre University of Calgary
  2. 2. Outline EDM Studio Project Goals Cyberinfrastructure Technology Employed Demonstration Cybera Summit Disruptive Technologies Session - 2 September 30, 2008
  3. 3. EDM Studio (http://www.edmstudio.com) A leading-edge design firm based in Calgary Specialize in Interactive displays for museums Digital visualization Have created exhibits for places such as National Museum of Australia Royal Tyrrell Museum Frank Slide Interpretive Centre (in progress) Cybera Summit Disruptive Technologies Session - 3 September 30, 2008
  4. 4. Computer Animation Requires significant computational power to produce final movie Rendering of an individual frame can take hours High level of concurrency – frames can be rendered separately Cybera Summit Disruptive Technologies Session - 4 September 30, 2008
  5. 5. Case Study: Shrek (DreamWorks) Shrek (2001) – 5 million CPU render hours Shrek 2 (2004) – 10 million CPU render hours Shrek 3 (2007) – 20 million CPU render hours (Source: R. Rowe. DreamWorks Animation quot;Shrek the Thirdquot;: Linux Feeds an Ogre. Linux Journal. June 5, 2007. (http://www.linuxjournal.com/article/9653)) Time to Render 1 CPU 100 CPUs 10000 CPUs Shrek 571 years 5.7 years 21 days Shrek 2 1142 years 11.4 years 42 days Shrek 3 2283 years 22.8 years 83 days Cybera Summit Disruptive Technologies Session - 5 September 30, 2008
  6. 6. EDM Studio Pilot Project Goals To create an on-demand cloud-based rendering service Project is divided into two phases Phase 1 – a static environment (complete) Phase 2 – a dynamic environment with enriched user portal Cybera Summit Disruptive Technologies Session - 6 September 30, 2008
  7. 7. Phase I – Report Created a virtual 32 CPU rendering farm (static) on the HP Labs Data Centre at the University of Calgary Condor batch scheduling system used to manage rendering jobs Setup SideFX Houdini rendering software and licenses Setup 1 TB of storage for use by EDM Studio EDM Studios has used the render farm to create a preliminary animation of the Frank Slide What normally would have taken two months to complete was completed in two weeks Low-resolution sample rendered on the HP Labs Data Centre by EDM Studio. (Supplied) Cybera Summit Disruptive Technologies Session - 7 September 30, 2008
  8. 8. Phase II – Objectives Enable dynamic adaptivity of rendering farm based on user demand Employ data management tools to more efficiently move and manage data Construct a portal to allow EDM Studio to access data management tools and to submit and monitor rendering jobs Cybera Summit Disruptive Technologies Session - 8 September 30, 2008
  9. 9. Cyberinfrastructure Technology Employed Data management tools Virtual machine technology Dynamic cloud-based infrastructure Social networking technology Cybera Summit Disruptive Technologies Session - 9 September 30, 2008
  10. 10. Data Management Tools Significant amounts of data need to be moved and managed Exploring the use of iRODS (https://www.irods.org) Abstracts users, data and resources Flexible, adaptive, and customizable Handles data transfers and replications Cybera Summit Disruptive Technologies Session - 10 September 30, 2008
  11. 11. Virtual Machine Technology Employing Xen virtual machine technology Create custom Virtual Appliances (VA) for each application/service needed VAs can be easily cloned to create new instances and scale the environment Can support heterogeneous services on the same physical infrastructure Cybera Summit Disruptive Technologies Session - 11 September 30, 2008
  12. 12. Dynamic Cloud-based Infrastructure ASPEN: Automated Service Provisioning Environment Cybera Summit Disruptive Technologies Session - 12 September 30, 2008
  13. 13. Social Networking Technology Allow users to easily generate and share content Allow users to interact and collaborate Exploring the use of social networking technology for use by academia and industry Cybera Summit Disruptive Technologies Session - 13 September 30, 2008
  14. 14. Rendering Service Portal Using Ning - a white label social networking tool (http://www.ning.com) The portal is aimed at: Providing access to data management tools Allowing user to submit, monitor and manage rendering jobs Providing access to interactive applications Enabling interaction and collaboration Cybera Summit Disruptive Technologies Session - 14 September 30, 2008
  15. 15. Demonstration Cybera Summit Disruptive Technologies Session - 15 September 30, 2008
  16. 16. Contact Information Cameron Kiddle kiddlec@cpsc.ucalgary.ca http://grid.ucalgary.ca/ Cybera Summit Disruptive Technologies Session - 16 September 30, 2008

×