SlideShare a Scribd company logo
1 of 14
CG Pipelines


      [V|K|GUPTA]
1                                              2




The term "pipe" was introduced in              A pipe is an input-output data structure that eliminates the need for program A to write a
computer jargon with the development of        stream of data to a file that will be read and processed by program B.
UNIX.


 3                                               4




The concept of moving computer data            And so "CG process" became "CG workflows" and these became "CG pipelines”
through a series of software modules
became work process by progressing the
work product through a series of specialized
workers.



                                                                            The Pipeline Story
People




       Process            Tools




Dimensions of a Pipeline
Pre Production   Line Production
       Asset Build       Shot Build




        Editorial       Look Build
                         Finishing




CG Pipeline Categories
Production Operations Pipeline
CG Task Pipeline
Version

            Approved                                       File Server                     Live Data




                           Retake




                                                 Publish                          Revise
Reviewer




                  Retake
                                    Revision
                                                                                           Published
                                                                                            Assets
                                                                         Artist

 Approved




Work & Data Flow
Design




                Model




                         Surface




                                   Rigging



         Cascading Pipeline
Model




  Design             Surface




           Rigging



Modular Pipeline
•   The traditional way of thinking about a pipeline is the production pipeline.

•   Production Pipeline is modeled after post-industrial assembly systems where workers specialize in a
    given task.

•   The assembly line is a system where the work product moves past a series of work stations at a
    fixed speed, forcing each specialty to be constrained to a fixed duration and narrow set of skills.

•   Computer graphics is unlikely to achieve the efficiency of automated manufacturing line, but the
    concept of specialization has been embraced.

•   CG production is of phased nature, like model construction, motion construction, lighting, shading,
    rendering and compositing to break up the work.

•   Not all work missions will support the same production pipeline profile.

                    Production Pipeline
Data Management                             Asset Management                         Review Management
                                            An asset management system forms the   You need to figure out deadlines, who signs off on
Every CG environment involves the
                                            heart and mind of the data pipeline.   what, and stick to it.
delivery of a product, a shot, a sequence
or a complete show.

                                            An asset management system allows      Almost everyone works better in collaboration, so
                                            users to                               figure out who is saying "Yes" to an element, or
Along the way assets are gathered and
                                                                                   calling a retake.
intermediate assets or work products are
constructed.
                                            Track the progress
                                                                                   Review management system will track approvals,
                                                                                   retakes, progress etc and feeds the production
Assets used as inputs may include
                                                                                   with status of the show.
footage, stills, and reference materials.   Navigate assets


                                                                                   A key material in any pipeline comprises the
One person's output becomes the next        Find task / relationships              aggregate of direction and instructions about a
person's input. Hence the need for
                                                                                   particular work product (a shot or element of a
pipeline.
                                                                                   shot at the finest level).
                                            Controls the versions and revisions.

Managing the flow of materials through
                                                                                   Managing this data involves collecting, organizing
the studio is an important sub-pipeline.
                                                                                   and distributing the information to the right
                                                                                   persons.



                                                                                   It involves a decision loop, the approval pipeline is
                                                                                   itself a looped pipeline with an iterative nature.



Pipeline Essentials
Resource Management                                    Naming Convention
                                                         If you have a bulletproof naming system, you
     A render farm, storage and servers are are vital    can write batch scripts that automate large
     for large productions.                              amounts of painful work.



     You need lots of storage space, and you need it     Moving       directories,    renaming    files,
     secure that is, someone makes rotating backups      categorization, even simple compositing tasks
     or automated backups.                               (burn-in, watermarks, etc.).



     Depending on what you can get for servers, it       In some environments this was not really
     may be preferable to have the artists copy the      possible, so the more you're able to automate
     data locally to work on it, instead of reading it   stuff, the easier life gets.
     off the server which is also being read from and
     written to by the render farm.
                                                         This also will help the asset management system
                                                         identify relationship for each shot.
     A job queue is essential to farm jobs to the
     servers.




Pipeline Essentials
•   A CG pipeline belongs to one of three classes:
    •   production (task)         primary
    •   material    (data)        secondary
    •   approval    (meta-data)   tertiary
•   A CG pipeline is comprised of three structural dimensions:
    •   People
    •   Process
    •   Tools
•   A CG pipeline utilizes technology but is not the technology
•   A CG pipeline divides a work-flow into separate and meaningful tasks assigned to two or more persons
•   A CG pipeline tasks divisions are determined using a tree of specialization across the three dimensions
•   The CG pipeline structural form is dictated by
    •   The business purpose
    •   Resource availability
    •   Studio culture
•   A CG pipeline is malleable




                 CG Pipeline Summary
Selected Credits




    V K GUPTA | CG Pipeline Architect | Twitter @kgvinnakota | Linkedin http://in.linkedin.com/in/vkgupta

More Related Content

What's hot

What's hot (20)

ієрархічна, мережева, реляційна модель бази даних
ієрархічна, мережева, реляційна модель бази данихієрархічна, мережева, реляційна модель бази даних
ієрархічна, мережева, реляційна модель бази даних
 
Infoblox dhcp ipam-dns 소개자료
Infoblox dhcp ipam-dns 소개자료Infoblox dhcp ipam-dns 소개자료
Infoblox dhcp ipam-dns 소개자료
 
Game Engine Architecture
Game Engine ArchitectureGame Engine Architecture
Game Engine Architecture
 
Bsd ppt
Bsd pptBsd ppt
Bsd ppt
 
Map Reduce
Map ReduceMap Reduce
Map Reduce
 
NTFS.ppt
NTFS.pptNTFS.ppt
NTFS.ppt
 
Design of Hadoop Distributed File System
Design of Hadoop Distributed File SystemDesign of Hadoop Distributed File System
Design of Hadoop Distributed File System
 
Entity Component Systems
Entity Component SystemsEntity Component Systems
Entity Component Systems
 
Linux opearting system ppt
Linux opearting system pptLinux opearting system ppt
Linux opearting system ppt
 
전영규 유니코드 세미나_공개용
전영규 유니코드 세미나_공개용전영규 유니코드 세미나_공개용
전영규 유니코드 세미나_공개용
 
Людина в русі
Людина в русіЛюдина в русі
Людина в русі
 
Організація програмного забезпечення комп’ютера
Організація програмного забезпечення комп’ютераОрганізація програмного забезпечення комп’ютера
Організація програмного забезпечення комп’ютера
 
Linux file system
Linux file systemLinux file system
Linux file system
 
GAN을 이용한 캐릭터 리소스 제작 맛보기
GAN을 이용한 캐릭터 리소스 제작 맛보기GAN을 이용한 캐릭터 리소스 제작 맛보기
GAN을 이용한 캐릭터 리소스 제작 맛보기
 
Mapreduce by examples
Mapreduce by examplesMapreduce by examples
Mapreduce by examples
 
MapReduce
MapReduceMapReduce
MapReduce
 
Big Data Analytics Part2
Big Data Analytics Part2Big Data Analytics Part2
Big Data Analytics Part2
 
Mobil Programlama Soruları
Mobil Programlama SorularıMobil Programlama Soruları
Mobil Programlama Soruları
 
Eclipse文字化けする。一撃で文字化けを直す方法
Eclipse文字化けする。一撃で文字化けを直す方法Eclipse文字化けする。一撃で文字化けを直す方法
Eclipse文字化けする。一撃で文字化けを直す方法
 
The Importance of Terminology and sRGB Uncertainty - Notes - 0.5
The Importance of Terminology and sRGB Uncertainty - Notes - 0.5The Importance of Terminology and sRGB Uncertainty - Notes - 0.5
The Importance of Terminology and sRGB Uncertainty - Notes - 0.5
 

Similar to Cg Pipeline

Software Architecture Intro
Software Architecture IntroSoftware Architecture Intro
Software Architecture Intro
Sadhana Ghalsasi
 
Making Runtime Data Useful for Incident Diagnosis: An Experience Report
Making Runtime Data Useful for Incident Diagnosis: An Experience ReportMaking Runtime Data Useful for Incident Diagnosis: An Experience Report
Making Runtime Data Useful for Incident Diagnosis: An Experience Report
QAware GmbH
 
10 - Architetture Software - More architectural styles
10 - Architetture Software - More architectural styles10 - Architetture Software - More architectural styles
10 - Architetture Software - More architectural styles
Majong DevJfu
 

Similar to Cg Pipeline (20)

Connecting the dots mbse process dec02 2015
Connecting the dots mbse process dec02 2015Connecting the dots mbse process dec02 2015
Connecting the dots mbse process dec02 2015
 
Centralizing sequence analysis
Centralizing sequence analysisCentralizing sequence analysis
Centralizing sequence analysis
 
Java Batch for Cost Optimized Efficiency
Java Batch for Cost Optimized EfficiencyJava Batch for Cost Optimized Efficiency
Java Batch for Cost Optimized Efficiency
 
Adv prod tools assgn5
Adv prod tools assgn5Adv prod tools assgn5
Adv prod tools assgn5
 
Quality assurance in dev ops and secops world
Quality assurance in dev ops and secops worldQuality assurance in dev ops and secops world
Quality assurance in dev ops and secops world
 
Quality assurance in dev ops and secops world
Quality assurance in dev ops and secops worldQuality assurance in dev ops and secops world
Quality assurance in dev ops and secops world
 
Cloud Migration: Moving to the Cloud
Cloud Migration: Moving to the CloudCloud Migration: Moving to the Cloud
Cloud Migration: Moving to the Cloud
 
Software Architecture Intro
Software Architecture IntroSoftware Architecture Intro
Software Architecture Intro
 
Estimating the Total Costs of Your Cloud Analytics Platform
Estimating the Total Costs of Your Cloud Analytics PlatformEstimating the Total Costs of Your Cloud Analytics Platform
Estimating the Total Costs of Your Cloud Analytics Platform
 
DevOps for Mainframe for IBM Pulse Conference
DevOps for Mainframe for IBM Pulse ConferenceDevOps for Mainframe for IBM Pulse Conference
DevOps for Mainframe for IBM Pulse Conference
 
Composition and Execution of Secure Workflows in WSRF-Grids, IEEE CCGrid 2008...
Composition and Execution of Secure Workflows in WSRF-Grids, IEEE CCGrid 2008...Composition and Execution of Secure Workflows in WSRF-Grids, IEEE CCGrid 2008...
Composition and Execution of Secure Workflows in WSRF-Grids, IEEE CCGrid 2008...
 
Ogce Workflow Suite Tg09
Ogce Workflow Suite Tg09Ogce Workflow Suite Tg09
Ogce Workflow Suite Tg09
 
Making Runtime Data Useful for Incident Diagnosis: An Experience Report
Making Runtime Data Useful for Incident Diagnosis: An Experience ReportMaking Runtime Data Useful for Incident Diagnosis: An Experience Report
Making Runtime Data Useful for Incident Diagnosis: An Experience Report
 
C++ for Marine Streamer Positioning and Navigation - ACCU 2011
C++ for Marine Streamer Positioning and Navigation - ACCU 2011C++ for Marine Streamer Positioning and Navigation - ACCU 2011
C++ for Marine Streamer Positioning and Navigation - ACCU 2011
 
10 - Architetture Software - More architectural styles
10 - Architetture Software - More architectural styles10 - Architetture Software - More architectural styles
10 - Architetture Software - More architectural styles
 
Performance on a budget
Performance on a budgetPerformance on a budget
Performance on a budget
 
Evolution of netflix conductor
Evolution of netflix conductorEvolution of netflix conductor
Evolution of netflix conductor
 
SharePoint 2010 as a Development Platform
SharePoint 2010 as a Development PlatformSharePoint 2010 as a Development Platform
SharePoint 2010 as a Development Platform
 
Tordatasci meetup-precima-retail-analytics-201901
Tordatasci meetup-precima-retail-analytics-201901Tordatasci meetup-precima-retail-analytics-201901
Tordatasci meetup-precima-retail-analytics-201901
 
(ATS3-APP14) Troubleshooting Symyx Notebook client performance
(ATS3-APP14) Troubleshooting Symyx Notebook client performance(ATS3-APP14) Troubleshooting Symyx Notebook client performance
(ATS3-APP14) Troubleshooting Symyx Notebook client performance
 

Recently uploaded

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
WSO2
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Victor Rentea
 
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 

Recently uploaded (20)

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
TEST BANK For Principles of Anatomy and Physiology, 16th Edition by Gerard J....
TEST BANK For Principles of Anatomy and Physiology, 16th Edition by Gerard J....TEST BANK For Principles of Anatomy and Physiology, 16th Edition by Gerard J....
TEST BANK For Principles of Anatomy and Physiology, 16th Edition by Gerard J....
 
Simplifying Mobile A11y Presentation.pptx
Simplifying Mobile A11y Presentation.pptxSimplifying Mobile A11y Presentation.pptx
Simplifying Mobile A11y Presentation.pptx
 
Design and Development of a Provenance Capture Platform for Data Science
Design and Development of a Provenance Capture Platform for Data ScienceDesign and Development of a Provenance Capture Platform for Data Science
Design and Development of a Provenance Capture Platform for Data Science
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
AI in Action: Real World Use Cases by Anitaraj
AI in Action: Real World Use Cases by AnitarajAI in Action: Real World Use Cases by Anitaraj
AI in Action: Real World Use Cases by Anitaraj
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
 
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital Adaptability
 
Quantum Leap in Next-Generation Computing
Quantum Leap in Next-Generation ComputingQuantum Leap in Next-Generation Computing
Quantum Leap in Next-Generation Computing
 
JavaScript Usage Statistics 2024 - The Ultimate Guide
JavaScript Usage Statistics 2024 - The Ultimate GuideJavaScript Usage Statistics 2024 - The Ultimate Guide
JavaScript Usage Statistics 2024 - The Ultimate Guide
 
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
 
Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and Insight
 
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 

Cg Pipeline

  • 1. CG Pipelines [V|K|GUPTA]
  • 2. 1 2 The term "pipe" was introduced in A pipe is an input-output data structure that eliminates the need for program A to write a computer jargon with the development of stream of data to a file that will be read and processed by program B. UNIX. 3 4 The concept of moving computer data And so "CG process" became "CG workflows" and these became "CG pipelines” through a series of software modules became work process by progressing the work product through a series of specialized workers. The Pipeline Story
  • 3. People Process Tools Dimensions of a Pipeline
  • 4. Pre Production Line Production Asset Build Shot Build Editorial Look Build Finishing CG Pipeline Categories
  • 7. Version Approved File Server Live Data Retake Publish Revise Reviewer Retake Revision Published Assets Artist Approved Work & Data Flow
  • 8. Design Model Surface Rigging Cascading Pipeline
  • 9. Model Design Surface Rigging Modular Pipeline
  • 10. The traditional way of thinking about a pipeline is the production pipeline. • Production Pipeline is modeled after post-industrial assembly systems where workers specialize in a given task. • The assembly line is a system where the work product moves past a series of work stations at a fixed speed, forcing each specialty to be constrained to a fixed duration and narrow set of skills. • Computer graphics is unlikely to achieve the efficiency of automated manufacturing line, but the concept of specialization has been embraced. • CG production is of phased nature, like model construction, motion construction, lighting, shading, rendering and compositing to break up the work. • Not all work missions will support the same production pipeline profile. Production Pipeline
  • 11. Data Management Asset Management Review Management An asset management system forms the You need to figure out deadlines, who signs off on Every CG environment involves the heart and mind of the data pipeline. what, and stick to it. delivery of a product, a shot, a sequence or a complete show. An asset management system allows Almost everyone works better in collaboration, so users to figure out who is saying "Yes" to an element, or Along the way assets are gathered and calling a retake. intermediate assets or work products are constructed. Track the progress Review management system will track approvals, retakes, progress etc and feeds the production Assets used as inputs may include with status of the show. footage, stills, and reference materials. Navigate assets A key material in any pipeline comprises the One person's output becomes the next Find task / relationships aggregate of direction and instructions about a person's input. Hence the need for particular work product (a shot or element of a pipeline. shot at the finest level). Controls the versions and revisions. Managing the flow of materials through Managing this data involves collecting, organizing the studio is an important sub-pipeline. and distributing the information to the right persons. It involves a decision loop, the approval pipeline is itself a looped pipeline with an iterative nature. Pipeline Essentials
  • 12. Resource Management Naming Convention If you have a bulletproof naming system, you A render farm, storage and servers are are vital can write batch scripts that automate large for large productions. amounts of painful work. You need lots of storage space, and you need it Moving directories, renaming files, secure that is, someone makes rotating backups categorization, even simple compositing tasks or automated backups. (burn-in, watermarks, etc.). Depending on what you can get for servers, it In some environments this was not really may be preferable to have the artists copy the possible, so the more you're able to automate data locally to work on it, instead of reading it stuff, the easier life gets. off the server which is also being read from and written to by the render farm. This also will help the asset management system identify relationship for each shot. A job queue is essential to farm jobs to the servers. Pipeline Essentials
  • 13. A CG pipeline belongs to one of three classes: • production (task) primary • material (data) secondary • approval (meta-data) tertiary • A CG pipeline is comprised of three structural dimensions: • People • Process • Tools • A CG pipeline utilizes technology but is not the technology • A CG pipeline divides a work-flow into separate and meaningful tasks assigned to two or more persons • A CG pipeline tasks divisions are determined using a tree of specialization across the three dimensions • The CG pipeline structural form is dictated by • The business purpose • Resource availability • Studio culture • A CG pipeline is malleable CG Pipeline Summary
  • 14. Selected Credits V K GUPTA | CG Pipeline Architect | Twitter @kgvinnakota | Linkedin http://in.linkedin.com/in/vkgupta