SlideShare a Scribd company logo
1 of 49
「 CG Magic: レンダリング」
のコンセプト

イミテーションに終わらない
創造性のある技術開発

技法の裏側にある本質
をさぐる
レンダリング技術最前線

   Physically-based VS. Image-based


 Physically-based ( Subsurface Scattering   )
Image-based ( Recovering Reflectance, etc )
Subsurface Scattering
Subsurface Scattering
Subsurface Scattering
             (multi-scattering)
   Diffusion
Subsurface Scattering

   Light Transport Equation




   Diffusion Equation
Subsurface Scattering
   Diffusion equation の解法

    1995   Jos Stam   multi-grid method


方程式を解かずに解を得る方法はないか?
Subsurface Scattering
   Diffusion equation の解法
  2001 Henrik Wann Jensen
  Medical Physics   (Transport Theory)

領域が無限であれば、一つの点光源を解としても
 つ
Subsurface Scattering
   Diffusion equation の解法

 実際には領域は無限ではない
  (片側が閉じている)
     ↓
 境界部分でプラスマイナスの収支が合うように
 仮想的な「負」の点光源を領域の上側に置く
Subsurface Scattering
   Dipole model   http://graphics.ucsd.edu/~henrik/
Subsurface Scattering
   Multi-scattering  の  Reflectance
Subsurface Scattering
   パラメーターの置き換え
    (mean free path, albedo)
Subsurface Scattering
   Dipole Model の実用化 ( 映画での実装)

ILM (Christophe Hery)
   Dipole Model
      +
テクスチャを用いたコントロール v


「 Harry Potter2(2002) 」
「 Lemony Snicket(2004) 」
「 Star Wars3(2005) 」
「 Pirates of Caribbean2,3(2006,2007) 」
Subsurface Scattering
   Multi-scattering  の  Transmittance
Subsurface Scattering
 Multi-scattering  の  Transmittance
Blue Sky Studio
「ホートンふしぎな世界のダレダーレ( 2008) 」
Subsurface Scattering
   Multi-scattering  の  Transmittance

    Transmittance の場合には、上下の両方が
    閉じている。
                  ↓
    上下両方の境界部分で、
    プラスマイナスの収支が合うように、
    仮想光源の配置を繰り返す。
Subsurface Scattering
仮想光源の配置
上境界




下境界
 Multipole Model
Craig Donner(2005)
http://www.cs.columbia.edu/~cdonner/pubs.shtml
Subsurface Scattering
   Multi-Layer model
Subsurface Scattering
   Multi-Layer model


            ↓  フーリエ変換




                                  Transmittance



                        Reflectance
Subsurface Scattering
 物体表面上の位置の変化による
subsurface scattering の効果の変化

 物理パラメーターは同一に設定して計算
              ↓
Albedo Map のピクセル値を用いてスケールを掛ける
( multi-scattering   = diffusion = 混ぜ合わせの計算
                                   ↓
                    Albedo Map もフィルタリング)

 
Subsurface Scattering
   Multi-Layer model
Albedo Map を用いたコントロール
Subsurface Scattering
   Human Skin Model
↓




    +   =
Subsurface Scattering
   Human skin ( メラニン、ヘモグロビンの影響を正確にシミュ
  レート)
    Craig Donner(2006)
Subsurface Scattering
   GPU   Human Skin
NVIDIA(2007) “A System for Efficient Rendering of   Human
    Skin”


  * Multi-layer   Model をガウス基底の線形結合に分解
    * Diffusion の計算は2 D でおこない3 D モデルにマッ
    ピング

                     ↓

        前計算を必要としないリアルタイム処理へ
Subsurface Scattering
   GPU   Human Skin
Subsurface Scattering
   Multi-Scattering in Hair
“Dual Scattering Approximation for Fast Multiple
  Scattering in Hair”(2008)
http://cg.cs.uni-bonn.de/project-pages/hairmodeling/



      Multi-Scattering in Hair
                  ↓
global multi-scattering +  local multi-
  scattering.
Subsurface Scattering
   Human Hair Model
Stephen Marshner(2003)
“Light Scattering from Human Hair Fibers”
Subsurface Scattering
   Multi-Scattering in Hair
Subsurface Scattering
   Multi-Scattering in Hair
Recovering Reflectance
   Light Field(4D)



   Reflectance Field(6D)
Recovering Reflectance

   Lightstage (Paul Debevec 2000) www.debevec.org
Recovering Reflectance

   Lightstage( 視点の変化への対応)
    ディフューズ成分とスペキュラー成分の分離
    (視点に変化に対して別々に変換)
Recovering Reflectance

 Lightstage( 変形への対応)
Tim Hawkins(2004)
Recovering Reflectance
   Lightstage( 映画での実装)
Mark Sager
「 Spider-Man2 」( 2004)
Recovering Reflectance
   Reflectance の検証
       Shree Nayar ( 2006 )
“Fast Separation of Direct and Global Components of a Scene using High
   Frequency Illumination”
http://www1.cs.columbia.edu/CAVE/projects/ separation/
Recovering Reflectance

   Reflectance の検証
Recovering Reflectance

   Hair Photobooth ( 2008 )
 http://people.csail.mit.edu/sparis/publi/2008/siggraphHair/
撮影画像を用いて髪の毛のジオメトリと質感を復元する。
Recovering Reflectance
   Hair Photobooth
Recovering   Appearance
   Light Field Display ( Depth Illusion の効果)
Micro-lens Camera
Ren Ng(2005)  
Recovering   Appearance
   Light Field Display
Liquid Lens Array ( 2008 東大苗村研)
   http://www.varioptic.com/en/index.php
Recovering   Appearance
Depth Illusion
HDR Photo bubbles( 「 Speed Racer 」
 ( 2008 ))
Recovering   Appearance
   Depth Illusion
Recovering Reflectance
   Reflectance Field Display
Recovering Reflectance
   Reflectance Field Display
Ramesh Raskar(2008)
“Towards Passive 6D Reflectance Field Displays”
Image-based Lighting

   Image-Based Lighting
             ↓
   HDR 環境マップを用いた Global Illumination
             ↓
   Precomputed Radiance Transfer
     ( Spherical Harmonics を用いた Lighting
    /Rendering)
Subsurface Scattering
   Multi-Scattering in Hair
“Efficient Multiple Scattering in Hair Using Spherical Harmonics”(2008)

More Related Content

What's hot

CVPR2019 読み会「Understanding the Limitations of CNN-based Absolute Camera Pose ...
CVPR2019 読み会「Understanding the Limitations of CNN-based Absolute Camera Pose ...CVPR2019 読み会「Understanding the Limitations of CNN-based Absolute Camera Pose ...
CVPR2019 読み会「Understanding the Limitations of CNN-based Absolute Camera Pose ...Sho Kagami
 
フォトンマッピング入門
フォトンマッピング入門フォトンマッピング入門
フォトンマッピング入門Shuichi Hayashi
 
ICCV19読み会 "Learning Single Camera Depth Estimation using Dual-Pixels"
ICCV19読み会 "Learning Single Camera Depth Estimation using Dual-Pixels"ICCV19読み会 "Learning Single Camera Depth Estimation using Dual-Pixels"
ICCV19読み会 "Learning Single Camera Depth Estimation using Dual-Pixels"Hajime Mihara
 
CVPR2019読み会 "A Theory of Fermat Paths for Non-Line-of-Sight Shape Reconstruc...
CVPR2019読み会 "A Theory of Fermat Paths  for Non-Line-of-Sight Shape Reconstruc...CVPR2019読み会 "A Theory of Fermat Paths  for Non-Line-of-Sight Shape Reconstruc...
CVPR2019読み会 "A Theory of Fermat Paths for Non-Line-of-Sight Shape Reconstruc...Hajime Mihara
 
GN-Net: The Gauss-Newton Loss for Deep Direct SLAMの解説
GN-Net: The Gauss-Newton Loss for Deep Direct SLAMの解説GN-Net: The Gauss-Newton Loss for Deep Direct SLAMの解説
GN-Net: The Gauss-Newton Loss for Deep Direct SLAMの解説Masaya Kaneko
 
輪読発表資料: Efficient Virtual Shadow Maps for Many Lights
輪読発表資料: Efficient Virtual Shadow Maps for Many Lights輪読発表資料: Efficient Virtual Shadow Maps for Many Lights
輪読発表資料: Efficient Virtual Shadow Maps for Many Lightsomochi64
 
Copy and-paste networks for deep video inpainting
Copy and-paste networks for deep video inpaintingCopy and-paste networks for deep video inpainting
Copy and-paste networks for deep video inpainting邦洋 長谷川
 
(文献紹介)HDR+, Night Sight
(文献紹介)HDR+, Night Sight(文献紹介)HDR+, Night Sight
(文献紹介)HDR+, Night SightMorpho, Inc.
 
Visual SLAM: Why Bundle Adjust?の解説(第4回3D勉強会@関東)
Visual SLAM: Why Bundle Adjust?の解説(第4回3D勉強会@関東)Visual SLAM: Why Bundle Adjust?の解説(第4回3D勉強会@関東)
Visual SLAM: Why Bundle Adjust?の解説(第4回3D勉強会@関東)Masaya Kaneko
 
SLAM勉強会(3) LSD-SLAM
SLAM勉強会(3) LSD-SLAMSLAM勉強会(3) LSD-SLAM
SLAM勉強会(3) LSD-SLAMIwami Kazuya
 
SLAMチュートリアル大会資料(ORB-SLAM)
SLAMチュートリアル大会資料(ORB-SLAM)SLAMチュートリアル大会資料(ORB-SLAM)
SLAMチュートリアル大会資料(ORB-SLAM)Masaya Kaneko
 
20180929 sfm learner&vid2_depth_print
20180929 sfm learner&vid2_depth_print20180929 sfm learner&vid2_depth_print
20180929 sfm learner&vid2_depth_printKUMIKO Suzuki
 
"Spectral graph reduction for efficient image and streaming video segmentatio...
"Spectral graph reduction for efficient image and streaming video segmentatio..."Spectral graph reduction for efficient image and streaming video segmentatio...
"Spectral graph reduction for efficient image and streaming video segmentatio...Shunya Ueta
 
レイトレ合宿5 スライド
レイトレ合宿5 スライドレイトレ合宿5 スライド
レイトレ合宿5 スライドSho Ikeda
 

What's hot (17)

CVPR2019 読み会「Understanding the Limitations of CNN-based Absolute Camera Pose ...
CVPR2019 読み会「Understanding the Limitations of CNN-based Absolute Camera Pose ...CVPR2019 読み会「Understanding the Limitations of CNN-based Absolute Camera Pose ...
CVPR2019 読み会「Understanding the Limitations of CNN-based Absolute Camera Pose ...
 
フォトンマッピング入門
フォトンマッピング入門フォトンマッピング入門
フォトンマッピング入門
 
Global Illumination
Global IlluminationGlobal Illumination
Global Illumination
 
ICCV19読み会 "Learning Single Camera Depth Estimation using Dual-Pixels"
ICCV19読み会 "Learning Single Camera Depth Estimation using Dual-Pixels"ICCV19読み会 "Learning Single Camera Depth Estimation using Dual-Pixels"
ICCV19読み会 "Learning Single Camera Depth Estimation using Dual-Pixels"
 
CVPR2019読み会 "A Theory of Fermat Paths for Non-Line-of-Sight Shape Reconstruc...
CVPR2019読み会 "A Theory of Fermat Paths  for Non-Line-of-Sight Shape Reconstruc...CVPR2019読み会 "A Theory of Fermat Paths  for Non-Line-of-Sight Shape Reconstruc...
CVPR2019読み会 "A Theory of Fermat Paths for Non-Line-of-Sight Shape Reconstruc...
 
GN-Net: The Gauss-Newton Loss for Deep Direct SLAMの解説
GN-Net: The Gauss-Newton Loss for Deep Direct SLAMの解説GN-Net: The Gauss-Newton Loss for Deep Direct SLAMの解説
GN-Net: The Gauss-Newton Loss for Deep Direct SLAMの解説
 
輪読発表資料: Efficient Virtual Shadow Maps for Many Lights
輪読発表資料: Efficient Virtual Shadow Maps for Many Lights輪読発表資料: Efficient Virtual Shadow Maps for Many Lights
輪読発表資料: Efficient Virtual Shadow Maps for Many Lights
 
Copy and-paste networks for deep video inpainting
Copy and-paste networks for deep video inpaintingCopy and-paste networks for deep video inpainting
Copy and-paste networks for deep video inpainting
 
(文献紹介)HDR+, Night Sight
(文献紹介)HDR+, Night Sight(文献紹介)HDR+, Night Sight
(文献紹介)HDR+, Night Sight
 
CG2013 13
CG2013 13CG2013 13
CG2013 13
 
Visual SLAM: Why Bundle Adjust?の解説(第4回3D勉強会@関東)
Visual SLAM: Why Bundle Adjust?の解説(第4回3D勉強会@関東)Visual SLAM: Why Bundle Adjust?の解説(第4回3D勉強会@関東)
Visual SLAM: Why Bundle Adjust?の解説(第4回3D勉強会@関東)
 
SLAM勉強会(3) LSD-SLAM
SLAM勉強会(3) LSD-SLAMSLAM勉強会(3) LSD-SLAM
SLAM勉強会(3) LSD-SLAM
 
CG2013 10
CG2013 10CG2013 10
CG2013 10
 
SLAMチュートリアル大会資料(ORB-SLAM)
SLAMチュートリアル大会資料(ORB-SLAM)SLAMチュートリアル大会資料(ORB-SLAM)
SLAMチュートリアル大会資料(ORB-SLAM)
 
20180929 sfm learner&vid2_depth_print
20180929 sfm learner&vid2_depth_print20180929 sfm learner&vid2_depth_print
20180929 sfm learner&vid2_depth_print
 
"Spectral graph reduction for efficient image and streaming video segmentatio...
"Spectral graph reduction for efficient image and streaming video segmentatio..."Spectral graph reduction for efficient image and streaming video segmentatio...
"Spectral graph reduction for efficient image and streaming video segmentatio...
 
レイトレ合宿5 スライド
レイトレ合宿5 スライドレイトレ合宿5 スライド
レイトレ合宿5 スライド
 

Viewers also liked

Learning theorist project
Learning theorist projectLearning theorist project
Learning theorist projectoliviareich
 
Cognitivsm
CognitivsmCognitivsm
CognitivsmUlfa
 
Cognitivism theory
Cognitivism theoryCognitivism theory
Cognitivism theoryTiffy374
 
Introducing cognitivism as a learning theory
Introducing cognitivism as a learning theoryIntroducing cognitivism as a learning theory
Introducing cognitivism as a learning theoryRita Ndagire Kizito
 
Teresa B. - Cognitivism
Teresa B. - CognitivismTeresa B. - Cognitivism
Teresa B. - Cognitivismmandysmama
 
Cognitivism
CognitivismCognitivism
Cognitivismslezelle
 

Viewers also liked (10)

Learning theorist project
Learning theorist projectLearning theorist project
Learning theorist project
 
Cognitivsm
CognitivsmCognitivsm
Cognitivsm
 
COGNITIVISM THEORY
COGNITIVISM THEORYCOGNITIVISM THEORY
COGNITIVISM THEORY
 
Cognitivism theory
Cognitivism theoryCognitivism theory
Cognitivism theory
 
Introducing cognitivism as a learning theory
Introducing cognitivism as a learning theoryIntroducing cognitivism as a learning theory
Introducing cognitivism as a learning theory
 
Teresa B. - Cognitivism
Teresa B. - CognitivismTeresa B. - Cognitivism
Teresa B. - Cognitivism
 
Cognitivism
CognitivismCognitivism
Cognitivism
 
Cognitivism
CognitivismCognitivism
Cognitivism
 
Theories of Learning
Theories of LearningTheories of Learning
Theories of Learning
 
Cognitive Learning Theory
Cognitive Learning TheoryCognitive Learning Theory
Cognitive Learning Theory
 

2008年6月21日倉地紀子講演「SIG-GT11 『CG Magic:レンダリング』に見るレンダリングの最新事情」資料