Discover the technology behind "The Heretic" – Unite Copenhagen 2019
•Download as PPTX, PDF•
1 like•258 views
Unity's award-winning Demo team, creators of Adam and Book of the Dead, showcases how Unity can power high-end visuals for game productions. These slides show how the team used the latest features in the High Definition Render Pipeline such as Post Processing, Shader Graph, Visual Effect Graph, and Timeline to create their latest amazing real-time short film, The Heretic. Speaker: Mark Schoennagel – Unity Watch the session on YouTube: https://youtu.be/CCnhPyK1v9E
Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Similar to Discover the technology behind "The Heretic" – Unite Copenhagen 2019
Similar to Discover the technology behind "The Heretic" – Unite Copenhagen 2019 (20)
More from Unity Technologies
More from Unity Technologies (20)
Recently uploaded
Recently uploaded (20)
Discover the technology behind "The Heretic" – Unite Copenhagen 2019
- 2. Discover the Technology behind ‘The Heretic’ Mark Schoennagel @Unity3dMarks Lead Evangelist - Unity Technologies
- 3. The Blacksmith - 2015 Adam - 2016 Book of the Dead - 2018
- 6. Realistic Digital Humans - Concept Art 6
- 7. 7 Process Static 3D scan Neutral + FACS 4D Capture Clean 4D data Combine Snappers snapperstech.com russian3dscanner.com http://ir-ltd.net/ Infinite Realities Russian3DScanner Actor
- 8. Realistic Digital Humans - Combined Results 8 Mesh Only Mesh & Textures
- 9. Realistic Digital Humans - Attachment System 9 Attachments Only Skin & Attachments
- 10. Realistic Digital Humans - HDRP Shaders 10 Skin: Modified HDRP StackLit Using Sub-Surface Scattering Eyes: Custom Forward Lit Hair: Shader Graph’s Hair Master Node
- 11. Realistic Digital Humans - Lighting Setup 11 Environment Lights Only Character Lights Only
- 12. Realistic Digital Humans - Lighting Setup 12 Environment & Character Lights
- 13. Lets take a look…
- 14. Realtime VFX: ‘Boston’ Wire Robot
- 15. Realtime VFX: ‘Boston’ Wire Robot - Concept Art 15
- 16. Realtime VFX: ‘Boston’ Wire Robot 16
- 17. Realtime VFX: ‘Boston’ Wire Robot 17
- 18. Realtime VFX: ‘Boston’ Wire Robot - Spline 18
- 19. Realtime VFX: ‘Boston’ Wire Robot - SDF Shape 19
- 20. Realtime VFX: Warp Transition 20
- 21. Realtime VFX: Warp Transition 21 Corridor Environment Cave Environment ?
- 22. Warp Transition - Slice Technology Design
- 23. Row of Slice Meshes Warp Transition - Slice Meshes One Slice Mesh
- 24. Warp Transition - Slice Meshes
- 25. 151 Slice MeshesWarp Transition - Slice Meshes One Slice Mesh
- 26. Warp Transition - Slice Meshes One Slice Mesh Cave/Corridor
- 27. Subscribe now for a 3-month free trial at unity.com/learn-premium with code: UNITECPH19 *Learn Premium is included in Unity Plus and Pro licenses. Just sign in with your Unity ID. Unity experts, live sessions, and more
- 28. Want to learn more? Tutorial: Particle System: Lights Tutorial: Post-Processing Effects (2018.x+) Tutorial: Introduction to the Post Processing Stack Subscribe now for a 3-month free trial at unity.com/learn- premium with code: UNITECPH19 *Learn Premium is included in Unity Plus and Pro licenses. Just sign in with your Unity ID.
- 29. Want to learn more? Tutorial: Introduction to Shader Graph Tutorial: Shader Graph: Color Node Project: Make a Flag Move with Shader Graph Subscribe now for a 3-month free trial at unity.com/learn- premium with code: UNITECPH19 *Learn Premium is included in Unity Plus and Pro licenses. Just sign in with your Unity ID.
- 30. Thank You! Mark Schoennagel @Unity3dMarks Lead Evangelist - Unity Technologies
Editor's Notes
- ‘The Heretic’ is the latest project from Unity’s award winning ‘Demo Team’. The Demo Team always aims to raise the bar of what is possible with Unity; for Graphics, Cinematics and Realtime Rendering. Previous works: - Blacksmith (2015): Physically Based Rendering - Adam (2016): Timeline & Post Processing - Book of The Dead (2018): HDRP for realistic forest & foliage
- ‘The Heretic’ tackles several different areas: - Continued development of the High Definition Render Pipeline; and the improvements it brings to graphics features. - The Data Pipeline & Workflow for rendering Realistic Digital Humans in Unity Sequencing Visual Effects in Unity; both pre-simulated and realtime simulated. - Editor Tools for creating Procedural visuals (Specifically for the Wire Robot and also the Warp Transition)
- Demo team wanted to own the entire pipeline. This is Gwain Actor performing Scanning Human All the way to the lighting / post processing the character Done as a research project Unity doesn’t make games, so we do projects like this to test our tools and workflows, address areas where needed
- Early concept art. Note items that didn’t change. Alembic – Strap on his “brief case” Vest Arm Notice the bird on his shoulder, that’s Boston
- What maps get generated where? Normal? Etc… 4D Capture: Scans the actor’s face every frame during the sequence. Similar to Photogrammetry; result is a mesh of every frame. Pro: Accurate face Shape, blood flow, skin deformation (Smile Example) But doesn’t give enough specific details (Wrinkles, pores, etc) FACS Poses: The Facial Action Coding System Capture of Extreme Poses of Actor’s Face Usually used as Blend Shapes Allows for better data of micro details; such as wrinkles and small bumps on the skin’s surface Both data sets then had to be cleaned up before they were then combined in Unity; with the best of both sets of data being used for the end result in both mesh and textures.
- Left Result: Mesh only in Unity HDRP Well defined frown, smile, cheek bones, etc as a result of the 4d scanned data and Right Result: With the Texture maps applied; the scanned data is a lot more visible. wrinkles on the forhead creases around the mouth. However, the character looks like a costume mask; with missing eyes, teeth, This was solved in a different way.
- Used a traditional approach for attaching eyes, mouth. EXCEPT this isnt a rig it’s a mesh. Used DOTS( Data Oriented Tech Stack)’ Jobs System and Burst, to resolve the position of the attachments instantaneously at RT As the character animates the attachments reposition themselves as the skin is dynamically deforming. This process happens every single frame; calculating the relation based on the closest set of triangles. The same technology was used for attaching the fur collar to the leather jacket; as the leather jacket is simulated using Alembic. Having the attachments seperately also allows them to be controlled seperately; such as adjusting the eyes.
- Skin – Modified HDRP Lit Shader and extended it Sub Surface Scattering with Diffusion Profiles. From the scanned data; they used Thickness Maps to determine how light ‘passes through’ the skin. This is noticeable with Gawain’s Ears when there is a bright/intense light source behind them. For the Eyes, customized the Forward Lit Shader. What they added was a custom Eye Renderer Script to control various properties of the eyes such as iris, pupil, cornea etc. The Shader Graph’s new HDRP Hair Master Node was used for the eyebrows and his stubble. This Master Node allows for extra control and details using shader outputs for smoothness, strand direction, diffusion profile, etc.
- Lighting is also very important when rendering Gawain. The left, realtime point lights and spotlight for the corridor environment. Gawain has separate lighting control for just his face. Notice Subsurface is picked up from Environment
- Combined, we can see that both lighting sets layer on top of each other for the end result. Lets now have a look at Gawain up-close in the editor, [Cut to Editor to Show Human Close Up and continue Editor Demo until Boston Tentacles Section]
- Little of Boston is pre baked
- Is a tool of Gwain, can open doors, is a camera,
- It’s the hand, the dream catcher
- Sine Distance Field
- [Cut to Editor to show the Warp Transition]
- If you want to continue learning, check out our learning platform at learn.unity.com. You’ll find free learning resources, and you can sign up for a special 3-month trial of Learn Premium - available for a limited time to Unite CPH attendees with this code - to access live sessions with Unity experts and the best learning resources updated for the latest Unity release. If you’re a Unity Plus or Pro user, Learn Premium is included in your license already, at no extra cost. Just sign in to learn.unity.com with your Unity ID.
- If you want to continue learning, check out our learning platform at learn.unity.com. You’ll find free learning resources, and you can sign up for a 30-day trial of Learn Premium to access live sessions with Unity experts, and the best learning resources updated for the latest Unity release.
- If you want to continue learning, check out our learning platform at learn.unity.com. You’ll find free learning resources, and you can sign up for a 30-day trial of Learn Premium to access live sessions with Unity experts, and the best learning resources updated for the latest Unity release.