Khronos Munich 2018 - Halcyon and Vulkan

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Halcyon + Vulkan
Munich Khronos Meetup
Graham Wihlidal
SEED – Electronic Arts

“PICA PICA”
 Exploratory mini-game & world
 Goals
 Hybrid rendering with DXR [Andersson 2018]
 Clean and consistent vi...

HALCYON

Halcyon Goals
 Rapid prototyping framework
 Different purpose than Frostbite
 Fast experimentation vs. AAA games
 Wind...

Halcyon Goals
 Minimize or eliminate busy-work
 Artist “meta-data” meshes
 Occlusion
 GI / Lighting
 Collision
 Leve...

Halcyon Goals
 Only target modern APIs
 Direct3D 12
 Vulkan 1.1
 Metal 2
 Multi-GPU
 Explicit heterogeneous mGPU
 N...

Halcyon Goals
 Local or remote streaming
 Minimal boilerplate code
 Variety of rendering techniques and approaches
 Ra...

Hybrid Rendering
S E E D // Halcyon + Vulkan
Direct Shadows
(ray trace or raster)
Direct Lighting
(compute)
Reflections
(r...

Hybrid Rendering

Rasterization Only

Halcyon Goals
 “PICA PICA” and Halcyon built from scratch
 Implemented lots of bespoke technology
 Minimal effort to ad...

Rendering Components
 Render Backend
 Render Device
 Render Handles
 Render Commands
 Render Graph
 Render Proxy
S E...

Rendering Components
S E E D // Halcyon + Vulkan
Render Handles
Render Commands
Render Backend
Render Device
Render Backen...

Render Backend

Render Backend
 Live-reloadable DLLs
 Enumerates adapters and capabilities
 Swap chain support
 Extensions (i.e. ray t...

Render Backend
 Provides debugging and profiling
 RenderDoc integration, validation layers, …
 Create and destroy rende...

Render Backend
S E E D // Halcyon + Vulkan
 Direct3D 12
 Vulkan 1.1
 Metal 2
 Proxy
 Mock

Render Backend
S E E D // Halcyon + Vulkan
 Direct3D 12
 Shader Model 6.X
 DirectX Ray Tracing
 Bindless Resources
 E...

Render Backend
S E E D // Halcyon + Vulkan
 Vulkan 1.1
 Sub-groups
 Descriptor indexing
 External memory
 Multi-draw ...

Render Backend
S E E D // Halcyon + Vulkan
 Metal 2
 Early development
 Primarily desktop
 Argument buffers
 Machine ...

Render Backend
S E E D // Halcyon + Vulkan
 Proxy
 Not discussed in this presentation

Render Backend
S E E D // Halcyon + Vulkan
 Mock
 Performs resource tracking and validation
 Command stream is parsed a...

Render Device

Render Device
S E E D // Halcyon + Vulkan
 Abstraction of a logical GPU adapter
 e.g. VkDevice, ID3D12Device, …
 Provid...

Render Device
S E E D // Halcyon + Vulkan
 Ownership of GPU resources
 Create & Destroy
 Lifetime tracking of resources...

Render Handles

S E E D // Halcyon + Vulkan
Render Handles
 Resources associated by handle
 Lightweight (64 bits)
 Constant-time lookup...

S E E D // Halcyon + Vulkan
Render Handles
ID3D12Resource ID3D12Resource
DX12: Adapter 2
ID3D12Resource
DX12: Adapter 3
ID...

S E E D // Halcyon + Vulkan
Render Handles
 Can query if a device has a handle loaded
 Safely add and remove devices
 H...

S E E D // Halcyon + Vulkan
Render Handles
 Shared resources are supported
 Primary device owner, secondaries alias prim...

S E E D // Halcyon + Vulkan
Render Handles
 Can also mix and match backends in the same process!
 Made debugging VK impl...

Render Commands

Render Commands
 Draw
 DrawIndirect
 Dispatch
 DispatchIndirect
 UpdateBuffer
 UpdateTexture
 CopyBuffer
 CopyText...

Render Commands
 Queue type specified
 Spec validation
 Allowed to run?
 e.g. draws on compute
 Automatic scheduling
...

Render Commands
S E E D // Halcyon + Vulkan

Render Command List
 Encodes high level commands
 Tracks queue types encountered
 Queue mask indicating scheduling rule...

Render Compilation
 Render command lists are “compiled”
 Translation to low level API
 Can compile once, submit multipl...

Render Graph

Render Graph
 Inspired by FrameGraph [O’Donnell 2017]
 Automatically handle transient resources
 Import explicitly mana...

Render Graph
 Basic memory management
 Not targeting current consoles
 Fine grained memory reuse sub-optimal with curre...

Render Graph
 Frame Graph  Render Graph: No concept of a “frame”
 Fully automatic transitions and split barriers
 Sing...

Render Graph
 Composition of multiple graphs at varying frequencies
 Same GPU: async compute
 mGPU: graphs per GPU
 Ou...

$Render Graph  Composition of multiple graphs at varying frequencies  e.g. translucency, refraction, global illumination ...$

Render Graph
 Two phases
 Graph construction
 Specify inputs and outputs
 Serial operation (by design)
 Graph evaluat...

 Construction phase
 Evaluation phase

Render Graph
 Automatic profiling data
 GPU and CPU counters per-pass
 Works with mGPU
 Each GPU is profiled
S E E D /...

Render Graph
 Live debugging overlay
 Evaluated passes in-order of execution
 Input and output dependencies
 Resource ...

Render Graph
Some of our render graph passes:
S E E D // Halcyon + Vulkan
 Bloom
 BottomLevelUpdate
 BrdfLut
 CocDeriv...

Shaders

Shaders
 Complex materials
 Multiple microfacet layers
 [Stachowiak 2018]
 Energy conserving
 Automatic Fresnel betwe...

Shaders
 Exclusively HLSL
 Shader Model 6.X
 Majority are compute shaders
 Performance is critical
 Group shared memo...

Shaders
 No reflection
 Avoid costly lookups
 Only explicit bindings
 … except for validation
 Extensive use of HLSL ...

Shaders
S E E D // Halcyon + Vulkan
SPIR-VDXIL
Vulkan 1.1Direct3D 12
ISPCMSL
SPIRV-CROSS
AVX2, …Metal 2
DXC
HLSL

Shader Arguments
 Commands refer to resources with “Shader Arguments”
 Each argument represents an HLSL space
 MaxShade...

Shader Arguments
 Each argument contains:
 “ShaderViews” handle
 Constant buffer handle and offset
 “ShaderViews”
 Co...

Shader Arguments
 Constant buffers are all dynamic
 Avoid temporary descriptors
 Just a few large buffers, offsets chan...

Vulkan Implementation
 Architecture simplified development effort
 Vulkan specific:
 Backend and device implementation
...

Vulkan Implementation
S E E D // Halcyon + Vulkan

Vulkan Implementation
S E E D // Halcyon + Vulkan

Vulkan Implementation
S E E D // Halcyon + Vulkan

Vulkan Implementation
S E E D // Halcyon + Vulkan

Vulkan Implementation
S E E D // Halcyon + Vulkan

Vulkan Implementation
S E E D // Halcyon + Vulkan

Vulkan Implementation
S E E D // Halcyon + Vulkan

Vulkan Implementation
S E E D // Halcyon + Vulkan

Vulkan! 

Vulkan! 

Vulkan! 

Vulkan Implementation
 Shader compilation (HLSL  SPIR-V)
 Patch SPIR-V to match DX12
 Using spirv-reflect from Hai and...

SPIR-V Patching
 SPV_REFLECT_RESOURCE_FLAG_SRV
 Offset += 1000
 SPV_REFLECT_RESOURCE_FLAG_SAMPLER
 Offset += 2000
 SP...

SPIR-V Patching
 SPV_REFLECT_RESOURCE_FLAG_CBV
 Offset Unchanged: 0
 Descriptor Set += MAX_SHADER_ARGUMENTS
 CBVs move...

SPIR-V Patching
S E E D // Halcyon + Vulkan
 If 2 of 4 HLSL spaces in use:
Unbound
SRVs (>=1000) UAVs (>=3000)Samplers (>...

Vulkan Implementation
 Translate commands
 Read command list
 Write Vulkan API
S E E D // Halcyon + Vulkan

S E E D // Halcyon + Vulkan

S E E D // Halcyon + Vulkan

Ongoing Work!
VK nearing DX12

Tools

Tools
 RenderDoc
 NV Nsight
 AMD RGP
S E E D // Halcyon + Vulkan

S E E D // Halcyon + Vulkan

Tools
S E E D // Halcyon + Vulkan

Tools
S E E D // Halcyon + Vulkan
 C++ Export!
 Standalone

Dear ImGui + ImGuizmo
 Live tweaking
 Very useful!
S E E D // Halcyon + Vulkan

References
S E E D // Halcyon + Vulkan
 [Stachowiak 2018] Tomasz Stachowiak. “Towards Effortless Photorealism Through Rea...

Thanks
 Matthäus Chajdas
 Rys Sommefeldt
 Timothy Lottes
 Tobias Hector
 Neil Henning
 John Kessenich
 Hai Nguyen
...

Thanks
 SEED
 Johan Andersson
 Colin Barré-Brisebois
 Jasper Bekkers
 Joakim Bergdahl
 Ken Brown
 Dean Calver
 Dir...

S E E D / / S E A R C H F O R E X T R A O R D I N A R Y E X P E R I E N C E S D I V I S I O N
S T O C K H O L M – L O S A ...

Questions?

Share Slideshare

LinkedIn
Facebook
Twitter

Embed

Size (px)

Show related Slideshows at end

WordPress Shortcode

Link

Share
Email

2024 Trend Updates: What Really Wor... by Search Engine Jou... 1033581 views
Storytelling For The Web: Integrate... by Chiara Aliotta 945137 views
Artificial Intelligence, Data and C... by OECD Directorate ... 865593 views
How to Leverage AI to Boost Employe... by SocialHRCamp 363144 views
2024 State of Marketing Report – by... by Marius Sescu 206375 views
Everything You Need To Know About C... by Expeed Software 226977 views

View on Slideshare

1 of 93 Ad

View on Slideshare

1 of 93 Ad