I will talk about Generative AI and its applications to 2D art production in the gaming industry. We will explore the Stable Diffusion neural net and concepts such as Prompt Engineering, Image-to-Image, ControlNet, and Dreambooth and how they can enhance game development. Moreover, we will compare the pros and cons of Stable Diffusion with Midjourney. As a result, you will better understand the potential benefits of incorporating generative AI into your game development workflow.

1. AI FOR ART GENERATION
https://edvice.pro
Dave Savio
Jun 13, 2023

2. ABOUT ME
Dave Savio
Senior Data Scientist
- The company creates Mobile Games
- 500M Downloads
Head of AI & CPO
- Raised $5M
- Launched a voice assistant for gamers
- Was successfully acquired in 2021
Founder
- An early-stage startup exploring AI for Art Generation in
Games
- https://artifactory.ai/

3. GENERATIVE AI
ChatGPT, Midjourney, RunwayML Gen-2, TTS, Nvidia 3D Gen

4. IMAGE GENERATION

5. MIDJOURNEY
Cons:
●Doesn’t know about your
game style
●Stores generated images
●Discord UI
●Copyright?
Pros:
●Short Prompts
●Quality out of the box
A mobile game asset of a house, exterior,
isometric - no land, trees, interior

6. ADOBE FIREFLY
Cons:
●Doesn’t know about your
game style
●Copyright?
Pros:
●Integrated with Photoshop
●Trained on Stock Images
Source

7. STABLE DIFFUSION
Cons:
●Long prompts
●Requires GPUs
●Copyright?
Pros:
●You can train the model for
your game style
●Doesn’t store your assets
Source

8. AUTOMATIC1111
Source

9. Text-to-Image
Diffusion Process:
●Gaussian Noise
●UNet Denoiser
●CLIP Conditioning
●VAE Decompression
Source

10. Prompt Engineering
●a cat
Source

11. Prompt Engineering
●a cat
●a cat, pencil art
Source

12. Prompt Engineering
●a cat
●a cat, pencil art
●a cat, pencil art, blue eyes
Source

13. Image-to-Image
a cat, blue eyes

14. ControlNet
a cat, pencil art, blue eyes

15. Inpainting
a cat with mouse ears, pencil art

16. male character character set world of warcraft ii,
in the style of rendered in unreal engine, dark
sky-blue and dark indigo, strong lighting
contrasts, gustave buchet, heavy texture, the
new fauves, uhd image
Game Style?

17. Dreambooth &
LORA
●https://civitai.com/
●https://docs.artifactory.ai/style-transfer-
with-dreambooth
●https://github.com/bmaltais/kohya_ss
Source

18. THANK YOU!
Dave Savio
Still have questions?
Book a consultation with me on Edvice.
Contacts
ds@artifactory.ai
https://www.linkedin.com/in/dave-savio/
https://t.me/savostyanov_dmitry

19. Live
Example?