AI for Art Generation / Dave Savio (Artifactory.ai)

•Download as PPTX, PDF•

1 like•105 views

I will talk about Generative AI and its applications to 2D art production in the gaming industry. We will explore the Stable Diffusion neural net and concepts such as Prompt Engineering, Image-to-Image, ControlNet, and Dreambooth and how they can enhance game development. Moreover, we will compare the pros and cons of Stable Diffusion with Midjourney. As a result, you will better understand the potential benefits of incorporating generative AI into your game development workflow.

Design

AI FOR ART GENERATION
https://edvice.pro
Dave Savio
Jun 13, 2023

ABOUT ME
Dave Savio
Senior Data Scientist
- The company creates Mobile Games
- 500M Downloads
Head of AI & CPO
- Raised $5M
- Launched a voice assistant for gamers
- Was successfully acquired in 2021
Founder
- An early-stage startup exploring AI for Art Generation in
Games
- https://artifactory.ai/

GENERATIVE AI
ChatGPT, Midjourney, RunwayML Gen-2, TTS, Nvidia 3D Gen

MIDJOURNEY
Cons:
●Doesn’t know about your
game style
●Stores generated images
●Discord UI
●Copyright?
Pros:
●Short Prompts
●Quality out of the box
A mobile game asset of a house, exterior,
isometric - no land, trees, interior

ADOBE FIREFLY
Cons:
●Doesn’t know about your
game style
●Copyright?
Pros:
●Integrated with Photoshop
●Trained on Stock Images
Source

STABLE DIFFUSION
Cons:
●Long prompts
●Requires GPUs
●Copyright?
Pros:
●You can train the model for
your game style
●Doesn’t store your assets
Source

Text-to-Image
Diffusion Process:
●Gaussian Noise
●UNet Denoiser
●CLIP Conditioning
●VAE Decompression
Source

Prompt Engineering
●a cat
●a cat, pencil art
Source

Prompt Engineering
●a cat
●a cat, pencil art
●a cat, pencil art, blue eyes
Source

Inpainting
a cat with mouse ears, pencil art

male character character set world of warcraft ii,
in the style of rendered in unreal engine, dark
sky-blue and dark indigo, strong lighting
contrasts, gustave buchet, heavy texture, the
new fauves, uhd image
Game Style?

Dreambooth &
LORA
●https://civitai.com/
●https://docs.artifactory.ai/style-transfer-
with-dreambooth
●https://github.com/bmaltais/kohya_ss
Source

THANK YOU!
Dave Savio
Still have questions?
Book a consultation with me on Edvice.
Contacts
ds@artifactory.ai
https://www.linkedin.com/in/dave-savio/
https://t.me/savostyanov_dmitry

What's hot

Using Generative AI

Mark DeLoura

Generative AI models, such as ChatGPT and Stable Diffusion, can create new and original content like text, images, video, audio, or other data from simple prompts, as well as handle complex dialogs and reason about problems with or without images. These models are disrupting traditional technologies, from search and content creation to automation and problem solving, and are fundamentally shaping the future user interface to computing devices. Generative AI can apply broadly across industries, providing significant enhancements for utility, productivity, and entertainment. As generative AI adoption grows at record-setting speeds and computing demands increase, on-device and hybrid processing are more important than ever. Just like traditional computing evolved from mainframes to today’s mix of cloud and edge devices, AI processing will be distributed between them for AI to scale and reach its full potential. In this presentation you’ll learn about: - Why on-device AI is key - Full-stack AI optimizations to make on-device AI possible and efficient - Advanced techniques like quantization, distillation, and speculative decoding - How generative AI models can be run on device and examples of some running now - Qualcomm Technologies’ role in scaling on-device generative AI

Generative AI at the edge.pdf

Qualcomm Research

Generative AI

lutzsuarnaba1

generative-ai-fundamentals and Large language models

AdventureWorld5

Exploring Opportunities in the Generative AI Value Chain.pdf

Dung Hoang

Generative artificial intelligence (AI) models are reinventing communication, content creation, and information access. In this roadmap, presented at Bessemer's annual Seed Summit, Partner Talia Goldberg explores the technological advancements driving AI solutions and how these changes are opening up new promising area of investment. Learn more about Generative AI: https://www.bvp.com/atlas/is-ai-gener... https://www.bvp.com/atlas/roadmap-the... https://www.bvp.com/atlas/entering-th... Subscribe for venture insights: https://bessemervp.team/subscribe About Bessemer Venture Partners — We help entrepreneurs lay strong foundations to build and forge long-standing companies. With more than 135 IPOs and 200 portfolio companies in the enterprise, consumer and healthcare spaces, Bessemer supports founders and CEOs from their early days through every stage of growth. Our global portfolio includes Pinterest, Shopify, Twilio, Yelp, LinkedIn, PagerDuty, DocuSign, Wix, Fiverr and Toast, and has more than $20 billion of assets under management. Connect with us — Subscribe to our channel: https://bit.ly/3oVeW4k Visit our website bvp.com: https://bit.ly/3bzFXaE Sign up for our newsletter: https://bit.ly/3SoVY3D Find Bessemer on LinkedIn: https://bit.ly/3zZpGoS Find Bessemer on Twitter: https://bit.ly/3JsVJAF Find Bessemer on Instagram: https://bit.ly/3BH8but

Is AI generation the next platform shift?

Bessemer Venture Partners

For this plenary talk at the Charlotte AI Institute for Smarter Learning, Dr. Cori Faklaris introduces her fellow college educators to the exciting world of generative AI tools. She gives a high-level overview of the generative AI landscape and how these tools use machine learning algorithms to generate creative content such as music, art, and text. She then shares some examples of generative AI tools and demonstrate how she has used some of these tools to enhance teaching and learning in the classroom and to boost her productivity in other areas of academic life.

An Introduction to Generative AI - May 18, 2023

CoriFaklaris1

An overview of the most important AI capabilities in marketing, advertising and content creation. I made this presentation to inform, educate and inspire people in the creative industries to familiarise themselves with the incredible toolsets that are already here and in development. I also explain how generative Ai works explore some possible new roles and business models for agencies. Hope you enjoy it!

The Creative Ai storm

Leandro Righini

Generative AI and law.pptx

Chris Marsden

Leveraging Generative AI: Opportunities, Risks and Best Practices

Social Samosa

The Future is in Responsible Generative AI

Saeed Al Dhaheri

Artificial Intelligence Introduction & Business usecases

Vikas Jain

The current state of generative AI

Benjaminlapid1

Prompt Engineering

Manjunatha Sai

Generative AI has dominated the headlines recently, which has caused many enterprises to put a full stop to implementing this technology until they can understand what’s behind the glitz and glamour. What if we shifted the conversation? What if the focus became a fresh, incremental approach to embracing the opportunities with generative artificial intelligence to keep organizations moving upward on the S Curve of Growth? Brands stay relevant and solve complex problems by testing the barometer for one thing — will a new strategy, tool, or piece of technology improve humanity? Human connections are more vital than using shiny new tools or technology. As your teams work to steer clear of the temptation to do what everyone else is doing in uniform, this post will highlight how to stand out, compete, and do so with less risk in today’s world of generative AI overload.

A Framework for Navigating Generative Artificial Intelligence for Enterprise

RocketSource

𝐆𝐞𝐧𝐞𝐫𝐚𝐭𝐢𝐯𝐞 𝐀𝐈: 𝐂𝐡𝐚𝐧𝐠𝐢𝐧𝐠 𝐇𝐨𝐰 𝐁𝐮𝐬𝐢𝐧𝐞𝐬𝐬 𝐈𝐧𝐧𝐨𝐯𝐚𝐭𝐞𝐬 𝐚𝐧𝐝 𝐎𝐩𝐞𝐫𝐚𝐭𝐞𝐬

VINCI Digital - Industrial IoT (IIoT) Strategic Advisory

Through a comprehensive exploration, this talk would intend to uncover the inner workings of GANs and demystify their training process. This talk shall help you gain insights into the different types of GANs, such as conditional GANs and style-based GANs, and how they contribute to the advancement of generative AI. To truly appreciate the significance of GANs, this talk will also discuss their wide-ranging industrial applications, spanning image synthesis, video generation, data augmentation, and virtual reality.

Exploring Generative AI with GAN Models

KonfHubTechConferenc

In this presentation, we will delve into the exciting applications of Generative AI across various business domains. Leveraging the capabilities of artificial intelligence and machine learning, Generative AI allows for dynamic, context-aware user interfaces that adapt in real-time to provide personalized user experiences. We will explore how this transformative technology can streamline design processes, facilitate user engagement, and open the doors to new forms of interactivity.

Generative AI Use-cases for Enterprise - First Session

Gene Leybzon

The deep learning AI revolution has been sweeping the world for a decade now. Deep neural nets are routinely used for tasks like translation, fraud detection, and image classification. PwC estimates that they will create $15.7 trillion/year of value by 2030. But most current networks are "discriminative" in that they directly map inputs to predictions. This type of model requires lots of training examples, doesn't generalize well outside of its training set, creates inscrutable representations, is subject to adversarial examples, and makes knowledge transfer difficult. People, in contrast, can learn from just a few examples, generalize far beyond their experience, and can easily transfer and reuse knowledge. In recent years, new kinds of "generative" AI models have begun to exhibit these desirable human characteristics. They represent the causal generative processes by which the data is created and can be compositional, compact, and directly interpretable. Generative AI systems that assist people can model their needs and desires and interact with empathy. Their adaptability to changing circumstances will likely be required by rapidly changing AI-driven business and social systems. Generative AI will be the engine of future AI innovation.

The Future of AI is Generative not Discriminative 5/26/2021

Steve Omohundro

As generative AI adoption grows at record-setting speeds and computing demands increase, hybrid processing is more important than ever. But just like traditional computing evolved from mainframes and thin clients to today’s mix of cloud and edge devices, AI processing must be distributed between the cloud and devices for AI to scale and reach its full potential. In this talk you’ll learn: • Why on-device AI is key • Which generative AI models can run on device • Why the future of AI is hybrid • Qualcomm Technologies’ role in making hybrid AI a reality

The future of AI is hybrid

Qualcomm Research

What's hot (20)

Using Generative AI

Generative AI at the edge.pdf

Generative AI

generative-ai-fundamentals and Large language models

Exploring Opportunities in the Generative AI Value Chain.pdf

Is AI generation the next platform shift?

An Introduction to Generative AI - May 18, 2023

The Creative Ai storm

Generative AI and law.pptx

Leveraging Generative AI: Opportunities, Risks and Best Practices

The Future is in Responsible Generative AI

Artificial Intelligence Introduction & Business usecases

The current state of generative AI

Prompt Engineering

A Framework for Navigating Generative Artificial Intelligence for Enterprise

Exploring Generative AI with GAN Models

Generative AI Use-cases for Enterprise - First Session

The Future of AI is Generative not Discriminative 5/26/2021

The future of AI is hybrid

Similar to AI for Art Generation / Dave Savio (Artifactory.ai)

Careers in Philippine Game Development

Kevin Codamon

G3 GDC 2015 - Bringing Western Mobile Games to China

keithm9

Unreal Engine Course - MAGES Institute

Michael512473

Moonsubmarine Presentation @ Mobilesoft 2015

Luca Galli

Meta 3D Studios Art Experience

Billy Joe Cain

Artificial Intelligence_ How is it significant to the gaming industry_.pdf

Anil

Videogames: Raising Interactive Digital Entertainment Industry

Marlin Sugama

Au ggj intro2017_no_theme

Christopher Totten

My Presentation.ppt

Fake474384

Jongwings offers design and development of software applications, games, and web services. Jongwings was initiated back in 2012, as a designing studio and in 2013 we took a leap forward and added development services to our arsenal be an one point of contact for Your web & mobile app/games development. we are HQ in Madurai, TN .SpecialtiesGraphic Desings, 3D&2D Design and Animations, ios & Android App Development, ios & Android Game development

Jongwingsmobilegamedevelopmentcompany

Jongwings

company profile @Juegostudio

Cartic P

Invokers studios game_prez_v3

Alexey Surkov

We are a mobile app and game development studio based in New Delhi, India. A are a 2.5 year old studio with a team of 15+ passionate developers and creatives. We have worked with various startups and SME's from India, US, Singapore, Australia, etc. We have worked with various startups in helping them from brainstorming stage to user retention and beyond. Some of the startups we have worked with are feeontime, partiko, Bottlefinder, pawforce, etc. You can contact us for any of your game development related services on hello@DaphnisLabs.com Skype: samanyuchopra

Daphnis Labs Game Development Portfolio

Samanyu Chopra

Resume Standard

Jared Krinsky

What Are The Reasons Behind Unity 3 D’s Popularity For Games - BR Softech

B R SOFTECH PVT LTD

Studio presentation

Pinal Didwania

An Introduction To Game development

Ahmed

Production job roles

Samuel Hayman

So you (think you) want to work in video games

Sven Charleer

Generative AI refers to using artificial intelligence (AI) for creating new game content - whether that be characters, environments, stories or mechanics. Generative AI offers more realistic, immersive and engaging results than traditional methods can. According to Market.us, the global Generative AI Gaming Market was valued at USD 922 Million in 2022 with anticipated compound annual compounded annual growth estimated to average 23.3% from 2032-2036 resulting in incremental revenues estimated to total $7105 Million by 2032. Market forces include increased consumer demands for more immersive and realistic gameplay experiences as well as increasing popularity of cloud and mobile gaming technologies. Key Takeaways 1. Generative AI is used in gaming to create a variety of content, including characters, environments, and stories. 2. The technology can be used to generate realistic and immersive content that can help to improve the player experience. 3. Generative AI is also being used to create new gaming experiences, such as games that are tailored to the individual player's preferences. 4. By technique, the nondeterministic technique segment generated the largest revenue share in 2022. 5. By function, the non-player character (NPCs) dominated the market with a revenue share of 35.2% in 2022. 6. By end-user, the gaming studios segment dominated the market with a revenue share of 51% in 2022. 7. In 2022, Asia Pacific dominated the market with the highest revenue share of 34%. Market Trends - The increasing demand for more realistic and immersive gaming experiences is one of the key trends driving the growth of the generative AI in gaming market. - The rising popularity of cloud gaming and mobile gaming is also contributing to the growth of the market. - The increasing adoption of artificial intelligence (AI) in other industries, such as the film and television industry, is also creating new opportunities for the generative AI in gaming market. Rising Demands The demand for more realistic and immersive gaming experiences is increasing as gamers demand games that are more engaging and visually stunning. Generative AI can be used to create realistic and immersive content that can help to improve the player experience. For example, generative AI can be used to create realistic character models, environments, and textures. Increasing Uses Generative AI is being used in a variety of ways in gaming, including: - Creating realistic character models - Generating environments - Creating stories - Designing levels - Developing game mechanics The technology is also being used to create new gaming experiences, such as games that are tailored to the individual player's preferences.

How Generative AI is Improving Game Development?

Market.us

Similar to AI for Art Generation / Dave Savio (Artifactory.ai) (20)

Careers in Philippine Game Development

G3 GDC 2015 - Bringing Western Mobile Games to China

Unreal Engine Course - MAGES Institute

Moonsubmarine Presentation @ Mobilesoft 2015

Meta 3D Studios Art Experience

Artificial Intelligence_ How is it significant to the gaming industry_.pdf

Videogames: Raising Interactive Digital Entertainment Industry

Au ggj intro2017_no_theme

My Presentation.ppt

Jongwingsmobilegamedevelopmentcompany

company profile @Juegostudio

Invokers studios game_prez_v3

Daphnis Labs Game Development Portfolio

Resume Standard

What Are The Reasons Behind Unity 3 D’s Popularity For Games - BR Softech

Studio presentation

An Introduction To Game development

Production job roles

So you (think you) want to work in video games

How Generative AI is Improving Game Development?

More from DevGAMM Conference

The art of small steps, or how to make sound for games in conditions of war /...

DevGAMM Conference

Are you tired of being in a stagnant relationship with your game's audio system? Our team felt the same way, so we broke up with FMOD and started seeing Metasounds instead. We had to navigate some challenges during the transition, but we built custom editor scripts to automate certain processes, and we found that while FMOD made it easier to design sounds and music, Unreal provides fewer bugs. And while both Unreal Audio and Metasounds have their quirks, we decided to take matters into our own hands and build our own custom tools and features to make the workflow as efficient as we can.. Our bumpy journey from transitioning to Unreal Audio is not without any problems, but we feel like we are on the right track. We have the flexibility to create the sounds we want and take our game's audio to new heights. So if you're ready to break free from your boring audio engine, join us as we share our story of breaking up with FMOD and embracing the wacky world of Metasounds.

Breaking up with FMOD - Why we ended things and embraced Metasounds / Daniel ...

DevGAMM Conference

As "3D Audio" is rapidly becoming a sought out feature in games, it's no longer enough to just define a channel-based mix. The benefits of using Audio Objects quickly outshine having to squeeze all sounds into a fixed channel format, by delivering the best possible spatial precision no matter the output and can even be hardware accelerated with certain systems. In this talk, you'll get a quick introduction to the concept and benefits of Object-based Audio and then we'll go hands-on and create, edit and profile Audio Objects in Wwise.

How Audio Objects Improve Spatial Accuracy / Mads Maretty Sønderup (Audiokine...

DevGAMM Conference

GameDev community has very mixed feeling about hyper-casual in general Some admire it, majority don't understand and hates it 3 years ago it was really strange market filled with questionable people, low-quality projects and a lot of hype Years have passed, industry matured, adequate business ethics established And most important, this is not about mobile anymore! Almost every publisher have PC (Steam) or Console department right now They are porting successful mobile hits to our favourite platforms Combine it with very fast passed and data driven production cycles, opportunity to try different staff on monthly or even weekly basis and you get perfect environment to apply your passion of making great games and predictable financial conditions

Why indie developers should consider hyper-casual right now / Igor Gurenyov (...

DevGAMM Conference

In this talk we'll cover the complexities of the AI/ML landscape and what that means for independent studios. We'll look at tools for image, text, video, and multimedia and how these tools could be used to help smaller studios stand out in a competitive landscape. We'll also explore the potential legal and ethical ramifications of utilizing these tools and provide a roadmap for how to navigate this tumultuous ocean of technology

AI / ML for Indies / Tyler Coleman (Retora Games)

DevGAMM Conference

Agile processes have been widely adopted in software development for over a decade, but their adoption in game development studios is relatively new. In this talk, Epam Management experts Ganna Ivanicheva and Boris Lesun will discuss the benefits of adopting Agile processes in game development studios, drawing from their expertise and industry research. They will also explore the similarities and differences between software and game development processes, and common pain points studios face. Additionally, the speakers will delve into the acceleration of game development processes due to the adoption of artificial intelligence (AI).

Agility is the Key: Power Up Your GameDev Project Management with Agile Pract...

DevGAMM Conference

This session is jam-packed with valuable info. Explore the software that will make your life easier in PR, sales and other forms of outreach. Discover the latest software tools for finding emails, tracking replies, scheduling demos, and more. Explore AI-powered writing technology that will elevate your messaging. Leave with a wealth of options and practical tips to streamline your workflow and boost productivity

New PR Tech and AI Tools for 2023: A Game Changer for Outreach / Kirill Perev...

DevGAMM Conference

Playable Ads - Revolutionizing mobile games advertising / Jakub Kukuryk (Popc...

DevGAMM Conference

Does managing an art team differ from managing any other team? This speech is based on personal experience in managing an art team. It is a story about forging and sustaining a healthy and trusting atmosphere that allows artistic growth. It is about a collaborative team culture, clear communication, professional development, and alignment with project goals. Discover how focusing on these areas has allowed us to create a space where personal goals can help achieve the project goals.

Creative Collaboration: Managing an Art Team / Nastassia Radzivonava (Glera G...

DevGAMM Conference

Join Jan Kuhlmann, Marketing Manager for Europe at Xsolla, as he shares his expertise on taking your game to new heights. Discover the power of incorporating payments and direct-to-consumer strategies, and learn how to effectively connect with players globally. With Xsolla's fully customizable solutions, you'll have the tools to tailor your game to your players' specific needs, resulting in increased revenue and profitability.

From Local to Global: Unleashing the Power of Payments / Jan Kuhlmannn (Xsolla)

DevGAMM Conference

Strategies and case studies to grow LTV in 2023 / Julia Iljuk (Balancy)

DevGAMM Conference

Why is ASO not working in 2023 and how to change it? / Olena Vedmedenko (Keya...

DevGAMM Conference

How to increase wishlists & game sales from China? Growth marketing tactics &...

DevGAMM Conference

Turkish Gaming Industry and HR Insights / Mustafa Mert EFE (Zindhu)

DevGAMM Conference

When scaling up creative production, one of the biggest headaches is ensuring consistent quality, managing a higher volume of iterations, onboarding and training new team members, and handling unexpected challenges. In this discussion, we will explore real-life case studies that provide strategies for streamlining the scaling process while prioritizing mental well-being and maintaining quality standards.

Building an Awesome Creative Team from Scratch, Capable of Scaling Up / Sasha...

DevGAMM Conference

Seven Reasons Why Your LiveOps Is Not Performing / Alexander Devyaterikov (Be...

DevGAMM Conference

In this talk, we'll explore the power of music collaborations and how they can help reach and engage gameindustries’ audience. With music and games being among the most popular entertainments among the youthful demographic, so they make a perfect match. We'll share real-life examples of how games are using music collabs to captivate players and drive success. From game soundtracks to in-game events, we'll show how to use music to connect with audience in meaningful ways and turn it into essential tool for every developer and publisher.

The Power of Game and Music Collaborations: Reaching and Engaging the Masses ...

DevGAMM Conference

Branded Content: How to overcome players' immunity to advertising / Alex Brod...

DevGAMM Conference

Discover the story behind the impressive remastering of Chasm: The Rift, originally developed by Ukrainian developer Action Forms. In this talk, we unravel the challenges of reverse engineering, asset restoration, and game mechanic reconstruction. Learn how our team breathed new life into this cult classic, overcoming the absence of the original source code to create a captivating modern gaming experience. Witness video game preservation in action, as we celebrate and cherish digital heritage.

Resurrecting Chasm: The Rift - A Source-less Remastering Journey / Gennadii P...

DevGAMM Conference

In the end of 2022 we hosted Midnight Show, a cinematic showcase event with announcements of our new projects. But before we started the broadcast, it was almost 2 years of preparations and development, two weeks of filming and lots of mistakes we made during production of this show and projects that were announced. In this talk Andrew, original author, director and producer of Midnight Show, will tell about its history and what you definitely shouldn't do if you come up with idea to make your own showcase event.

How NOT to do showcase events: Behind the scenes of Midnight Show / Andrew Ko...

DevGAMM Conference

More from DevGAMM Conference (20)