SlideShare a Scribd company logo
https://www.google.com/url?
ARTIFICIAL
INTELLIGENCE
Renaldas Zioma
Unity Labs
Machine Learning and the future of content creation and art.
Gentle overview for Artists.
AI TO EMPOWER THE ARTIST
© Blutgruppe/Corbis
NEW CREATIVE TOOLS ARE COMING
https://www.youtube.com/watch?v=xwsMjX8IuGkVideo:
NEW CREATIVE TOOLS
#1 ARTISTIC EXPLORATION
Learning a Manifold of Fonts
Neill D.F. Campbell and Jan Kautz
ARTISTIC EXPLORATION
FONTS
http://bit.ly/2iW3xjaOnline demo:
ARTISTIC EXPLORATION
DESIGN
Create Anime Characters with A.I
Y. Jin, J. Zhang, M. Li, Y. Tian, H. Zhu www.youtube.com/watch?v=PUkQbGaL4FgVideo:
ARTISTIC EXPLORATION
DESIGN
http://bit.ly/2ibeMHuOnline demos: http://make.girls.moe
ARTISTIC EXPLORATION
FACE
Progressive Growing of GANs
T. Karras, T. Aila, S. Laine, J. Lehtinen http://bit.ly/2k6VlQpVideo:
ARTISTIC EXPLORATION
FACE IN 3D
http://bit.ly/2naBPDWOnline demo:
Progressive Growing of GANs
T. Karras, T. Aila, S. Laine, J. Lehtinen
ARTISTIC EXPLORATION
FACE MATH
Unsupervised Representation Learning with DCGAN
A. Radford, L. Metz, S. Chintala
ARTISTIC EXPLORATION
FORM
Exploring 3D Shapes using Autoencoder
N. Umetani, Autodesk Research http://bit.ly/2jsTth3Video:
ARTISTIC EXPLORATION
STYLE
Deep Photo Style Transfer
F. Luan, S. Paris, E. Shechtman, K. Bala. Adobe research
ORIGINAL STYLE RESULT
ARTISTIC EXPLORATION
STYLE
http://stylit.orgDemo:
StyLit
J. Fišer, O. Jamriška, M Lukáč, Adobe Research
COPYRIGHT 2016 @ UNITY TECHNOLOGIES
Image courtesy of AMGunnersFC as uploaded on reddit
NEW CREATIVE TOOLS
#2 ASSET SEARCH
NEW CREATIVE TOOLS
#3 ACCELERATORS & REFINERS
ACCELERATORS & REFINERS
GUIDE RAY-TRACER
NVIDIA Iray and image is courtesy of NVIDIA NVIDIA Iray AI Announcement link
ACCELERATORS & REFINERS
UPSCALER
Super Resolution using Deep Learning
A. J. Champandard
ACCELERATORS & REFINERS
UPSCALER
http://bigjpg.comOnline demo:
ACCELERATORS
FLUID SOLVER
www.youtube.com/watch?v=w71zxkniJfoVideo:
FluidNet
J. Tompson, K. Schlachter, P. Sprechmann, K. Perlin
NEW CREATIVE TOOLS
#4 ROBO ARTISTS
ROBO ARTISTS
SKETCH ☛ IMAGE
Pix2Pix
P. Isola, J. Zhu, T. Zhou, A. Efros
https://affinelayer.com/pixsrv/Online demo:
Super Resolution using Deep Learning
A. J. Champandard
ROBO ARTISTS
TEXTURE VARIATIONS
ROBO ARTISTS
DE-LIGHTING
http://bit.ly/unity-delightingDownload from Unity Asset Store:
ROBO ARTISTS
ENVIRONMENT SYNTHESIS
www.youtube.com/watch?v=5w685udM838Video:
Example Based Terrain Authoring /w CGAN
E. Guerin, J. Digne, E. Galin, A. Peytavie, C. Wolf, B Benes, B Martinez
NEW CREATIVE TOOLS
#5 ANIMATION SYNTHESIS
ROBO ARTISTS
ANIMATION SYNTHESIS
www.youtube.com/watch?v=86fC31nv8eMVideo:
DeepLoco
X. Peng, G. Berseth, K Yin, M. Panne
RNN, ANIMATIONS
Video link
Video link
Video link
Video link
ANIMATION SYNTHESIS
FAKE NEWS
www.youtube.com/watch?v=9Yq67CjDqvwVideo:
Synthesizing Obama: learn Lipsync from Audio
S. Suwajanakorn, S. Seitz, I Kemelmacher
NEW CREATIVE TOOLS
SUMMARY
• Artistic exploration
• Search
automatic asset tagging, search by example
• Acceleration
upscale, denoise, fluid/erosion solvers, approximate GI
• Automatisation
variations, colorization, delighting, previz tools
• Animation synthesis
WHAT DOES AI SEE?
Feature Visualization
C. Olah, A. Mordvintsev, L. Schubert. Google Brain
WHAT DOES AI SEE?
MEANING
LAYERS OF INTERLINKED
NEURON CELLS
TRAINED ON MILLIONS OF IMAGES
WHAT DOES AI SEE?
Feature Visualization
C. Olah, A. Mordvintsev, L. Schubert. Google Brain Layer 2
WHAT DOES AI SEE?
Layer 3
Feature Visualization
C. Olah, A. Mordvintsev, L. Schubert. Google Brain
WHAT DOES AI SEE?
Layer 5
Feature Visualization
C. Olah, A. Mordvintsev, L. Schubert. Google Brain
WHAT DOES AI SEE?
Layer 6
Feature Visualization
C. Olah, A. Mordvintsev, L. Schubert. Google Brain
WHAT DOES AI SEE?
Layer 8
Feature Visualization
C. Olah, A. Mordvintsev, L. Schubert. Google Brain
HOW DOES IT WORK?
AI ARCHITECTURES
UPSCALER
AI ARCHITECTURES
DEEP DREAM
AI ARCHITECTURES
STYLE TRANSFER
AI ARCHITECTURES
GENERATIVE ADVERSARIAL (GAN)
GENERATOR
DISCRIMINATOR
?
AI ARCHITECTURES
RECURSIVE
AI ARCHITECTURES
MIX MODALITIES
MEANING
FEATURESIMAGE
AUDIO
BONUS
USE RENDERED IMAGES TO TRAIN AI
BONUS
TO CLOSE THE LOOP
Assets by FINWARD STUDIOS
New Tools for Art and Content - Artificial Intelligence and Machine Learning

More Related Content

Similar to New Tools for Art and Content - Artificial Intelligence and Machine Learning

Portfolio in action: Reflecting on presentations
Portfolio in action: Reflecting on presentationsPortfolio in action: Reflecting on presentations
Portfolio in action: Reflecting on presentations
Kristina D.C. Hoeppner
 
In thelooppresentationfinalfinal
In thelooppresentationfinalfinalIn thelooppresentationfinalfinal
In thelooppresentationfinalfinalKatya Hott
 
Электронное тело пою. Образ человека в медиаискусстве.
Электронное тело пою. Образ человека в медиаискусстве.Электронное тело пою. Образ человека в медиаискусстве.
Электронное тело пою. Образ человека в медиаискусстве.Régine Grig
 
7 Overriding Themes Spotted Among Cannes Lions 2014 Winners
7 Overriding Themes Spotted Among Cannes Lions 2014 Winners7 Overriding Themes Spotted Among Cannes Lions 2014 Winners
7 Overriding Themes Spotted Among Cannes Lions 2014 Winners
Natalia Hatalska
 
Halloween Activities, Apps, & Resources for Teens
Halloween Activities, Apps, & Resources for TeensHalloween Activities, Apps, & Resources for Teens
Halloween Activities, Apps, & Resources for Teens
Shelly Sanchez Terrell
 

Similar to New Tools for Art and Content - Artificial Intelligence and Machine Learning (6)

Portfolio in action: Reflecting on presentations
Portfolio in action: Reflecting on presentationsPortfolio in action: Reflecting on presentations
Portfolio in action: Reflecting on presentations
 
In thelooppresentationfinalfinal
In thelooppresentationfinalfinalIn thelooppresentationfinalfinal
In thelooppresentationfinalfinal
 
Anne hall presentation_vid
Anne hall presentation_vidAnne hall presentation_vid
Anne hall presentation_vid
 
Электронное тело пою. Образ человека в медиаискусстве.
Электронное тело пою. Образ человека в медиаискусстве.Электронное тело пою. Образ человека в медиаискусстве.
Электронное тело пою. Образ человека в медиаискусстве.
 
7 Overriding Themes Spotted Among Cannes Lions 2014 Winners
7 Overriding Themes Spotted Among Cannes Lions 2014 Winners7 Overriding Themes Spotted Among Cannes Lions 2014 Winners
7 Overriding Themes Spotted Among Cannes Lions 2014 Winners
 
Halloween Activities, Apps, & Resources for Teens
Halloween Activities, Apps, & Resources for TeensHalloween Activities, Apps, & Resources for Teens
Halloween Activities, Apps, & Resources for Teens
 

More from Renaldas Zioma

Overview of AI Startups in Lithuania
Overview of AI Startups in LithuaniaOverview of AI Startups in Lithuania
Overview of AI Startups in Lithuania
Renaldas Zioma
 
Trip down the GPU lane with Machine Learning
Trip down the GPU lane with Machine LearningTrip down the GPU lane with Machine Learning
Trip down the GPU lane with Machine Learning
Renaldas Zioma
 
Practical AI in Games
Practical AI in GamesPractical AI in Games
Practical AI in Games
Renaldas Zioma
 
THE BLACKSMITH demo: Bridging the Gap between Realtime and Offline CG
THE BLACKSMITH demo: Bridging the Gap between Realtime and Offline CGTHE BLACKSMITH demo: Bridging the Gap between Realtime and Offline CG
THE BLACKSMITH demo: Bridging the Gap between Realtime and Offline CG
Renaldas Zioma
 
Unite2014: Mastering Physically Based Shading in Unity 5
Unite2014: Mastering Physically Based Shading in Unity 5Unite2014: Mastering Physically Based Shading in Unity 5
Unite2014: Mastering Physically Based Shading in Unity 5
Renaldas Zioma
 
FMX2013: Butterfly Effect
FMX2013: Butterfly EffectFMX2013: Butterfly Effect
FMX2013: Butterfly Effect
Renaldas Zioma
 

More from Renaldas Zioma (7)

Overview of AI Startups in Lithuania
Overview of AI Startups in LithuaniaOverview of AI Startups in Lithuania
Overview of AI Startups in Lithuania
 
Trip down the GPU lane with Machine Learning
Trip down the GPU lane with Machine LearningTrip down the GPU lane with Machine Learning
Trip down the GPU lane with Machine Learning
 
Practical AI in Games
Practical AI in GamesPractical AI in Games
Practical AI in Games
 
THE BLACKSMITH demo: Bridging the Gap between Realtime and Offline CG
THE BLACKSMITH demo: Bridging the Gap between Realtime and Offline CGTHE BLACKSMITH demo: Bridging the Gap between Realtime and Offline CG
THE BLACKSMITH demo: Bridging the Gap between Realtime and Offline CG
 
Unite2014: Mastering Physically Based Shading in Unity 5
Unite2014: Mastering Physically Based Shading in Unity 5Unite2014: Mastering Physically Based Shading in Unity 5
Unite2014: Mastering Physically Based Shading in Unity 5
 
FMX2013: Butterfly Effect
FMX2013: Butterfly EffectFMX2013: Butterfly Effect
FMX2013: Butterfly Effect
 
Buttefly
ButteflyButtefly
Buttefly
 

Recently uploaded

UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
DianaGray10
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
DanBrown980551
 
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
DianaGray10
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
Alpen-Adria-Universität
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance
 
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdfSAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
Peter Spielvogel
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
Prayukth K V
 
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 202420240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
Matthew Sinclair
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
Ana-Maria Mihalceanu
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
James Anderson
 
Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1
DianaGray10
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance
 
A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...
sonjaschweigert1
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
91mobiles
 
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
Neo4j
 
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Nexer Digital
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Albert Hoitingh
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Paige Cruz
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
Aftab Hussain
 

Recently uploaded (20)

UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
 
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
 
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdfSAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
 
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 202420240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
 
Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
 
A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
 
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
 
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
 

New Tools for Art and Content - Artificial Intelligence and Machine Learning