Presentation and Live Demo for talk around "Creative AI" - ML to create Art, Jokes, Stories and Music given by Suyash Joshi at MLOps Online Meetup in Oct 2022 : https://mlops.community/watch/creative-ai---using-ml-to-create-art-music-and-jokes_we1vtxYZsrtLyr/

1. CREATIVEAI-ART,MUSIC,JOKE
USINGMODERNMLTECHNIQUES
MLOPS MEETUP - OCT 19 2022
SUYASH JOSHI (SUYASH@SUYASHJOSHI.COM)
@SUYASHCJOSHI
@MLOPSCOMMUNITY
#CREATIVEAI

2. - Creative Coder & Artist (Magician) currently
pursuing masters degree at Goldsmiths,
University of London and available for
consulting around AR/Mobile/Creative AI
- 10+ years of work experience in (Silicon Valley)
SF Bay Area as a software engineer
- BS in Computer Science from The Univ. of
Michigan
@suyashcjoshi
suyash@suyashjoshi.com
WHOAMI

3. Ref: https://www.reddit.com/r/dalle2/comments/wir4ao/comparison_of_dalle_midjourney_stable_diffusion/
IMAGE GENERATION MODELS
PROMPT

4. STATE OF AI ART IN 2022
Popular Generative Networks - 2022

5. PREVIOUS WORK …
AARON
Oldest AI Art system built using GOFAI in 1960’s
by Harold Cohen
Steven Thaler and/or Creativity Machine
Generative Art created by Zach Liberman
Ref: https://zachlieberman.medium.com/daily-sketches-2016-28586d8f008e

6. AI ART CONTROVERSIES
Edmond de Belamy
Christie’s sold its
fi
rst piece of auctioned AI art
for $432,500 in 2018. Original open source
authors got nothing :(
Steven Thaler and/or Creativity Machine
- In 2022, USA Copyright Office refused to
register the piece on the basis that it lacked “the
human authorship necessary to support a
copyright claim”.
- Getty Image banned AI generated Imagery
from their website to protect against Copyright
claims
In 2022, AI Art won the Colorado State Fair Art
Competition!

7. CONTROVERSIAL AI ART
- Prompt "A SEXY ROBOT WOMAN" USING
STABILITY AI'S DREAMSTUDIO
THE RESULT OF A PROMPT FOR "A SEXY ROBOT WOMAN" USING STABILITY AI'S DREAMSTUDIO
- Deep Fake Generated ‘Porn’ of real people -
non consensual etc
NFT Art inundated with AI generated Art work
FAKEORREAL?

8. VIDEO GENERATION MODELS
Ref: https://arxiv.org/pdf/2209.14792.pdf
Ref: https://makeavideo.studio

9. DEMOS
StyleGan3 - Collab
Stability AI - Tool
Stable Diffusion - GitHub

10. AIGENERATEDMUSIC
1stAIGeneratedSong“Daddy’sCar”bySonyCSLMusicTeamin2016

11. ALGORITHMICCOMPOSITION
https://coconet.glitch.me/
Google Magenta - Coconut

12. STYLETRANSFERBUTFORMUSIC
Ref: https://sites.research.google/tonetransfer
Ref: https://magenta.tensor
f
low.org/ddsp

13. 1. MUSIC INFORMATION RETRIEVAL
OTHERCREATIVEAIPOSSIBILITIES
2. TEXT + MUSIC : DEAR DIARY , HTTPS://SLIDESLIVE.COM/38941538/MUSICAL-DIARY-AI-APPLICATION-FOR-
MUSIC-MAKING-AND-JOURNALING
3. JOKE GENERATION (PUNS, MEMES)
4. NARRATIVE / NON FICTION STORY GENERATION
5. POETRY

14. ETHICAL & SOCIETAL CHALLENGES
1. Ownership : Who is the real author ?
2. Credit/Permission : Whose data were the ML Model(s) train on?
3. Accessibility : Is the technology limited to large enterprises or only certain users ?
4. JobDisplacement : Concept Artist, Illustrators, Animators, Musicians, Writers

15. @SUYASHCJOSHI - SUYASH@SUYASHJOSHI.COM
MIT’S COURSE ON DEEP CREATIVITY: HTTPS://ALI-DESIGN.GITHUB.IO/DEEPCREATIVITY/
RESOURCES
HOW TO WRITE A GOOD PROMPT : HTTPS://DECENTRALIZEDCREATOR.COM/WRITE-GOOD-PROMPTS-FOR-AI-ART-GENERATORS/
MUSIC AI GENERATION APPS: HTTPS://WWW.AUDIOCIPHER.COM/POST/AI-MUSIC-APP
ML ARTS CURATION (COURSE, ART WORK ETC) : HTTPS://ML4A.NET
TEXT TO SPEECH: HTTPS://GITHUB.COM/ML4A/ML4A/BLOB/MASTER/EXAMPLES/MODELS/TACOTRON2.IPYNB
HTTPS://AI.GOOGLEBLOG.COM/2017/12/TACOTRON-2-GENERATING-HUMAN-LIKE-SPEECH.HTML
CREATIVE AI DATABASE: https://creative-ai.org
RUNWAY ML OPEN SOURCE PROJECTS : HTTPS://RUNWAYML.COM/

16. QUESTIONS?
SUYASH JOSHI (SUYASH@SUYASHJOSHI.COM)
@SUYASHCJOSHI
@MLOPSCOMMUNITY
#CREATIVEAI