Expecto Patronum!
Stable Diffusion!
咒語和他們的原理
甚麼是 Stable diffusion?
唸咒 => 產出圖片
其他對手: MidJourney
爲什麼爆紅?
- 簡單易用沒 whitelist
- 可以自己架(去年你買到顯卡的話)
- NovelAI leak WAIFU
甚麼是 Stable diffusion?
產出圖片
修改圖片
Inpainting/Outpainting
開始唸咒吧
本日嘉賓 - 異短惡貓
開始唸咒吧
https://beta.dreamstudio.ai/dream
https://huggingface.co/spaces/stabilityai/stable-diffusion
開始唸咒吧
https://beta.dreamstudio.ai/dream
https://huggingface.co/spaces/stabilityai/stable-diffusion
開始唸咒吧
開始唸咒吧
開始唸咒吧
開始唸咒吧
所以結果會是這樣
來看看咒語
爲什麼
+1girl
+best quality
- lowres
- poorly drawn
- bad proportions
就能產出好圖? (Novel AI)
注意:NSFW
or…
https://laion.ai/blog/laion-aesthetics/
How to train your model
Input:
Image => image
embedding
Text => text embedding
Output:
Embeddings that
matches
https://openai.com/blog/cl
ip/
Model - Stable Diffusion overview
Model - Prerequisite - Neural Networks
ML Lecture 6: Brief Introduction of Deep Learning
https://www.youtube.com/watch?v=Dr-WRlEFefw
Model - Prerequisite - Convolutional Neural Networks
【機器學習2021】卷積神經網路 (Convolutional Neural
Networks, CNN)
https://www.youtube.com/watch?v=OP5HcXJg2Aw
Model - Prerequisite - Autoencoders
【機器學習2021】自編碼器 (Auto-encoder) (上) – 基本概念
https://www.youtube.com/watch?v=3oHlf8-J3Nc
Model - Prerequisite - Natural Language Processing
ML Lecture 14: Unsupervised Learning - Word
Embedding
https://www.youtube.com/watch?v=X7PH3NuYW0Q
【機器學習2021】自注意力機制 (Self-attention) (上)
https://www.youtube.com/watch?v=hYdO9CscNes
【機器學習2021】Transformer (上)
https://www.youtube.com/watch?v=
n9TlOhRjYoc
【機器學習2021】自督導式學習 (Self-supervised Learning)
(二) – BERT簡介
https://www.youtube.com/watch?v=gh0hewYkjgo
Model - Diffusions
Adding Gaussian noise
Denoising to obtain image
Model - Diffusions
https://jalammar.github.io/illustrated-stable-diffusion/
Model - Diffusion - Read more
https://zhuanlan.zhihu.com/p/563543020
https://lilianweng.github.io/posts/2021-07-11-diffusion-mod
els/
https://angusturner.github.io/generative_models/2021/06/2
9/diffusion-probabilistic-models-I.html
https://ayandas.me/blog-tut/2021/12/04/diffusion-prob-mod
els.html
看完了記住要教我
自己跑咒語
https://github.com/invoke-ai/InvokeAI
換 model
E.g. https://huggingface.co/hakurei/waifu-diffusion
https://invoke-ai.github.io/InvokeAI/
升級了 macos 跑不了,囧
https://github.com/pytorch/pytorch/issues/777
54

Expecto Patronum! Stable Diffusion!