Video Super Resolution (VSR) 是一個用來放大影片很多倍的技術，大部分的情況下是讓影片的長與寬都各放大 4 倍左右，也就是整個影片被放大了 4x4 = 16 倍之譜。這個分享的主題圍繞在 VSR 套用在高品質的影片，特別是那些來自電影或是電視劇的影片時，以較嚴格的角度來審視，它能做到多好的成效，離哪些商業應用的情境有多遠。內容始於 VSR 的特性與介紹，透過學術論文研究，以實際的電影/電視劇影片來實驗與調校，會帶來大量的圖片與影片，同時進一步提出可能的應用與限制。是一個聲光效果非常強的分享，看過的人應該都不會忘 : ) https://cloudsummit.ithome.com.tw/2023/session-page/1986

1. Dr. 官順暉 (Drake Guan)
超解析度影片成像技術
(Video Super Resolution)
# Machine Learning # Generative AI

2. ● KKCompany Technologies
AI Research
● BlendVision (KKStream)
Video Encoding System
Recommender System
● Digimax Inc.
Animation Pipeline
3-D Rendering & Pipeline
● National Taiwan University
Computer Graphics
Computational Photography

3. 核 心 技 術
KKCompany 核心技術透過「串流、
雲端、大數據與人工智慧」，結合顧問
服務滿足企業需求，不僅為客戶建構串
流平台，透過獨家研發軟體技術與累積
豐富服務經驗，整合大數據分析，導入
多元應用情境，帶動產業數位轉型

4. KKCompany Technologies
旗 下 自 有 產 品 品 牌
音 樂 串 流
最具影響力的
華語音樂串流品牌
雲 端 智 慧
雲端轉型首選技術顧問
多 媒 體 科 技
雲端串流服務領導品牌

5. Let's Enhance HD, YouTube

6. 「罐頭會過期」但電影不會！王家衛經典作品《重慶森林》4K 修復版, GQ 經典生存系列電影始祖！《大逃殺》推出 4K 數位修復版, GQ

7. 今敏經典重現第二彈《東京教父：4K數位修復版》, 光年映畫
侯孝賢經典電影《悲情城市》33 週年 4K…, Hypebeast

8. 數位經典修復, CATCHPLAY+

9. Old Film
New Experience

10. ● 國家電影及視聽文化中心 典藏與數位修復處 膠卷修復組
● 2016 年建立時只有 6 個人，2021 年有 14 個人，6 個人負責處理整治實體膠捲、1 人把膠捲掃描
成數位影像，1 人修復數位音訊檔案、4 位負責影片數位修復、1 人負責調光、1 人檔案輸出。
● 現在 AI 愈來愈發達，有應用在電影修復上嗎？
○ 狹義的修復上，沒有。
○ 許多應用 AI 把原來的影片處理得更好，補充了更多細節，反而是一種衍生作品。
○ 有使用 AI 輔助判斷髒點之類的工作，再讓修復師判斷，而不是機器主導。
● 一般的 2K 修復大約是 2 個半月左右，1 個人 1 個月只能修 10 分鐘左右。
數位修復讓老電影重生，但一位修復師工作一個月只能修復10分鐘, T客邦

11. Film-Scanning Color-Grading Auto-Framing DustBusting DeVeil Texture-Mgt
Stabilization DeFlicker DeWarp DeBlob Audio-Proc
Digital Film Restorationby, scientific|Media imageLAB

12. Can we?

13. 老派生成式 AI ?
生成式 AI ?

14. An Evolution in Single Image Super Resolution using Deep Learning, LaptrinhX
Digital Image Processing: Image Upscaling x Interpolation

15. Interpolations for imshow, matplotlib
Digital Image Processing: Image Upscaling x Interpolation

16. Single Image Super Resolution (SISR / SR)
IPHONE PHOTOS ZOOM LIMIT EXTENDED IN IOS 14 (+INFINITE ZOOM TRICK), iPhoneTricks

17. Single Image Super-Resolution from Transformed Self-Exemplars,
CVPR 2015
A+: Adjusted Anchored Neighborhood Regression for Fast Super-
Resolution, ACCV 2014
Machine Learning based

18. ● SRCNN (2014): the first deep-learning model
● SRGAN (2017): adopting Generative Adversarial Network
● EDVR (2019): CVPR NTIRE Challenge champion
● BasicVSR++ (2021): advanced deep learning model for high-quality video super-resolution
● Real-ESRGAN (2021): applied on real-world low-res images
● SwinIR (2021): utilizing Transformer model
● CodeFormer (2022): blind face restoration/enhancement
● STDO (2023): divide-n-conquer + lite model on mobile devices
● …
Learning a Deep Convolutional Network for Image Super-Resolution, ECCV 2014
Deep Learning based

19. 阿基拉 (1988)
Akira (1988) Trailer, YouTube

20. 聖誕夜驚魂 (1994)
The Nightmare Before Christmas (1993) Official Trailer #1, YouTube

21. 佳麗村三姐妹 (2003)
The Triplets of Belleville (2003) - Trailer, YouTube

22. 惡童當街 (2006)
鉄コン筋クリート/TEKKONKINKREET Trailer, YouTube

23. 書劍恩仇錄 (2002)
書劍恩仇錄, KKTV

24. 101次求婚 (1991)
101次求婚 101回目のプロポーズ 1991, YouTube

25. NHK 旧門司駅 (1988)
重要文化財に指定された門司港駅（旧門司駅）, NHK Archives

26. 霹靂兵燹 35 (2002)
霹靂兵燹 35, PILI線上看

27. Input
101次求婚 101回目のプロポーズ 1991, YouTube
Output
訓練資料庫組成 → 超解析度影片成像風格

28. VSR Model #1
Input VSR Model #2
101次求婚 101回目のプロポーズ 1991, YouTube
超解析度影片成像品質 ≠ 人類美感

29. 中視經典好戲【浴火鳳凰】(1990)
Michael Jackson, Janet Jackson - Scream (1995)
影片超解析度成像 ⊆ 影片數位修復

30. SD full-HD 4K 8K
30 fps 60 fps 120 fps
SDR 100 nits HDR 1000 nits HDR 4000 nits SDR to HDR
Color gamut conversion
Color depth booster
Video Super Resolution
Video Frame Interpolation
8 bits 10 bits 12 bits
BT709 P3 BT2020
Resolution
Color gamut
Frame rate
Dynamic range
Bit depth
VSR 發展方向

31. 1. Enhancing Video Quality: Video super
resolution techniques are used to
enhance the quality of low-resolution
videos. By increasing the resolution, these
techniques can produce sharper and
clearer videos, making them more
enjoyable to watch.
2. Surveillance Systems: Video super
resolution plays a crucial role in
surveillance systems, where low-res
surveillance footage often hampers the
ability to identify people or objects
accurately. By SR, the quality of the
captured video can be improved, aiding
in forensic analysis and identification.
3. Video Compression: Video super
resolution can be used in video
compression algorithms to reduce the file
size while maintaining a high-quality
viewing experience. By upscaling low-
resolution videos before compression, the
compressed video can retain more
details, resulting in a better visual
representation.
4. Virtual Reality (VR) and Augmented
Reality (AR): Video super resolution is
important in VR and AR applications to
provide a more immersive experience. By
enhancing the resolution of video
content, users can perceive more detailed
and realistic virtual environments, leading
to a more engaging and believable exp.
5. Broadcast and Streaming Services:
Video super resolution is utilized in
broadcast and streaming services to
upscale low-resolution content to higher
resolutions. This allows for the
distribution of content in various formats
while maintaining a consistent and
visually appealing quality across different
devices and platforms.
6. Medical Imaging: Video super
resolution has applications in medical
imaging, such as enhancing the quality of
low-resolution videos captured during
surgeries or medical procedures. This can
aid medical professionals in making
accurate diagnoses and treatment
decisions.
7. Video Restoration: Video super
resolution techniques can be employed
in video restoration applications to repair
and enhance old or degraded video
footage. By upscaling and enhancing the
resolution, it is possible to recover lost
details and improve the overall visual
quality of the restored video.
8. Digital Zoom: In applications where
digital zoom is utilized, video super
resolution can enhance the zoomed-in
portions of the video. By increasing the
resolution, the details in the zoomed
region can be better preserved, resulting
in a clearer and more informative image.
ChatGPT: VSR 的應用？

32. 老派生成式 AI
老而新生成式 AI

33. 初衷：Old is New

35. Talk to Us
https://www.kkcompany.com/
drakeguan@kkcompany.com