SlideShare a Scribd company logo
CAIR: Fast and Lightweight
Multi-Scale Color Attention Network
for Instagram Filter Removal
Woon-Ha Yeo, Wang-Taek Oh,
Kyung-Su Kang, Young-Il Kim, Han-Cheol Ryu*
AIM Workshop, ECCV 2022
Motivation
Image with filter
(Filtered image)
[2,5,7,11,25] show performance degradation due to filter.
“orange”
Image
“apple”
Deep
Learning
Model
Deep
Learning
Model
Motivation
Image with filter
(Filtered image)
Original image
Revert
Motivation
• Example of filtered images in Instagram Filtered Fashionable Images (IFFI) dataset [11]
Analysis on existing Instagram filter removal methods
(Ours)
Instagram filter removal methods
Analysis on existing Instagram filter removal methods
(Ours)
State-of-the-art Image restoration method
Analysis on existing Instagram filter removal methods
(Ours)
Proposed method
Nonlinear Activation Free Network (NAFNet) [4]
• Main architecture of NAFNet [4]
• NAFBlock [4]
Simplified channel attention (SCA)
Simple Gate
• Modules in NAFBlock [4]
CAIR: Multi-Scale Color Attention Network for Instagram Filter Removal
• Main architecture of proposed CAIR-Single
CAIR: Multi-Scale Color Attention Network for Instagram Filter Removal
• Main architecture of proposed CAIR-Multi • Color attention (CA) module inspired by [27]
CAIR: Multi-Scale Color Attention Network for Instagram Filter Removal
• Ensemble learning strategy (CAIR*)
Pretrained
CAIR-S
Pretrained
CAIR-M
Ensemble
Network
H× W× 3 H× W× 6 H× W× 3
Inference
Concatenate Train
Experimental Results
• Comparison with the proposed CAIR and other methods
PSNR vs. runtime (ms) PSNR vs. the number of parameters (M)
Experimental Results
(Ours)
[2] Bianco, Simone, et al. "Artistic photo filter removal using convolutional neural networks." Journal of Electronic Imaging 27.1 (2017): 011004.
[4] Chen, Liangyu, et al. "Simple baselines for image restoration." arXiv preprint arXiv:2204.04676 (2022).
[5] Chen, Yu-Hsiu, et al. "Filter-invariant image classification on social media photos." Proceedings of the 23rd ACM international conference on Multimedia. 2015.
[7] Hendrycks, Dan, and Thomas Dietterich. "Benchmarking neural network robustness to common corruptions and perturbations." arXiv preprint arXiv:1903.12261 (2019).
[11] Kinli, Furkan, Baris Ozcan, and Furkan Kirac. "Instagram filter removal on fashionable images." Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2021.
[12] Kınlı, Furkan, Barış Ö zcan, and Furkan Kıraç. "Patch-wise Contrastive Style Learning for Instagram Filter Removal." Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2022.
[14] Lim, Bee, et al. "Enhanced deep residual networks for single image super-resolution." Proceedings of the IEEE conference on computer vision and pattern recognition workshops. 2017.
[25] Wu, Zhe, et al. "Recognizing instagram filtered images with feature de-stylization." Proceedings of the AAAI Conference on Artificial Intelligence. Vol. 34. No. 07. 2020.
[27] Zamir, Syed Waqas, et al. "Cycleisp: Real image restoration via improved data synthesis." Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2020.
References
For more details,
please visit our website:
Code: https://github.com/HnV-Lab/cair
Paper: https://arxiv.org/abs/2208.14039

More Related Content

Similar to CAIR: Fast and Lightweight Multi-Scale Color Attention Network for Instagram Filter Removal

A Review on User Personalized Tag Based Image Search by Tag Relevance
A Review on User Personalized Tag Based Image Search by Tag RelevanceA Review on User Personalized Tag Based Image Search by Tag Relevance
A Review on User Personalized Tag Based Image Search by Tag Relevance
IRJET Journal
 
IRJET-A Review on User Personalized Tag Based Image Search by Tag Relevance
IRJET-A Review on User Personalized Tag Based Image Search by Tag RelevanceIRJET-A Review on User Personalized Tag Based Image Search by Tag Relevance
IRJET-A Review on User Personalized Tag Based Image Search by Tag Relevance
IRJET Journal
 
IATMSI 2022 Presentation Format.pptx
IATMSI 2022 Presentation Format.pptxIATMSI 2022 Presentation Format.pptx
IATMSI 2022 Presentation Format.pptx
MayankLovanshi4
 
International Journal of Computational Engineering Research(IJCER)
International Journal of Computational Engineering Research(IJCER)International Journal of Computational Engineering Research(IJCER)
International Journal of Computational Engineering Research(IJCER)
ijceronline
 
Eren_Golge_MS_Thesis_2014
Eren_Golge_MS_Thesis_2014Eren_Golge_MS_Thesis_2014
Eren_Golge_MS_Thesis_2014
Bilkent University
 
Volume 2-issue-6-2077-2080
Volume 2-issue-6-2077-2080Volume 2-issue-6-2077-2080
Volume 2-issue-6-2077-2080Editor IJARCET
 
Volume 2-issue-6-2077-2080
Volume 2-issue-6-2077-2080Volume 2-issue-6-2077-2080
Volume 2-issue-6-2077-2080Editor IJARCET
 
Novel Hybrid Approach to Visual Concept Detection Using Image Annotation
Novel Hybrid Approach to Visual Concept Detection Using Image AnnotationNovel Hybrid Approach to Visual Concept Detection Using Image Annotation
Novel Hybrid Approach to Visual Concept Detection Using Image Annotation
CSCJournals
 
Volume 2-issue-6-1974-1978
Volume 2-issue-6-1974-1978Volume 2-issue-6-1974-1978
Volume 2-issue-6-1974-1978Editor IJARCET
 
Volume 2-issue-6-1974-1978
Volume 2-issue-6-1974-1978Volume 2-issue-6-1974-1978
Volume 2-issue-6-1974-1978Editor IJARCET
 
Efficient content-based image retrieval using integrated dual deep convoluti...
Efficient content-based image retrieval using integrated dual  deep convoluti...Efficient content-based image retrieval using integrated dual  deep convoluti...
Efficient content-based image retrieval using integrated dual deep convoluti...
International Journal of Reconfigurable and Embedded Systems
 
Multivariate feature descriptor based cbir model to query large image databases
Multivariate feature descriptor based cbir model to query large image databasesMultivariate feature descriptor based cbir model to query large image databases
Multivariate feature descriptor based cbir model to query large image databases
IJARIIT
 
imPlag: Detecting Image Plagiarism Using Hierarchical Near Duplicate Retrieval
imPlag: Detecting Image Plagiarism Using Hierarchical Near Duplicate RetrievalimPlag: Detecting Image Plagiarism Using Hierarchical Near Duplicate Retrieval
imPlag: Detecting Image Plagiarism Using Hierarchical Near Duplicate Retrieval
Prerana Mukherjee
 
Faro Visual Attention For Implicit Relevance Feedback In A Content Based Imag...
Faro Visual Attention For Implicit Relevance Feedback In A Content Based Imag...Faro Visual Attention For Implicit Relevance Feedback In A Content Based Imag...
Faro Visual Attention For Implicit Relevance Feedback In A Content Based Imag...
Kalle
 
Content-based Image Retrieval System for an Image Gallery Search Application
Content-based Image Retrieval System for an Image Gallery Search Application Content-based Image Retrieval System for an Image Gallery Search Application
Content-based Image Retrieval System for an Image Gallery Search Application
IJECEIAES
 
A Comprehensive Analysis on Co-Saliency Detection on Learning Approaches in 3...
A Comprehensive Analysis on Co-Saliency Detection on Learning Approaches in 3...A Comprehensive Analysis on Co-Saliency Detection on Learning Approaches in 3...
A Comprehensive Analysis on Co-Saliency Detection on Learning Approaches in 3...
AnuragVijayAgrawal
 
14. 23759.pdf
14. 23759.pdf14. 23759.pdf
14. 23759.pdf
TELKOMNIKA JOURNAL
 
Adversarial Photo Frame: Concealing Sensitive Scene Information in a User-Acc...
Adversarial Photo Frame: Concealing Sensitive Scene Information in a User-Acc...Adversarial Photo Frame: Concealing Sensitive Scene Information in a User-Acc...
Adversarial Photo Frame: Concealing Sensitive Scene Information in a User-Acc...
multimediaeval
 
Face recognition Face Identification
Face recognition Face IdentificationFace recognition Face Identification
Face recognition Face Identification
Kalyan Acharjya
 
Global Descriptor Attributes Based Content Based Image Retrieval of Query Images
Global Descriptor Attributes Based Content Based Image Retrieval of Query ImagesGlobal Descriptor Attributes Based Content Based Image Retrieval of Query Images
Global Descriptor Attributes Based Content Based Image Retrieval of Query Images
IJERA Editor
 

Similar to CAIR: Fast and Lightweight Multi-Scale Color Attention Network for Instagram Filter Removal (20)

A Review on User Personalized Tag Based Image Search by Tag Relevance
A Review on User Personalized Tag Based Image Search by Tag RelevanceA Review on User Personalized Tag Based Image Search by Tag Relevance
A Review on User Personalized Tag Based Image Search by Tag Relevance
 
IRJET-A Review on User Personalized Tag Based Image Search by Tag Relevance
IRJET-A Review on User Personalized Tag Based Image Search by Tag RelevanceIRJET-A Review on User Personalized Tag Based Image Search by Tag Relevance
IRJET-A Review on User Personalized Tag Based Image Search by Tag Relevance
 
IATMSI 2022 Presentation Format.pptx
IATMSI 2022 Presentation Format.pptxIATMSI 2022 Presentation Format.pptx
IATMSI 2022 Presentation Format.pptx
 
International Journal of Computational Engineering Research(IJCER)
International Journal of Computational Engineering Research(IJCER)International Journal of Computational Engineering Research(IJCER)
International Journal of Computational Engineering Research(IJCER)
 
Eren_Golge_MS_Thesis_2014
Eren_Golge_MS_Thesis_2014Eren_Golge_MS_Thesis_2014
Eren_Golge_MS_Thesis_2014
 
Volume 2-issue-6-2077-2080
Volume 2-issue-6-2077-2080Volume 2-issue-6-2077-2080
Volume 2-issue-6-2077-2080
 
Volume 2-issue-6-2077-2080
Volume 2-issue-6-2077-2080Volume 2-issue-6-2077-2080
Volume 2-issue-6-2077-2080
 
Novel Hybrid Approach to Visual Concept Detection Using Image Annotation
Novel Hybrid Approach to Visual Concept Detection Using Image AnnotationNovel Hybrid Approach to Visual Concept Detection Using Image Annotation
Novel Hybrid Approach to Visual Concept Detection Using Image Annotation
 
Volume 2-issue-6-1974-1978
Volume 2-issue-6-1974-1978Volume 2-issue-6-1974-1978
Volume 2-issue-6-1974-1978
 
Volume 2-issue-6-1974-1978
Volume 2-issue-6-1974-1978Volume 2-issue-6-1974-1978
Volume 2-issue-6-1974-1978
 
Efficient content-based image retrieval using integrated dual deep convoluti...
Efficient content-based image retrieval using integrated dual  deep convoluti...Efficient content-based image retrieval using integrated dual  deep convoluti...
Efficient content-based image retrieval using integrated dual deep convoluti...
 
Multivariate feature descriptor based cbir model to query large image databases
Multivariate feature descriptor based cbir model to query large image databasesMultivariate feature descriptor based cbir model to query large image databases
Multivariate feature descriptor based cbir model to query large image databases
 
imPlag: Detecting Image Plagiarism Using Hierarchical Near Duplicate Retrieval
imPlag: Detecting Image Plagiarism Using Hierarchical Near Duplicate RetrievalimPlag: Detecting Image Plagiarism Using Hierarchical Near Duplicate Retrieval
imPlag: Detecting Image Plagiarism Using Hierarchical Near Duplicate Retrieval
 
Faro Visual Attention For Implicit Relevance Feedback In A Content Based Imag...
Faro Visual Attention For Implicit Relevance Feedback In A Content Based Imag...Faro Visual Attention For Implicit Relevance Feedback In A Content Based Imag...
Faro Visual Attention For Implicit Relevance Feedback In A Content Based Imag...
 
Content-based Image Retrieval System for an Image Gallery Search Application
Content-based Image Retrieval System for an Image Gallery Search Application Content-based Image Retrieval System for an Image Gallery Search Application
Content-based Image Retrieval System for an Image Gallery Search Application
 
A Comprehensive Analysis on Co-Saliency Detection on Learning Approaches in 3...
A Comprehensive Analysis on Co-Saliency Detection on Learning Approaches in 3...A Comprehensive Analysis on Co-Saliency Detection on Learning Approaches in 3...
A Comprehensive Analysis on Co-Saliency Detection on Learning Approaches in 3...
 
14. 23759.pdf
14. 23759.pdf14. 23759.pdf
14. 23759.pdf
 
Adversarial Photo Frame: Concealing Sensitive Scene Information in a User-Acc...
Adversarial Photo Frame: Concealing Sensitive Scene Information in a User-Acc...Adversarial Photo Frame: Concealing Sensitive Scene Information in a User-Acc...
Adversarial Photo Frame: Concealing Sensitive Scene Information in a User-Acc...
 
Face recognition Face Identification
Face recognition Face IdentificationFace recognition Face Identification
Face recognition Face Identification
 
Global Descriptor Attributes Based Content Based Image Retrieval of Query Images
Global Descriptor Attributes Based Content Based Image Retrieval of Query ImagesGlobal Descriptor Attributes Based Content Based Image Retrieval of Query Images
Global Descriptor Attributes Based Content Based Image Retrieval of Query Images
 

Recently uploaded

GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
James Anderson
 
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
Product School
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
Elena Simperl
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
Product School
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and Grafana
RTTS
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
Product School
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
DianaGray10
 
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Ramesh Iyer
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Product School
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
Elena Simperl
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
Alison B. Lowndes
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
Product School
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Thierry Lestable
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
Guy Korland
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
Alan Dix
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Tobias Schneck
 
"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi
Fwdays
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
Laura Byrne
 

Recently uploaded (20)

GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
 
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and Grafana
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
 
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
 
"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
 

CAIR: Fast and Lightweight Multi-Scale Color Attention Network for Instagram Filter Removal

  • 1. CAIR: Fast and Lightweight Multi-Scale Color Attention Network for Instagram Filter Removal Woon-Ha Yeo, Wang-Taek Oh, Kyung-Su Kang, Young-Il Kim, Han-Cheol Ryu* AIM Workshop, ECCV 2022
  • 2. Motivation Image with filter (Filtered image) [2,5,7,11,25] show performance degradation due to filter. “orange” Image “apple” Deep Learning Model Deep Learning Model
  • 3. Motivation Image with filter (Filtered image) Original image Revert
  • 4. Motivation • Example of filtered images in Instagram Filtered Fashionable Images (IFFI) dataset [11]
  • 5. Analysis on existing Instagram filter removal methods (Ours) Instagram filter removal methods
  • 6. Analysis on existing Instagram filter removal methods (Ours) State-of-the-art Image restoration method
  • 7. Analysis on existing Instagram filter removal methods (Ours) Proposed method
  • 8. Nonlinear Activation Free Network (NAFNet) [4] • Main architecture of NAFNet [4] • NAFBlock [4] Simplified channel attention (SCA) Simple Gate • Modules in NAFBlock [4]
  • 9. CAIR: Multi-Scale Color Attention Network for Instagram Filter Removal • Main architecture of proposed CAIR-Single
  • 10. CAIR: Multi-Scale Color Attention Network for Instagram Filter Removal • Main architecture of proposed CAIR-Multi • Color attention (CA) module inspired by [27]
  • 11. CAIR: Multi-Scale Color Attention Network for Instagram Filter Removal • Ensemble learning strategy (CAIR*) Pretrained CAIR-S Pretrained CAIR-M Ensemble Network H× W× 3 H× W× 6 H× W× 3 Inference Concatenate Train
  • 12. Experimental Results • Comparison with the proposed CAIR and other methods PSNR vs. runtime (ms) PSNR vs. the number of parameters (M)
  • 14. [2] Bianco, Simone, et al. "Artistic photo filter removal using convolutional neural networks." Journal of Electronic Imaging 27.1 (2017): 011004. [4] Chen, Liangyu, et al. "Simple baselines for image restoration." arXiv preprint arXiv:2204.04676 (2022). [5] Chen, Yu-Hsiu, et al. "Filter-invariant image classification on social media photos." Proceedings of the 23rd ACM international conference on Multimedia. 2015. [7] Hendrycks, Dan, and Thomas Dietterich. "Benchmarking neural network robustness to common corruptions and perturbations." arXiv preprint arXiv:1903.12261 (2019). [11] Kinli, Furkan, Baris Ozcan, and Furkan Kirac. "Instagram filter removal on fashionable images." Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2021. [12] Kınlı, Furkan, Barış Ö zcan, and Furkan Kıraç. "Patch-wise Contrastive Style Learning for Instagram Filter Removal." Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2022. [14] Lim, Bee, et al. "Enhanced deep residual networks for single image super-resolution." Proceedings of the IEEE conference on computer vision and pattern recognition workshops. 2017. [25] Wu, Zhe, et al. "Recognizing instagram filtered images with feature de-stylization." Proceedings of the AAAI Conference on Artificial Intelligence. Vol. 34. No. 07. 2020. [27] Zamir, Syed Waqas, et al. "Cycleisp: Real image restoration via improved data synthesis." Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2020. References
  • 15. For more details, please visit our website: Code: https://github.com/HnV-Lab/cair Paper: https://arxiv.org/abs/2208.14039