基于深度學習的圖像上色論文、代碼、demo的大彙總。圖像上色方式包括全自動上色(Automatic Colorization)和使用者互動上色(User Guided / Interaction Colorization)。
Github上持續更新:https://github.com/MarkMoHR/Awesome-Image-Colorization
目錄
- 全自動圖像上色
- 使用者互動圖像上色
- 基于顔色提示的上色
- 基于彩色參考圖的上色
- 基于顔色色塊的上色
- 基于語言/文字的上色
1. 全自動圖像上色
論文 | 發表處 | 代碼/項目連結 |
Learning Large-Scale Automatic Image Colorization | ICCV 2015 | [project] [code] |
Deep Colorization | ICCV 2015 |
Learning Representations for Automatic Colorization | ECCV 2016 | [project] [code] |
Colorful Image Colorization | ECCV 2016 | [project] [code] |
Let there be Color!: Joint End-to-end Learning of Global and Local Image Priors for Automatic Image Colorization with Simultaneous Classification | SIGGRAPH 2016 | [project] [code] |
Unsupervised Diverse Colorization via Generative Adversarial Networks | ECML-PKDD 2017 | [code] |
Learning Diverse Image Colorization | CVPR 2017 | [code] |
Structural Consistency and Controllability for Diverse Colorization | ECCV 2018 |
Pixelated Semantic Colorization | 1901.10889 |
2. 使用者互動圖像上色
2.1 基于顔色提示的上色
圖像類型 | 論文 | 發表處 | 代碼/項目連結 |
漫畫 | Manga colorization | SIGGRAPH 2006 |
線稿 / 草圖 | Auto-painter: Cartoon Image Generation from Sketch by Using Conditional Generative Adversarial Networks | 1705.01908 | [code] |
灰階自然圖像 | Real-Time User-Guided Image Colorization with Learned Deep Priors | SIGGRAPH 2017 | [project] [code1] [code2] |
草圖 | Scribbler: Controlling Deep Image Synthesis with Sketch and Color | CVPR 2017 |
線稿 | User-Guided Deep Anime Line Art Colorization with Conditional Adversarial Networks | ACM MM 2018 | [code] |
線稿 | Two-stage Sketch Colorization | SIGGRAPH Asia 2018 | [code] |
線稿 / 草圖 | Outline Colorization through Tandem Adversarial Networks | Online Demo | [Demo] [code] |
線稿 | Paints Chainer | Online Demo | [Demo] [code] |
線稿 | Style2paints | Online Demo | [Demo] [code] |
漫畫 | MangaCraft | Online Demo | [Demo] |
2.2 基于彩色參考圖的上色
圖像類型 | 論文 | 發表處 | 代碼/項目連結 |
漫畫 | Comicolorization: Semi-Automatic Manga Colorization (also palette based) | SIGGRAPH Asia 2017 | [code] |
草圖 | TextureGAN: Controlling Deep Image Synthesis with Texture Patches | CVPR 2018 | [code] |
灰階自然圖像 | Deep Exemplar-based Colorization | SIGGRAPH 2018 | [code] |
灰階自然圖像 | Example-Based Colourization Via Dense Encoding Pyramids (also palette based) | Pacific Graphics 2018 | [code] |
灰階自然圖像 | A Superpixel-based Variational Model for Image Colorization | TVCG 2019 |
2.3 基于顔色色塊的上色
圖像類型 | 論文 | 發表處 | 代碼/項目連結 |
自然圖像 | Palette-based Photo Recoloring | SIGGRAPH 2015 | [project] |
漫畫 | Comicolorization: Semi-Automatic Manga Colorization (also reference based) | SIGGRAPH Asia 2017 | [code] |
灰階自然圖像 | Coloring with Words: Guiding Image Colorization Through Text-based Palette Generation (also text based) | ECCV 2018 | [code] |
灰階自然圖像 | Example-Based Colourization Via Dense Encoding Pyramids (also reference based) | Pacific Graphics 2018 | [code] |
2.4 基于語言/文字的上色
圖像類型 | 論文 | 發表處 | 代碼/項目連結 |
灰階自然圖像 / 草圖 | Language-Based Image Editing with Recurrent Attentive Models | CVPR 2018 | [code] |
灰階自然圖像 | Coloring with Words: Guiding Image Colorization Through Text-based Palette Generation (also palette based) | ECCV 2018 | [code] |
場景草圖 | LUCSS: Language-based User-customized Colorization of Scene Sketches | 1808.10544 | [code] |