[人工智能]图像拼接（Image Stiching）方向论文微总结

图像拼接任务对于目前主流视觉任务来说比较偏，目前基于深度学习的框架还不成熟，而且拼接任务里面很多小点都可以单独拿出来研究，比如聚焦或迁移到单应矩阵，图像对齐，图像融合，视频防抖，图像矩形化等。找到好的研究场景，既能发文又能有实用价值。现简单整理近几年的相关文章，如有遗漏还望读者指出。

期刊

近几年

1. Natural Image Stitching Using Depth Maps

   • Paper：Arxiv 2022
   • Blog：
     • 【论文精读】Natural Image Stitching Using Depth Maps
     • 【论文精读】Natural Image Stitching Using Depth Maps

2. Unsupervised Deep Image Stitching: Reconstructing Stitched Features to Images

   • Paper：https://arxiv.org/abs/2106.12859
   • Code：https://github.com/nie-lang/UnsupervisedDeepImageStitching
   • Blog：TIP2021—重访CV经典: 首个无监督深度学习图像拼接框架

3. Pixel-wise Deep Image Stitching

   • Paper：Arxiv 2021
   • Blog：【论文精读】Pixel-wise Deep Image Stitching

4. Learning Edge-Preserved Image Stitching from Large-Baseline Deep Homography

   • Paper：Arxiv 2020
   • Blog：【论文精读】Learning Edge-Preserved Image Stitching from Large-Baseline Deep Homography

5. A view-free image stitching network based on global homography

   • Paper：Journal of Visual Communication and Image Representation，2020
   • Code：https://github.com/nie-lang/DeepImageStitching-1.0
   • Blog：【论文精读】A view-free image stitching network based on global homography-基于全局单应的无视图图像拼接网络

6. A Novel Projective-Consistent Plane Based Image Stitching Method

   • Paper：IEEE Transactions on Multimedia，2019

7. Graph-based Hypothesis Generation for Parallax-tolerant Image Stitching

   • Paper：Arxiv 2018
   • Blog：【论文精读】Graph-based Hypothesis Generation for Parallax-tolerant Image Stitching-基于图的视差容忍图像拼接假设生成

8. Single-Perspective Warps in Natural Image Stitching

   • Paper：IEEE Transactions on Image Processing，2018
   • Blog：
     • 【论文精读】Single-Perspective Warps in Natural Image Stitching-自然图像拼接中的单透视扭曲；
     • 【论文精读】Single-Perspective Warps in Natural Image Stitching

9. Parallax-Tolerant Image Stitching Based on Robust Elastic Warping

• Paper：IEEE Transactions on Multimedia，2018
• Code：https://github.com/gain2217/Robust_Elastic_Warping
• Blog：【论文精读】Parallax-Tolerant Image Stitching Based on Robust Elastic Warping

经典方法

1. Seam carving for content-aware image resizing
   • Paper：ACM Transactions on graphics （TOG）2007
   • Code：https://github.com/mahmoudnafifi/seam-carving
   • Blog：【论文精读】Seam Carving for Content-Aware Image Resizing
2. Automatic Panoramic Image Stitching using Invariant Features
   • Paper：International Journal of Computer Vision， 2007
   • Keywords：开山之作
   • Software：http://matthewalunbrown.com/autostitch/autostitch.html
3. As-Rigid-As-Possible Shape Manipulation
   • Paper：ACM Transactions on Computer Graphics，2005
   • Project：https://www-ui.is.s.u-tokyo.ac.jp/~takeo/research/rigid/index.html
   • Blog：【论文精读】As-Rigid-As-Possible Shape Manipulation

会议

近几年

1. Deep Rectangling for Image Stitching: A Learning Baseline
   • Paper：https://arxiv.org/abs/2203.03831（CVPR 2022 oral）
   • Code：https://github.com/nie-lang/DeepRectangling
   • Blog：
     • CVPR2022 Oral | 从图形学顶会到视觉顶会：一份改良何恺明早期工作的图像拼接矩形化新基准
     • 【论文精读】Deep Rectangling for Image Stitching: A Learning Baseline
2. Leveraging Line-Point Consistence To Preserve Structures for Wide Parallax Image Stitching
   • Paper：CVPR 2021
   • Code：https://github.com/dut-media-lab/Image-Stitching
   • Blog：
     • 【论文精读】Leveraging Line-point Consistence to Preserve Structures for Wide Parallax Image Stitching
     • 【论文精读】Leveraging Line-point Consistence to Preserve Structures for Wide Parallax Image Stitching
3. Minimal Solutions for Panoramic Stitching Given Gravity Prior
   • Paper：ICCV 2021
4. Warping Residual Based Image Stitching for Large Parallax
   • Paper：CVPR 2020
5. Image Stitching and Rectification for Hand-Held Cameras
   • Paper：ECCV 2020
   • Project：https://www.nec-labs.com/~mas/RS-APAP
6. SuperPoint: Self-Supervised Interest Point Detection and Description
   • Paper：CVPR 2018 workshop
   • Code：
     • https://github.com/magicleap/SuperPointPretrainedNetwork
     • https://github.com/rpautrat/SuperPoint
   • Blog：【论文精读】SuperPoint: Self-Supervised Interest Point Detection and Description
7. DocUNet: Document Image Unwarping via A Stacked U-Net
   • Paper：CVPR 2018
   • Blog：
     • CVPR 2018 | 旷视科技Face++率先提出DocUNet 可复原扭曲的文档图像
     • 【论文精读】DocUNet: Document Image Unwarping via A Stacked U-Net

经典方法

1. SEAGULL: Seam-Guided Local Alignment for Parallax-Tolerant Image Stitching
   • Paper：ECCV 2016
2. Natural Image Stitching with the Global Similarity Prior
   • Paper：ECCV 2016
   • Code：https://github.com/nothinglo/NISwGSP
3. Adaptive as-natural-as-possible image stitching
   • Paper：CVPR 2015
   • Code：https://github.com/YaqiLYU/AANAP
   • Blog：
     • 【论文精读】Adaptive As-Natural-As-Possible Image Stitching
     • 【论文精读】Adaptive As-Natural-As-Possible Image Stitching
4. Parallax-Tolerant Image Stitching
   • Paper：CVPR 2014
   • Code：https://github.com/gain2217/Robust_Elastic_Warping
   • Keywords：seam-driven stitching的改进版
   • Blog：
     • 【论文精读】Parallax-tolerant Image Stitching
     • 14.Parallax-tolerant Image Stitching - 大视差图片拼接
5. Shape-Preserving Half-Projective Warps for Image Stitching
   • Paper：CVPR 2014
   • Code：http://www.cmlab.csie.ntu.edu.tw/~frank/SPH/cvpr14_SPHP_code.tar
   • Blog：
     • 【论文精读】Shape-Preserving Half-Projective Warps for Image Stitching
     • SPHP：形状保留半投影图像拼接
6. As-projective-as-possible Image Stitching with Moving DLT
   • Paper：CVPR 2013，IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 2014
   • Code：https://cs.adelaide.edu.au/~tjchin/apap/files/mdlt.zip
   • Project：https://cs.adelaide.edu.au/~tjchin/apap/
   • Blog：【论文精读】As-Projective-As-Possible Image Stitching with Moving DLT
7. Seam-Driven Image Stitching
   • Paper：EUROGRAPHICS 2013
   • Blog：
     • 【论文精读】Seam-Driven Image Stitching
     • 图像拼接论文笔记 Seam-Driven Image Stitching
     • Seam-Driven Image Stitching - 基于最佳拼缝搜索的图像拼接
     • 13.Seam-Driven Image Stitching - 基于最佳拼缝搜索的图像拼接
8. Smoothly Varying Affine Stitching
   • Paper：CVPR 2011
   • Blog：【论文精读】Smoothly Varying Affine Stitching
9. Constructing image panoramas using dual-homography warping
   • Paper：CVPR 2011
   • Blog：【论文精读】Constructing Image Panoramas using Dual-Homography Warping

参考资料：

1. 图像拼接现在还有研究的价值吗？有哪些可以研究的点？现在技术发展如何？ - YaqiLYU的回答 - 知乎
2. 图像拼接系列论文-CSDN专栏-作者: 小李不会编程啊
3. 论文笔记-CSDN专栏-作者: 18岁小白想成大牛

阅读世界，共赴山海

423全民读书节，邀你共读