Image Inpainting: An Overview

Authors

  • Suma N Department of Studies and Research in Computer Applications, Tumkur University, Tumkuru, Karnataka, India.
  • Kusuma Kumari B M Department of Studies and Research in Computer Applications, Tumkur University, Tumkuru, Karnataka, India.

DOI:

https://doi.org/10.5281/zenodo.10628249

Keywords:

Image inpainting, Inpainting techniques, Tools, Datasets

Abstract

Over the years’ Researchers have intensively studied the image inpainting problem due to its great importance and effectiveness in various image processing applications such as human and object security, object removal, face processingapplications. The process of adding or erasing missing areas from images is known as image inpainting. Although it necessitates a profound comprehension of the image details in terms of texture and structure, it is regarded as one of the most difficult topics in the field of image processing. The majority of image inpainting techniques, various tools exploited in each of the reviewed works, challenges and limitations with image inpainting techniques as well as the datasets used are reviewed in this paper which may be useful for researchers in assessing their own proposed methods.

References

Salem, N. M. (2021). A Survey on Various Image Inpainting Techniques. Future Engineering Journal, 2(2).

Jam, J., Kendrick, C., Walker, K., Drouard, V., Hsu, J. G. S., & Yap, M. H. (2021). A comprehensive review of past and present image inpainting methods. Computer vision and image understanding, 203, 103147.

Qureshi, M. A., & Deriche, M. (2015). A bibliography of pixel-based blind image forgery detection techniques. Signal Processing: Image Communication, 39, 46-74.

Bertalmio, M., Sapiro, G., Caselles, V., & Ballester, C. (2000, July). Image inpainting. In Proceedings of the 27th annual conference on Computer graphics and interactive techniques (pp. 417-424).

Inpaint Photo Restoration Software http://www.theinpaint.com/

https://pyimagesearch.com/

Qureshi, M. A., Deriche, M., Beghdadi, A., & Amin, A. (2017). A critical survey of state-of-the-art image inpainting quality assessment metrics. Journal of Visual Communication and Image Representation, 49, 177-191.

Liu, K., Li, J., & Hussain Bukhari, S. S. (2022). Overview of image inpainting and forensic technology. Security and Communication Networks, 2022.

Guillemot, C., & Le Meur, O. (2013). Image inpainting: Overview and recent advances. IEEE signal processing magazine, 31(1), 127-144.

Li, H., Luo, W., & Huang, J. (2017). Localization of diffusion-based inpainting in digital images. IEEE transactions on information forensics and security, 12(12), 3050-3064.

Criminisi, A., Pérez, P., & Toyama, K. (2004). Region filling and object removal by exemplar-based image inpainting. IEEE Transactions on image processing, 13(9), 1200-1212.

Thanki, B. B. (2015). Overview of an image inpainting techniques. International Journal For Technological Research In Engineering, 2(5), 388-391.

Mairal, J., Elad, M., & Sapiro, G. (2007). Sparse representation for color image restoration. IEEE Transactions on image processing, 17(1), 53-69.

Shen, B., Hu, W., Zhang, Y., & Zhang, Y. J. (2009, April). Image inpainting via sparse representation. In 2009 IEEE International Conference on Acoustics, Speech and Signal Processing (pp. 697-700). IEEE.

ANTONACIO, P. O. COMPLETING FACE PICTURES: A STUDY ON IMAGE AND FACIAL INPAINTING METHODS.

Criminisi, A., Pérez, P., & Toyama, K. (2004). Region filling and object removal by exemplar-based image inpainting. IEEE Transactions on image processing, 13(9), 1200-1212.

Farid, M. S., Mahmood, A., & Grangetto, M. (2016). Image de-fencing framework with hybrid inpainting algorithm. Signal, Image and Video Processing, 10, 1193-1201.

Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., ... & Fei-Fei, L. (2015). Imagenet large scale visual recognition challenge. International journal of computer vision, 115, 211-252.

Zhang, H., Chen, W., Tian, J., Wang, Y., & Jin, Y. (2018). Show, attend and translate: Unpaired multi-domain image-to-image translation with visual attention. arXiv preprint arXiv:1811.07483.

Karras, T., Laine, S., & Aila, T. (2019). A style-based generator architecture for generative adversarial networks. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (pp. 4401-4410).

Jing, L., & Tian, Y. (2020). Self-supervised visual feature learning with deep neural networks: A survey. IEEE transactions on pattern analysis and machine intelligence, 43(11), 4037-4058.

Huang, H., He, R., Sun, Z., & Tan, T. (2018). Introvae: Introspective variational autoencoders for photographic image synthesis. Advances in neural information processing systems, 31.

Rostamzadeh, N., Hosseini, S., Boquet, T., Stokowiec, W., Zhang, Y., Jauvin, C., & Pal, C. (2018). Fashion-gen: The generative fashion dataset and challenge. arXiv preprint arXiv:1806.08317.

Kumar, A., & Bhavsar, A. (2019). Copy-move forgery classification via unsupervised domain adaptation. arXiv preprint arXiv:1911.07932.

Hukkelås, H., Mester, R., & Lindseth, F. (2019, October). Deepprivacy: A generative adversarial network for face anonymization. In International symposium on visual computing (pp. 565-578). Cham: Springer International Publishing.

Liao, M., Lu, F., Zhou, D., Zhang, S., Li, W., & Yang, R. (2020). Dvi: Depth guided video inpainting for autonomous driving. In Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part XXI 16 (pp. 1-17). Springer International Publishing.

Adiga V, S., & Sivaswamy, J. (2019). Fpd-m-net: Fingerprint image denoising and inpainting using m-net based convolutional neural networks. In Inpainting and Denoising Challenges (pp. 51-61). Springer International Publishing.

Zhang, L., Zhou, Y., Barnes, C., Amirghodsi, S., Lin, Z., Shechtman, E., & Shi, J. (2022, October). Perceptual artifacts localization for inpainting. In European Conference on Computer Vision (pp. 146-164). Cham: Springer Nature Switzerland.

Kulshreshtha, P., Pugh, B., & Jiddi, S. (2022). Feature refinement to improve high resolution image inpainting. arXiv preprint arXiv:2206.13644.

Ahmed, S. T., Singh, D. K., Basha, S. M., Abouel Nasr, E., Kamrani, A. K., & Aboudaif, M. K. (2021). Neural network based mental depression identification and sentiments classification technique from speech signals: A COVID-19 Focused Pandemic Study. Frontiers in public health, 9, 781827.

Pathak, D., Krahenbuhl, P., Donahue, J., Darrell, T., & Efros, A. A. (2016). Context encoders: Feature learning by inpainting. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 2536-2544).

Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., ... & Bengio, Y. (2014). Generative adversarial nets. Advances in neural information processing systems, 27.

Pushpalwar, R. T., & Bhandari, S. H. (2016, February). Image inpainting approaches-a review. In 2016 IEEE 6th International Conference on Advanced Computing (IACC) (pp. 340-345). IEEE.

Pillai, S., & Khadagade, S. (2017). A review on digital image restoration process. International Journal of Computer Applications, 158(7).

Ahmed, S. T., Sreedhar Kumar, S., Anusha, B., Bhumika, P., Gunashree, M., & Ishwarya, B. (2020). A generalized study on data mining and clustering algorithms. New Trends in Computational Vision and Bio-inspired Computing: Selected works presented at the ICCVBIC 2018, Coimbatore, India, 1121-1129.

Lakshmanan, V., & Gomathi, R. (2017, March). A survey on image completion techniques in remote sensing images. In 2017 Fourth International Conference on Signal Processing, Communication and Networking (ICSCN) (pp. 1-6). IEEE.

Zeng, J., Fu, X., Leng, L., & Wang, C. (2019). Image inpainting algorithm based on saliency map and gray entropy. Arabian Journal for Science and Engineering, 44, 3549-3558.

Sathiyamoorthi, V., Ilavarasi, A. K., Murugeswari, K., Ahmed, S. T., Devi, B. A., & Kalipindi, M. (2021). A deep convolutional neural network based computer aided diagnosis system for the prediction of Alzheimer's disease in MRI images. Measurement, 171, 108838.

Elharrouss, O., Al-Maadeed, N., & Al-Maadeed, S. (2019, June). Video summarization based on motion detection for surveillance systems. In 2019 15th International Wireless Communications & Mobile Computing Conference (IWCMC) (pp. 366-371). IEEE.

Downloads

Published

2024-02-08

How to Cite

Suma N, & Kusuma Kumari B M. (2024). Image Inpainting: An Overview. International Journal of Human Computations & Intelligence, 3(1), 286–298. https://doi.org/10.5281/zenodo.10628249