Otwarty dostęp

A study of local smoothness-informed convolutional neural network models for image inpainting

Fulian Li

Fulian Li

Department of Applied Mathematics, University of Science and Technology BeijingBeijing, China
Wyszukaj tego autora
Sciendo|Google Scholar
Li, Fulian
 oraz 
Ping Lin

Ping Lin

Division of Mathematics, University of DundeeScotland, United Kingdom
Wyszukaj tego autora
Sciendo|Google Scholar
Lin, Ping
  
14 kwi 2022
A study of local smoothness-informed convolutional neural network models for image inpainting's Cover Image
O artykule
Poprzedni artykuł
Następny artykuł
Zacytuj
Pobierz okładkę
Data publikacji: 14 kwi 2022
Zakres stron: 897 - 908
Otrzymano: 25 gru 2021
Przyjęty: 10 kwi 2022
DOI: https://doi.org/10.2478/amns.2022.1.00013
Słowa kluczowe
© 2023 Fulian Li et al., published by Sciendo
This work is licensed under the Creative Commons Attribution 4.0 International License.

Fig. 1

A damaged image. Ω1 is the undetectable domain, Ω2 is the detectable domain.
A damaged image. Ω1 is the undetectable domain, Ω2 is the detectable domain.

Fig. 2

Computational Framework. The 0th layer is the input (damaged image), the 39 hidden layers contain the kernels and biases, each hidden layer has 16 neurons, the last layer outputs the estimation of the real image. W × W denotes the size of the image. The upper backward line means each output back to the input layer for next training. At the first training, g0 = f. Each formula denotes the gray value of each point of the image after convolution and activation, *denotes the convolution symbol.
Computational Framework. The 0th layer is the input (damaged image), the 39 hidden layers contain the kernels and biases, each hidden layer has 16 neurons, the last layer outputs the estimation of the real image. W × W denotes the size of the image. The upper backward line means each output back to the input layer for next training. At the first training, g0 = f. Each formula denotes the gray value of each point of the image after convolution and activation, *denotes the convolution symbol.

Fig. 3

Images captured by the authors. (a) denotes the complete images, (b) denotes the damaged images.
Images captured by the authors. (a) denotes the complete images, (b) denotes the damaged images.

Fig. 4

The left image is from [16], the right one is the damaged image.
The left image is from [16], the right one is the damaged image.

Fig. 5

Inpainting results. (a) column is the complete local image, (b) column is the damaged local image, (c)–(g) columns are the outputs of the CNN trained with Ld, Leu(λ = 0.001, n = 100), Lcs(λ = 0.001, n = 100), LD(H1, β = 0.001), LD(H2, β = 0.001).
Inpainting results. (a) column is the complete local image, (b) column is the damaged local image, (c)–(g) columns are the outputs of the CNN trained with Ld, Leu(λ = 0.001, n = 100), Lcs(λ = 0.001, n = 100), LD(H1, β = 0.001), LD(H2, β = 0.001).

Fig. 6

Inpainting results. (a) column is the complete local image, (b) column is the damaged local image, (c)–(g) columns are the outputs of the CNN trained with Ld, Leu(λ = 0.001, n = 100), Lcs(λ = 0.001, n = 100), LD(H1, β = 10, 100, 10, 100, 100 orderly from the first row to the last row), LD(H2,β = 0.001, 0.001, 0.001, 0.1, 1 orderly from the first row to the last row).
Inpainting results. (a) column is the complete local image, (b) column is the damaged local image, (c)–(g) columns are the outputs of the CNN trained with Ld, Leu(λ = 0.001, n = 100), Lcs(λ = 0.001, n = 100), LD(H1, β = 10, 100, 10, 100, 100 orderly from the first row to the last row), LD(H2,β = 0.001, 0.001, 0.001, 0.1, 1 orderly from the first row to the last row).
Język:
Angielski
Częstotliwość wydawania:
1 razy w roku
Dziedziny czasopisma:
Nauki biologiczne, Nauki biologiczne, inne, Matematyka, Matematyka stosowana, Matematyka ogólna, Fizyka, Fizyka, inne
Kanał RSS czasopisma