Otwarty dostęp

Digital model creation and image meticulous processing based on variational partial differential equation


Zacytuj

Introduction

In the development of digital model construction of animation scene, the related digital image processing has a long history of development. Previous image processing theories mainly involve Fourier analysis, filtering theory and other content; the processing methods used are mostly simple and single heuristic methods and thus the practical application has a strong limit, and cannot be used to calculate part of the characteristics and performance of the algorithm for in-depth discussion. But as more and more researchers became involved in the field of digital image processing, the technology gradually shifted from alchemy to modern chemistry. Partial differential equation (PDE) method, the most critical content in mathematical analysis, is closely related to the physical world. For example, common heat conduction equation and wave equation belong to PDE [1, 2]. In early studies, PDE was mainly used to represent physical and mechanical phenomena, while in today’s research and discussion, PDE used in various fields, such as finance, biology, image processing and so on. According to the conclusion of Koenderink et al.‘s study, the Gaussian convolution of the image is equal to the solution of the thermal diffusion equation. Thus, the relation between PDE dedrying and classical filter dedrying is constructed, and the result of the fusion with the concept of scale space proposed by Witkin is the basic content of PDE image processing. At the same time, Hummel also put forward the maximum and minimum value criterion of scale space according to the above content, which can be regarded as the mathematical explanation of causality. Guided by this, Perona and Malik et al. first proposed a denoising model based on nonlinear diffusion in the 1990s. However, after entering the 21st century, Tschumperle et al. analysed and verified that the diffusion tensor in the divergence operator framework could not directly present the local diffusion behaviour of the model by using the divergence mode of TV denoising model. Therefore, they finally proposed a denoising model with trace operator as the core. Finally, a highly efficient geometric adaptive denoising model based on the expression of trace operator is obtained by extending the framework of divergence group proposed by Weickert to the framework of trace operator. It should be noted that although this method can improve the drying level and edge retention level, there are still some problems that need to be improved in practical application. Therefore, on the basis of understanding the variational PDE, this paper makes a comparative analysis of the creation of the digital model of the animation scene and the image denoising and restoration technology, and finally makes clear the application advantages of variational PDE in the comparative analysis of the experimental effect [3, 4].

Digital model analysis of animation scene based on variational PDE
Image denoising
Definition 1

First, variational expression. Assuming it has been clear that the average value of Gaussian white noise N μ = 0 meets this condition, then combined with the analysis of maximum likelihood criterion, an approximation of I can be obtained by using the computational least squares problem. The specific formula is shown as follows: minIΩ||InoisyI||2dΩ \mathop {\min}\limits_I {\in _\Omega}||{I_{noisy}} - I|{|^2}d\Omega

Theorem 1

In the above formula, ||Inoisy − I||2 represents a measure of image difference during denoising, as shown below: ||InoisyI||2 ||{I_{noisy}} - I|{|^2}

Since n represents the Gaussian white noise with the mean μ = 0 and the standard deviation of σ, all points in a radius sphere with I noisy as the centre of the circle can be approximated by I, in other words, they may all be solutions of the above formula. Therefore, in order to obtain more valuable solutions, the related problems need to be normalised. If the smoothing property of the image can be measured by using the normalised term R (I), and the corresponding I becomes more positive with the subsequent decline, then the optimal solution of I can be obtained according to the level set of R.

Proposition 2

Second, divergence operator expression. The divergence operator model framework proposed by Weickert regards the PDE image denoising problem as a chemical concentration diffusion process following certain physical laws. In this way, the variational PDE denoising model is sorted into a more general framework based on divergence operator. The specific formula is shown as follows: It=div(DI) {{\partial I} \over {\partial t}} = {\rm{div}}(D\nabla I)

Lemma 3

In the above formula,I stands for the gradient field of the image, which corresponds to the concentration gradient of the chemical concentration diffusion, and D refers to the diffusion tensor field constructed based on the diffusion tensor. At this time, the diffusion behaviour is combined with the following formula, and the corresponding D needs to be designed, so as to obtain the following formula: It=div(DI) {{\partial I} \over {\partial t}} = {\rm{div}}(D\nabla I)

By comparison with the above formula, it can be seen that Φ functional expression is a special case of divergence expression, and the diffusion tensor corresponding to it is: D=ϕ(||I||)||I||Id D = {{\phi '(||\nabla I||)} \over {||\nabla I||}}Id

In the above formula, Id represents the identity matrix of 2×2, and the following formula can also be regarded as a special case of the divergence expression, and the corresponding diffusion heat formula is:

Heat diffusion equation: It=ΔI=div(I) {{\partial I} \over {\partial t}} = \Delta I = {\rm{div}}(\nabla I)

The corresponding diffusion tensor is: D = Id

P-M model equation: It=div[g(||I||)I] {{\partial I} \over {\partial t}} = {\rm{div}}[g(||\nabla I||)\nabla I]

The corresponding diffusion tensor is: D = g(||I||)Id

Selective smoothing model: It=div(g(||Gσ*I||)I) {{\partial I} \over {\partial t}} = {\rm{div}}(g(||{G_\sigma}*\nabla I||)\nabla I)

The corresponding diffusion tensor is: D = g(||Gσ * ∇I||)Id

Corollary 4

Thirdly, trace operator expression. Combined with the above research and analysis on thermal diffusion, P-M model, Φ functional expression and directional smoothing, the expression form of trace operator can be seen as follows: It=c1Iuu+c2Ivv \matrix{{{{\partial I} \over {\partial t}}} \hfill & {= {c_1}{I_{uu}} + {c_2}{I_{vv}}} \hfill\cr}

In the above formula, u,v ∈ R2 and ⊥ v,c1,c2 ≥ 0, Iuu and Ivv represent the second directional derivative of image I in the direction u and v, respectively. Combined with the expression of the second order directional derivative, the expression formula of trace operator of its diffusion tensor can be clearly expressed as: It=c1Iuu+c2Ivv=c1trace(HuuT)+c2trace(HvvT)=trace[H(c1uuT+c2vvT)]=trace(HT) \matrix{{{{\partial I} \over {\partial t}}} \hfill & {= {c_1}{I_{uu}} + {c_2}{I_{vv}}} \hfill\cr{} \hfill & {= {c_1}trace(Hu{u^T}) + {c_2}trace(Hv{v^T})} \hfill\cr{} \hfill & {= trace[H({c_1}u{u^T} + {c_2}v{v^T})]} \hfill\cr{} \hfill & {= trace(HT)} \hfill\cr}

Conjecture 5. In the above formula, trace () represents the trace operator and H represents the Hessian matrix. To accurately distinguish the diffusion tensor D contained in the discrete form, T should be used to represent the diffusion tensor expressed by the trace operator. The specific formula is as follows: T=c1uuT+c2vvT T = {c_1}u{u^T} + {c_2}v{v^T}

Meanwhile, since the Hessian matrix H and the diffusion tensor D belong to the symmetric matrix, the expression formula of the trace operator above can be transformed into: It=trace(TH) {{\partial I} \over {\partial t}} = trace(TH)

In geometric adaptive denoising model, assuming that the η*, ξ* and μ1* \mu _1^* , μ2* \mu _2^* represent smooth structure tensor S * characteristic vector and the corresponding characteristic value, and meets the μ1*μ2* \mu _1^* \ge \mu _2^* = = condition, so in order to make smooth behaviour can directly show the image of local structure, can be combined with orthogonal smooth direction represent the related gradient direction and the direction of the illumination, such as line, In other words, let the eigenvectors of T, U, V and S* be consistent: {u=η*v=ξ* \left\{{\matrix{{u = {\eta ^*}}\cr{v = {\xi ^*}}\cr}} \right.

Example 6

In order to remove the noise effectively and retain the edge as much as possible, it should be processed in accordance with the direction of the relevant gradient and the smoothing intensity of the direction of the isoluminance line. In other words, the characteristic value of the diffusion tensor T, λ12 should be adjusted autonomically according to the characteristics of the region in which it is located. When processing different image features, Tschumperle uses μ1*+μ2* \sqrt {\mu _1^* + \mu _2^*} to distinguish them. In this case, λ12 represents the μ1*+μ2* \sqrt {\mu _1^* + \mu _2^*} function. In this process, the following design principles need to be observed:

First, the isotropic smoothing and effective denoising is implemented in the non-edge region, and the specific formula is as follows: ItΔI=trace(H)namely: limμ1*+μ2*0T=Id {{\partial I} \over {\partial t}} \approx \Delta I = trace(H)\;\;{\rm{namely}}:\mathop {\lim}\limits_{\sqrt {\mu _1^* + \mu _2^*}\to 0} T = Id

And should be reflected in: λ12 limμ1*+μ2*0λ2=limμ1*+μ2*0λ2=1 li{m_{\sqrt {\mu _1^* + \mu _2^*}\to 0}}{\lambda _2} = li{m_{\sqrt {\mu _1^* + \mu _2^*}\to 0}}{\lambda _2} = 1

Second, the anisotropic smoothing process is implemented in the edge region, and the edge region is preserved as far as possible while the noise is removed. At this time, smoothing should be processed with the direction of ξ*of isoluminance line. The specific formula is as follows: Itλ2ξ*ξ*T=trace(λ2ξ*ξ*TH) {{\partial I} \over {\partial t}} \approx {\lambda _2}{\xi ^*}{\xi ^{*T}} = trace({\lambda _2}{\xi ^*}{\xi ^{*T}}H)

Also available: limμ1*+μ2*λ1λ2=0 li{m_{\sqrt {\mu _1^* + \mu _2^*}\to \infty}}{{{\lambda _1}} \over {{\lambda _2}}} = 0

The choices proposed by Tschumperle that meet the above requirements are: {λ1=11+μ1*+μ2*λ2=11+μ1*+μ2* \left\{{\matrix{{{\lambda _1} = {1 \over {1 + \mu _1^* + \mu _2^*}}}\cr{{\lambda _2} = {1 \over {\sqrt {1 + \mu _1^* + \mu _2^*}}}}\cr}} \right.

By referring the processing formula of the edge region above to the calculation formula of the trace operator’s diffusion tensor, the expression formula of T can be obtained: T=11+μ1*+μ2*η*η*T+11+μ1*+μ2*ξ*ξ*T T = {1 \over {1 + \mu _1^* + \mu _2^*}}{\eta ^*}{\eta ^{*T}} + {1 \over {\sqrt {1 + \mu _1^* + \mu _2^*}}}{\xi ^*}{\xi ^{*T}}

Image restoration

Note 7. First, the repair model based on variational expression. The expression form of divergence operator of TV repair model can be obtained by combining with Euler_Lagrange equation. Without analysing the normalisation factor A, the actual expression formula is as follows: It=div(I||I||)+λe(II0) {{\partial I} \over {\partial t}} = {\rm{div}}\left({{{\nabla I} \over {||\nabla I||}}} \right) + {\lambda _e}(I - {I^0})

The calculation formula of the corresponding diffusion tensor D is: D=1||I||Id D = {1 \over {||\nabla I||}}Id

Therefore, it is proved that D belongs to a diagonal matrix, and part of the behaviour of TV repair model can be regarded as nonlinear isotropic diffusion. At the same time, combining with the above analysis and research on the Φ functional, it can be clear that the trace operator expression formula of the corresponding model is: It=0Iηη+1||I||Iξξ=trace(TH) {{\partial I} \over {\partial t}} = 0{I_{\eta \eta}} + {1 \over {||\nabla I||}}{I_{\xi \xi}} = trace(TH)

And the expression formula of T is: T=cηηηT+cξξξT=1||I||ξξT=1||I||3(IxIyIx2IyIxIy2) T = {c_\eta}\eta {\eta ^T} + {c_\xi}\xi {\xi ^T} = {1 \over {||\nabla I||}}\xi {\xi ^T} = {1 \over {||\nabla I|{|^3}}}(\mathop {- {I_x}{I_y}}\limits_{I_x^2}- {\mathop {{I_y}}\limits_{{I_x}{I_y}}\ ^2})

At this point, the eigenvector of T represents gradient direction η and vertical direction ξ, and the corresponding eigenvalues are 0 and.

Considering the above repair algorithm from the perspective of comprehensive adaptive threshold and multi-scale, it can be seen that the constant A needs to be introduced into the following formula, whose essence is to prevent 0 items from appearing in the denominator. Meanwhile, the uniqueness of this repair model can be determined after studying the influence of different choices of A on the repair. It=div(Ia2+||I||2)+λe(II0) {{\partial I} \over {\partial t}} = {\rm{div}}\left({{{\nabla I} \over {\sqrt {{a^2} + ||\nabla I|{|^2}}}}} \right) + {\lambda _e}(I - {I^0})

Combined with the above formula analysis, it can be seen that under the condition of a ||I||, it can be approximated as: Itdiv(Ia)+λe(II0)ΔI+λe(II0) \matrix{{{{\partial I} \over {\partial t}}} \hfill & {\approx {\rm{div}}\left({{{\nabla I} \over a}} \right) + {\lambda _e}(I - {I^0})} \hfill\cr{} \hfill & {\approx \Delta I + {\lambda _e}(I - {I^0})} \hfill\cr}

Open Problem 8

In other words, under a ||I||, the effect of the above formula is approximately linear isotropic diffusion.

Second, the repair model based on divergence operator expression. Although using the variational method to deal with and analyse the denoising model can provide a global explanation for the denoising process, part of the flexibility of model design will be lost, and an efficient repair model cannot be obtained. Therefore, it is necessary to use more local expression forms to deal with the problem, namely discrete operator and trace operator. Taking the curvature-driven (CDD) repair model as an example, D is regarded as the area waiting to be repaired, and E is regarded as the outer neighbourhood of the area waiting to be repaired. Under the condition of no noise analysis, the TV repair model can be simplified as: minED||I||dxdy \min {\in _{E \cup D}}||\nabla I||dxdy

The actual equation of the most rapid descent is: It=div(1||I||I) {{\partial I} \over {\partial t}} = {\rm{div}}\left({{1 \over {||\nabla I||}}\nabla I} \right)

The Fast Curvature Driven (FCDD) repair model improves the actual computing speed on the basis of the original model, and the specific form is shown as follows: It=div(g(|k|)I) {{\partial I} \over {\partial t}} = {\rm{div}}(g(|k|)\nabla I)

Thirdly, the repair model based on trace operator expression. The repair model with divergence operator as the core mainly regards the repair process as a process of information diffusion to the damaged area. The core of the application of this model is that the diffusion characteristic of each point in the damaged area is the corresponding diffusion tensor. Since the diffusion tensor contained in the circuit operator cannot fully and intuitively present the actual diffusion situation, the reference trace operator should be written to express it. Generally speaking, trace operator expression will push information into the damaged area one by one in a smooth way. It is same as the expression form of divergence operator, and its design core is also a diffusion tensor. Taking the self-aware repair model as an example, it is assumed that I0 represents the original image, D represents the area waiting to be repaired, and DC refers to the complement of D, that is, the clear area without damage in the image. In this case, the image repair model based on trace operator expression is: {It=trace(TH),XDI=I0,XDc \left\{{\matrix{{{{\partial I} \over {\partial t}} = trace(TH),X \in D}\cr{I = {I^0},X \in {D^c}}\cr}} \right.

In the above formula, H represents the Hessian matrix and T represents the diffusion tensor, which can intuitively present the smooth behaviour of some regions of the model.

The key difficulty of using trace operator expression to design image repair model lies in diffusion tensor T, which is related to the corresponding feature value λ12 as follows: T=λ1uuT+λ2vvT T = {\lambda _1}u{u^T} + {\lambda _2}v{v^T}

In the curvature-driven directional 1DLaplaicans repair model, the final solution can be calculated using the classical time-stepping method, which can be divided into the following points:

The central difference method is used to analyse the first-order spatial derivatives Ix, Iy and the second-order spatial derivatives Ixx, Iyy and Ixy;

Calculate the curvature K and integrate it into the structural tensor field S and Hessian matrix field H, as follows: k=IxxIy22IxIy+IyyIx2(Ix2+Iy2)3/2 k = {{{I_{xx}}I_y^2 - 2{I_x}{I_y} + {I_{yy}}I_x^2} \over {{{(I_x^2 + I_y^2)}^{3/2}}}} S=(Ix2IxyIxyIy2) S = \left({\matrix{{I_x^2} & {{I_{xy}}}\cr{{I_{xy}}} & {I_y^2}\cr}} \right) H=(IxxIxyIxyIyy) H = \left({\matrix{{{I_{xx}}} & {{I_{xy}}}\cr{{I_{xy}}} & {{I_{yy}}}\cr}} \right)

Clarifying the smooth connecting tensor field S*, and clarifying the local structure geometry μ1* \mu _1^* , μ2* \mu _2^* and η** on the basis of the decomposition of characteristic values.

Calculate the diffusion tensor T with the following formula: T=11+1/|k|η*η*T+ξ*ξ*T T = {1 \over {1 + 1/|k|}}{\eta ^*}{\eta ^{*T}} + {\xi ^*}{\xi ^{*T}} Calculate the iteration rate β of PDE: β=trace(TH) \beta= trace(TH)

Update the image: I(n+1)=I(n)+Δtβ {I^{(n + 1)}} = {I^{(n)}} + \Delta t\beta

In the above formula, Δ T represents the length of the time distribution, and I represents the value of the waiting repair point at the time of N Δ T.

Repeat the above steps until the repair work is completed [5, 6].

Result analysis

From the combination of the hierarchical diagram analysis of the expression of variational, divergence and trace operators as shown in Figure 1, it can be observed that three expression models for image denoising and restoration are proposed in order to optimise the application effect of the digital model of the animation scene in this paper. Figure 2 shows the repair effect. In the variational restoration model, the results obtained by the restoration of this image are shown in Figure 3.

Fig. 1

Hierarchical relationship analysis diagram.

Fig. 2

Repair effect of scratches.

Fig. 3

Curve change diagram of image change.

According to the analysis of Figure 3, (a) represents the original TV model algorithm, (b) represents the adaptive threshold model algorithm and (c) represents the comprehensive adaptive threshold and multi-scale repair algorithm. It can be seen from the variation of the curve value that the actual repair time of the original algorithm will get higher and higher as the number of iterations increases. The same is true for the adaptive threshold, the comprehensive adaptive threshold and the multi-scale repair algorithm, but compared with the comprehensive adaptive threshold and the multi-scale repair algorithm, the number of iterations and repair time are less [7].

In the model based on divergence operator expression, the time required by CDD and FCDD algorithm in image restoration and the final rendering effect are compared and analysed, as shown in the Table 1.

The number and time of iterations required by CDD and FCDD models

Bar The ring Face LAKE
CDD FCDD CDD FCDD CDD FCDD CDD FCDD
Number of iterations 19980 824 47012 3972 47841 550 13822 598
Repair time 94.3 s 7.3 s 1433.3 s 125.0 s 987.6 s 11.9 s 307 s 13.3 s
Number of restored pixels 150 1659 894 992

CDD, curvature-driven; FCDD, fast curvature driven.

In the model based on trace operator expression, the simulated image and the real image are used for comparative experimental analysis, and the final results of the overview model, the geometric adaptive repair model and the TV model are compared and studied. Through the observation test in this paper, on the edge of the algorithm to the damaged area larger vertical and inclined to repair ability, the damaged area is to initialise white before repair, and the results of the TV to repair the false edge, geometric adaptive model repair results cannot be damaged area of the inner region surrounding the spread of information, This is bound to form a false edge in the damaged edge area. From the observation of the repair results of the model outlined in this paper, we can see that the information is fully diffused to the damaged area and the sharpness of the repair edge can be ensured [8, 9].

Conclusion

To sum up, combining the research and analysis of the variational PDE image denoising and restoration technology, it can be seen that the requirement of image detailed processing is extremely high in the application of the creation of digital model of animation scene based on variational PDEs. Therefore, although some achievements have been made in the practical development, there are still many challenges. So, in the future, researchers, with the continuous optimisation and promotion of network technology, should make use of variational PDEs to do image denoising and restoration according to the requirements of image processing on the basis of a comprehensive understanding of the creation requirements of digital models of animation scenes.

eISSN:
2444-8656
Język:
Angielski
Częstotliwość wydawania:
Volume Open
Dziedziny czasopisma:
Life Sciences, other, Mathematics, Applied Mathematics, General Mathematics, Physics