검색
Article Search

JMB Journal of Microbiolog and Biotechnology

OPEN ACCESS eISSN 0454-8124
pISSN 1225-6951
QR Code

Article

Kyungpook Mathematical Journal 2020; 60(4): 869-881

Published online December 31, 2020

Copyright © Kyungpook Mathematical Journal.

A Regularization-direct Method to Numerically Solve First Kind Fredholm Integral Equation

Zahra Masouri*, Saeed Hatamzadeh

Department of Mathematics, Islamshahr Branch, Islamic Azad University (IAU), Tehran, Iran
e-mail : nmasouri@yahoo.com
Department of Electrical Engineering, Islamshahr Branch, Islamic Azad University (IAU), Tehran, Iran
e-mail : s.hatamzadeh@yahoo.com

Received: June 7, 2019; Revised: January 9, 2020; Accepted: May 30, 2020

Most first kind integral equations are ill-posed, and obtaining their numerical solution often requires solving a linear system of algebraic equations of large condition number, which may be difficult or impossible. This article proposes a regularization-direct method to numerically solve first kind Fredholm integral equations. The vector forms of block-pulse functions and related properties are applied to formulate the direct method and reduce the integral equation to a linear system of algebraic equations. We include a regularization scheme to overcome the ill-posedness of integral equation and obtain a stable numerical solution. Some test problems are solved using the proposed regularization-direct method to illustrate its efficiency for solving first kind Fredholm integral equations.

Keywords: first kind Fredholm integral equation, regularization method, block-pulse functions, vector forms, numerical solution

Integral equations beside the other forms of functional equations such as integro-differential and differential equations, are widely used for mathematical modeling many problems in physical science and engineering. Such models have often no analytical solution, hence obtaining approximate solutions requires a suitable numerical method.

On the other hand, most physical mediums used in engineering problems are linear, i.e., they can be expressed by linear constitutive relationships. Mathematical modeling in such mediums leads to linear functional equations. In particular, the first kind Fredholm integral equation model is an appropriate tool to model many related structures.

First kind Fredholm integral equations are inherently ill-posed, hence solutions are generally unstable. This makes numerical solutions very difficult, since a small error can lead to unbounded errors. Indeed, solutions for ill-posed problems may not exist, or may not be unique [11, 12, 4, 7, 6, 8]. This intrinsic ill-posedness is often the main challenge to analyze these problems. Therefore, it is important to provide an appropriate method to obtain stable solutions for first kind Fredholm integral equations.

This article proposes a regularization-direct method for numerical solution of first kind Fredholm integral equations using the vector forms of block-pulse functions (BPFs) and related properties. We express the first kind integral equation as a second kind Fredholm integral equation and include a regularization parameter. BPFs vector forms are then applied to the latter integral equation and the solution reduces to solving a linear system of algebraic equations due to BPF properties. The main advantages of the proposed regularization-direct method are as follows.

  • · Obtain a convergent numerical solution for first kind Fredholm integral equation.

  • · Avoids projection methods such as collocation, Galerkin, etc.

  • · Accuracy is satisfactory.

  • · The algorithm is simple and clear to use and can be easily implemented.

The remainder of this paper is organized as follows. Section 2 reviews some previous regularization methods for solving first kind integral equations. Section 3 provides a brief review on BPFs and their vector forms. Section 4 proposes the regularization-direct method for numerical solution of first kind Fredholm integral equations and Section 5 provides error analysis and evaluates convergence associated with the proposed method. Section 6 solves some test problems using the proposed method to illustrate its computational efficiency with and without regularization. Section 7 summarizes and concludes the paper.

Regularization methods construct stable approximate solution for ill-posed problems, and several such methods have been previously proposed to solve ill-posed first kind Fredholm integral equations. This section reviews some related regularization methods.

Consider a general form first kind Fredholm integral equation

abk(s,t)x(t)dt=f(s),  asb,

where k is the kernel, f is a known function, and x is the unknown function to be determined.

Let us consider Kx=f, rather than (2.1), where operator K:XY is abk(s,t)x(t)dt. We can assume that the linear operator K is injective without loss of generality, since uniqueness for a linear operator can always be achieved by a suitable modification of the solution space X [11]. (A discussion on injectivity for a class of integral operators may be found in [10].)

We want to find an approximation of the unbounded inverse operator K1:YX by a bounded linear operator R:YX with regularization. This can be accomplished using the following definition.

Definition 2.1. Let X and Y be normed spaces and let K:XY be an injective bounded linear operator. Then a family of bounded linear operators Rα:YX, α>0, with the property of pointwise convergence limα0RαKx=x, xX, is called a regularization scheme for the operator K. The parameter α is called the regularization parameter [11].

It is concluded from Definition 2.1 that limα0Rαf=K1f, for all fKx.

Several approaches to solve these equations have been proposed using regularization techniques.

Phillips [16] developed a method to solve Fredholm integral equations using the quadrature rule with a regularization technique. Twomey [22] subsequently improved the method.

Lavrentiev [13] proposed a regularization method to solve first kind integral equations with square-integrable, symmetric, and positive-definite kernels.

Tikhonov [19] used the same restrictions as Lavrentiev to consider the following second kind integral equation rather than (2.1),

ab k*(s,t)x(t)dt+γx(s)=f*(s),

where

k*(s,t)=k*(t,s)=ab k(z,t)k(z,s)dz,f*(s)=ab k(z,s)f(z)dz,

and γ is the regularization parameter.

Moreover, Tikhonov introduced some other regularization methods to solve first kind integral equations in [20] and [21].

Essah and Delves [5] developed a cross-validation scheme to automatically set two introduced regularization parameters (constraints) to solve first kind integral equations by using a Chebyshev series method.

Caldwell [1] considered the simplest form of regularization

abk(s,t)xε(t)dt+εxε(s)=f(s),

where ε is a small, positive parameter. He pointed out that this could establish

limε0xε(s)x(s)=0

in the L2-norm, but this convergence is not uniform.

Wazwaz [23] proposed a regularization-homotopy method to solve first kind Fredholm integral equations by combining regularization with homotopy perturbation to handle the ill-posedness.

Neggal et al. [15] considered a variant of projected Tikhonov regularization to solve first kind Fredholm integral equations. They provided a theoretical analysis in Hilbert space and established some convergence rates under certain regularity assumptions on the exact solution and kernel.

Rashed [18] introduced another method to treating first and second kind Fredholm and Volterra integral equations, and tested the method for various numerical examples.

A regularization method already proposed by Wazwaz was developed by Ziyaee and Tari [24] to linear and nonlinear two-dimensional first kind Fredholm integral equations. The regularization method was used for linear equations directly, but nonlinear first kind equations were transformed to first kind linear equations by a change of variable, and then the regularization method was applied.

An m-set of BPFs is defined over interval [0,H) as [17, 3, 2, 14, 9]

φi(t)=1,iHmt<(i+1)Hm,0,otherwise,

where i=0, 1, ..., m-1, and m is a positive integer. Consider h=H/m, and let i be the ith BPF.

The most important BPFs properties are disjointness, orthogonality, and completeness.

We can express the first m terms of BPFs as an m-vector

Φ(t)=[φ0(t),φ1(t),,φm1(t)]T,  t[0,H),

where superscript T indicates transposition. Above representation and disjointness property follows

Φ(t)ΦT(t)V=V˜Φ(t),

where V is an m-vector and V˜=diag(V). Moreover, it can be clearly concluded that for any m×m matrix B

ΦT(t)BΦ(t)=B^TΦ(t),

where B^ is an m-vector with elements equal to the diagonal entries of B. Also

0HΦ(t)dt=[h,h,,h]T,

and

0HΦ(t)ΦT(t)dt=hI,

where I is the m×m identity matrix.

The expansion of a function f over [0,H) with respect to i, i=0,1,…,m-1, may be compactly written as [9, 14]

f(t) i=0 m1fiφi(t)=FTΦ(t)=ΦT(t)F,

where F=[f0,f1,,fm1]T and fis are defined by

fi=1h0H f(t)φi(t)dt.

Let us assume k is a function of two variables in L2([0,H)×[0,H)), where L2 is the space of square integrable functions. It can be similarly expanded with respect to BPFs as

k(s,t)ΦT(s)KΨ(t),

where Φ and Ψ are m1- and m2-dimensional BPF vectors respectively, and K is the m1×m2 block-pulse coefficient matrix with kij, i=0,1,,m11, j=0,1,,m21, as follows:

kij=m1m20H 0 H k(s,t)φi(s)ψj(t)dsdt.

For convenience, we put m1=m2=m.

This article assumes that BPFs are defined over an arbitrary interval [a,b). All the above properties and relations can be generalized over this interval.

We propose an effective regularization-direct method to numerically solve first kind Fredholm integral equation using the results obtained in the previous section for BPFs.

Consider first kind Fredholm integral equation of the form

abk(s,t)x(t)dt=f(s),  as<b,

where k and f are known and x is the unknown function to be determined. Moreover, kL2([a,b)×[a,b)) and fL2([a,b)).

Equation (4.1) can be expressed as a second kind Fredholm integral equation

αxα(s)+abk(s,t)xα(t)dt=f(s),  as<b,

where we assume the regularization parameter α0. Solutions for (4.1) and (4.2) will be identical if α0. Therefore, we focus on the solution for (4.2).

Approximating k, f, and xα with respect to BPFs, using (3.7) and (3.9), gives

k(s,t)ΦT(s)KΦ(t),f(s)FTΦ(s)=ΦT(s)F,xα(s)XαTΦ(s)=ΦT(s)Xα,

where m-vectors F and xα, and m×m matrix K are BPFs coefficients of f, xα, and k, respectively, and xα is the unknown vector to be obtained.

Substituting (4.3) into (4.2),

αΦT(s)Xα+ab Φ T(s)KΦ(t)ΦT(t)XαDtΦT(s)F.

Therefore,

αΦT(s)Xα+ΦT(s)Kab Φ(t)ΦT(t)dtXαΦT(s)F,

and hence from (3.6)

ΦT(s)αXα+ΦT(s)hKXαΦT(s)F,

or

αXα+hKXαF.

Replacing with =,

(αI+hK)Xα=F,

which is a linear system of algebraic equations in terms of unknown vector Xα=[xα0,xα1,,xαm1]T. Solving this system and computing Xα provides solution xα(s)XαTΦ(s) for (4.2) which will be in terms of α. When α0 the approximate solution x(s) for first kind Fredholm integral equation (4.1) is

x(s)=limα0xα(s)limα0XαTΦ(s).

This section investigates the proposed regularization-direct method convergence.

Error for the proposed method has two parts, one related to the direct method (particularly BPF expansion) and the other due to the regularization method.

Consider Kx=f (defined in Section 2), where K:XY. Assume Rα:YX is the regularization operator. Let xαm=XαTΦ(s) be the approximate solution for (4.1), computed by the proposed method, where m is the number of BPFs and α is the regularization parameter, and x is the exact solution of (4.1). Then

xαmx=Rαfmx=RαfmRαf+Rαfx=RαfmRαf+RαKxx,

and from the triangle inequality

xαmxRαfmRαf+RαKxx.

Therefore,

xαmxRαfmf+RαKIx,

where I is the identity operator.

This decomposition shows that the error consists of two parts. The first term reflects error from the BPF expansion and the second term is due to approximation error between . and K1, where limα0Rα=K1.

From Definition 2.1, the second error term will decrease as α approaches zero, i.e., limα0RαKI=0.

The following lemma applies to the first term.

Lemma 5.1. The representation error (or the residual error) when a differentiable function f(t) is represented in a series of m BPFs is [17]

fmf123mSUP[0,H](f'(t)).

Hence, from Lemma 5.1, the first error term in (5.3) will decrease as m increases.

Therefore, we should choose an appropriate m to achieve an acceptable total error.

Finally, the relation (5.3) shows that the proposed regularization-direct method has satisfactory convergence.

We present several test problems solved using the proposed regularization-direct method with their related numerical results to illustrate the proposed method's computational efficiency.

Approximate results were calculated for each test problem for two sets of points as follows.

  • i. The set of mid-points of the m subintervals [a+ih,a+(i+1)h) of interval [a,b), where i=0,1,…,m-1, and h=(b-a)/m.

  • ii. The set of ten specific points si in interval [a,b) such that si=a+ih', where i=0,1,…,9, and h'=(b-a)/10

The results are presented as mean-absolute error. If we obtain the approximate solution at N points si for a given m, then the mean-absolute error for this m can be expressed as

E=1N i=0 N1|x(si)x¯(si)|,

where x and x¯ are the exact and approximate solutions, respectively, and we set N=m and N=10 to calculate E at the mid-points and ten points, respectively.

Test Problem 6.1.

Consider the first kind Fredholm integral equation

01k(s,t)x(t)dt=f(s),  0s<1,

where k(s,t)=sin(s+t) and f(s)=14((1cos(2))cos(s)+(2+sin(2))sin(s)), with exact solution x(s)=cos(s). Table 1 shows mean-absolute errors for the direct method, with and without regularization, for different m and α0.

Table 1 . Mean-absolute error for the solution to test problem 6.1 at mid-points and ten specific points, for different m and α" 0..

mMean-absolute error at mid-pointsMean-absolute error at ten points


Proposed regularization-direct methodDirect method Without regularizationProposed regularization-direct methodDirect method Without regularization
27.3 e-3 7.3 e-3 6.2 e-2 6.2 e-2
42.9 e-3 6.8 e-1 2.7 e-2 1.6 e0
81.4 e-3 3.8 e0 1.3 e-2 5.4 e0
167.0 e-4 1.7 e+1 6.3 e-3 1.6 e+1
323.5 e-4 7.0 e+1 3.0 e-3 3.4 e+1
641.7 e-4 2.9 e+2 1.5 e-3 1.4 e+2


Test Problem 6.2.

Consider the first kind Fredholm integral equation

01k(s,t)x(t)dt=f(s),  0s<1,

where k(s,t)=texp(ts) and f(s)=12exp(s), with solution x(s)=exp(s). Table 2 shows the results for α0.

Table 2 . Mean-absolute error for the solution to test problem 6.2 at mid-points and ten specific points, for different m and α" 0..

mMean-absolute error at mid-pointsMean-absolute error at ten points


Proposed regularization-direct methodDirect method Without regularizationProposed regularization-direct methodDirect method Without regularization
26.2 e-32.5 e -19.2 e-21.3 e0
43.2 e-31.4 e04.6 e-24.2 e0
81.6 e-36.2 e02.3 e-21.2 e+1
168.2 e-42.5 e +11.1 e-22.5 e+1
324.1 e-41.0 e +25.7 e-31.0 e+2
642.1 e-44.1 e +22.8 e-34.1 e+2


Test Problem 6.3.

Consider the first kind Fredholm integral equation

01k(s,t)x(t)dt=f(s),  0s<1,

where k(s,t)=2st2 and f(s)=12s, with exact solution x(s)=s. Table 3 shows the results for α0.

Table 3 . Mean-absolute error for the solution to test problem 6.3 at mid-points and ten specific points, for different m and α" 0..

mMean-absolute error at mid-pointsMean-absolute error at ten points


Proposed regularization-direct methodDirect method Without regularizationProposed regularization-direct methodDirect method Without regularization
29.1 e-36.5e-11.4 e-13.3e0
44.3 e-35.0 e06.7 e-21.5 e+1
82.1 e-33.9 e+13.3 e-27.7 e+1
161.0 e-33.1 e+21.6 e-23.1 e+2
325.2 e-42.5 e+38.1 e-32.5 e+3
642.6 e-42.0 e+44.1 e-32.0 e+4


Test Problem 6.4.

Consider the first kind Fredholm integral equation [18]

01k(s,t)x(t)dt=f(s),  0s<1,

where k(s,t)=t(s1),ts,s(t1),t>s, and f(s)=exp(s)+(1exp(1))s1, with exact solution x(s)=exp(s). Figure 1 shows the results obtained by the proposed method at mid-points for m=4 and α0.

Figure 1. Numerical results for test problem 6.4 with m=4 and α " 0, using the proposed method.

Test Problem 6.5.

Consider the first kind Fredholm integral equation [15]

01k(s,t)x(t)dt=f(s),  0s<1,

where k(s,t)=exp(s2t) and f(s)=(exp(s2+1)1)/(s2+1), with exact solution x(s)=exp(s). Figure 2 shows the results at mid-points for m=8 and α=1, e8.

Figure 2. Numerical results for test problem 6.5 with m=8 and α=1 e-8, using the proposed method.

The numerical results generally confirm that the proposed regularization-direct method provides a stable approximate solution with sufficient accuracy for first kind Fredholm integral equation; whereas only unstable solutions are found without regularization. The reduction rate for the mean absolute errors confirms the proposed method has satisfactory convergence.

We proposed a regularization-direct method to numerically solve first kind Fredholm integral equations using vector forms of BPFs and their related properties. The proposed method adopts a regularization scheme to overcome the integral equation's ill-posedness. Various test problems confirmed that the proposed method can provide stable and convergent numerical solutions with reasonable accuracy for first kind Fredholm integral equations.

  1. J. Caldwell, Numerical study of Fredholm integral equations, Int. J. Math. Edu. Sci. Tech., 25(1994), 831-836.
    CrossRef
  2. A. Deb, G. Sarkar, M. Bhattacharjee, and S. K. Sen, All-integrator approach to linear SISO control system analysis using block pulse functions (BPF), J. Franklin Institute, 334B(2)(1997), 319-335.
    CrossRef
  3. A. Deb, G. Sarkar, and S. K. Sen, Block pulse functions, the most fundamental of all piecewise constant basis functions, Internat. J. Systems Sci., 25(2)(1994), 351-363.
    CrossRef
  4. L. M. Delves and J. L. Mohamed, Computational methods for integral equations, Cambridge University Press, Cambridge, 1985.
    CrossRef
  5. W. A. Essah and L. M. Delves, The numerical solution of first kind integral equations, J. Comput. Appl. Math., 27(1989), 363-387.
    CrossRef
  6. M. A. Golberg and C.-S. Chen, Discrete projection methods for integral equations, Computational Mechanics Publications, Southampton and Boston, 1997.
  7. C. W. Groetsch, The theory of Tikhonov regularization for Fredholm integral equations of the first kind, Pitman Advanced Publishing Program, Boston, 1984.
  8. P. C. Hansen, Numerical tools for analysis and solution of Fredholm integral equations of the first kind, Inverse Problems, 8(1992), 849-887.
    CrossRef
  9. S. Hatamzadeh-Varmazyar and Z. Masouri, Numerical method for analysis of one- and two-dimensional electromagnetic scattering based on using linear Fredholm integral equation models, Math. Comput. Modelling, 54(9)(2011), 2199-2210.
    CrossRef
  10. Y. Hu, S. M. Schennach, and J.-L. Shiu, Injectivity of a class of integral operators with compactly supported kernels, J. Econometrics, 200(1)(2017), 48-58.
    CrossRef
  11. R. Kress, Linear integral equations, Springer-Verlag, Berlin, 1989.
    CrossRef
  12. P. K. Kythe and P. Puri, Computational methods for linear integral equations, Birkhäuser, Boston, 2002.
    CrossRef
  13. M. M. Lavrentiev, Some improperly posed problems of mathematical physics, Springer-Verlag, New York, 1967.
    CrossRef
  14. Z. Masouri, E. Babolian, and S. Hatamzadeh-Varmazyar, An expansion-iterative method for numerically solving Volterra integral equation of the first kind, Comput. Math. Appl., 59(4)(2010), 1491-1499.
    CrossRef
  15. B. Neggal, N. Boussetila, and F. Rebbani, Projected Tikhonov regularization method for Fredholm integral equations of the first kind, J. Inequal. Appl., (2016), Paper No. 195, 21 pp.
    CrossRef
  16. D. L. Phillips, A technique for the numerical solution of certain integral equations of the first kind, J. Assoc. Comput. Mach., 9(1962), 84-97.
    CrossRef
  17. C. P. Rao, Piecewise constant orthogonal functions and their application to systems and control, Springer, Berlin, 1983.
  18. M. T. Rashed, An expansion method to treat integral equations, Appl. Math. Comput., 135(2003), 65-72.
    CrossRef
  19. A. N. Tikhonov, On the solution of ill-posed problems and the method of regularization, Dokl. Akad. Nauk SSSR, 151(3)(1963), 501-504.
  20. A. N. Tikhonov, On the regularization of incorrectly posed problems, Dokl. Akad. Nauk SSSR, 153(1)(1963), 49-52
  21. A. N. Tikhonov and V. Y. Arsenin, Solutions of ill-posed problems, John Wiley & Sons, Washington D. C., 1977.
  22. S. Twomey, On the numerical solution of Fredholm integral equations of the first kind by the inversion of the linear system produced by quadrature, J. Assoc. Comput. Mach., 10(1963), 97-101.
    CrossRef
  23. A. M. Wazwaz, The regularization-homotopy method for the linear and non-linear Fredholm integral equations of the first kind, Commun. Numer. Anal., (2011), Art. ID cna-00105, 11 pp.
    CrossRef
  24. F. Ziyaee and A. Tari, Regularization method for the two-dimensional Fredholm inte-gral equations of the first kind, Int. J. Nonlinear Sci., 18(3)(2014), 189-194.