Skip to main content

A computational method using multiresolution for volumetric data integration

Abstract

In this paper, we present a new method for integration of 3-D medical data by utilizing the advantages of 3-D multiresolution analysis and techniques of variational calculus. We first express the data integration problem as a variational optimal control problem where we express the displacement field in terms of wavelet expansions and, secondly, we write the components of the displacement field in terms of wavelet coefficients. We solve this optimization problem with a blockwise descent algorithm. We demonstrate the registration of 3-D brain MR images in the size of 257×257×65 as an application of the present method. Experimental results indicate that the method can integrate 3-D MR images better than only variational or only wavelet-based methods.

MSC: 68U10, 65D18, 65J05, 97N40.

1 Introduction

The main purpose of this paper is to present an efficient 3-D medical data (image) integration technique. Image integration (sometimes called registration or matching) can be described as finding a spatial correspondence between pixels (or voxels) of two images that maximizes the similarity between the two images. The images could be of the same or different objects and imaging modalities and possibly be taken at different distances, angles, and times. Detecting tumors, locating diseased areas, monitoring changes in an individual, drug discovery, image fusion, feature matching, and motion tracking are some of the important applications of the image registration problem. So far a general theory for image matching has yet to be established. Each application venue has developed its own approaches and implementations. As a result, a single standard method for image integration has not emerged. Therefore, finding reliable and efficient image integration techniques along with fast implementation methods is significantly important and active research area. Some of the well-known image integration algorithms can be seen in [1–5] and in the references therein.

Structure of this paper is as follows. In Section 2, we present an algorithm for integration of 3-D medical data by utilizing the advantages of 3-D multiresolution analysis and techniques of variational calculus. In Section 10, we present some experimental results regarding the integration of MR images as an application of the present method. We complete the paper with a final section where we briefly summarize the paper and discuss the future extensions.

2 Multiresolution approach for deformation field

Assume that both the template T(x) and reference R(x) images are defined on the same domain Ω⊂ R 3 . Because reference and template images are obtained from different distances, angles, times, sensors, and sometimes even by different individuals, a displacement field may occur between the reference and template images. One of the major goals of this paper is to compute the deformation field in a systematic way.

A deformation field is a vector image that maps reference image pixel coordinates to the coordinates of the corresponding template image pixels. Consider the deformations of the form

ϕ u (x):=x+u(x),x=( x 1 , x 2 , x 3 )∈Ω,u(x)= ( u 1 ( x ) , u 2 ( x ) , u 3 ( x ) ) ,
(1)

where u(x) denotes a displacement field. Because both the template T(x) and reference R(x) images are almost surely ‘the same’ images, we can write

R( x 1 , x 2 , x 3 )≈T ( ( x 1 , x 2 , x 3 ) + u ( x 1 , x 2 , x 3 ) ) =T ( x 1 + u 1 ( x ) , x 2 + u 2 ( x ) , x 3 + u 3 ( x ) ) .
(2)

In this paper, we exploit 3-D Haar wavelets. When expanding the displacement field u(x) in terms of a wavelet decomposition, it is necessary to take into account the wavelet parameters (coefficients) α, which yields that

ϕ u (x)= [ x 1 + u 1 ( x 1 , x 2 , x 3 , α ) x 2 + u 2 ( x 1 , x 2 , x 3 , α ) x 3 + u 3 ( x 1 , x 2 , x 3 , α ) ] .

The major goal of this paper is to compute the displacement field u(x) in a systematic way. We express each of u i , i=1,2,3, in terms of wavelet coefficients. Therefore, computing these wavelet coefficients will be enough to obtain the displacement field u(x).

A multiresolution analysis of L 2 (Ω), Ω= R 3 is a partially ordered set of closed linear subspaces

{ V n ⊂ L 2 ( Ω ) } n ∈ Z 3

with properties:

  1. (1)

    ⋂ n V n ={0}; ⋃ n V n ⊂ dense L 2 (Ω);

  2. (2)

    f(x)∈ V n ⟺f( 2 m x)∈ V n + m , for every n∈ Z 3 , m∈E;

  3. (3)

    f(x)∈ V n ⟺f(x− 2 − k )∈ V n , for every k∈ Z 3 , n∈E;

  4. (4)

    There exists Φ∈ V 0 such that { Φ ( x − k ) } k ∈ Z 3 is a Riesz basis for V 0 .

Here n=( n 1 , n 2 , n 3 ), 2 n =( 2 n 1 , 2 n 2 , 2 n 3 ), 0=(0,0,0)∈ N 3 , x=( x 1 , x 2 , x 3 )∈ R 3 , 2 n =( 2 n 1 x 1 , 2 n 1 x 2 , 2 n 1 x 3 ). The function Φ(x) is called the scaling function of the multiresolution analysis. Detailed information about multiresolution analysis and wavelets might be seen in [6]. Let Ω= ( 0 , 1 ) 3 ⊂ R 3 be the open unit cube. For any n∈ Z 3 , we introduce the function space V n : the space of piecewise constant functions on a uniform grid with mesh size h=( 2 − n 1 , 2 − n 2 , 2 − n 3 ). These grids are uniformly spaced in each of the three coordinate directions, but possibly with a different mesh size in the different directions. The volume of these cells is denoted by h 3 = 2 − ( n 1 + n 2 + n 3 ) . The functions in V n are all constant in each cell defined by

Ω n , k := [ k 1 2 − n 1 , ( k 1 + 1 ) 2 − n 1 ] × [ k 2 2 − n 2 , ( k 2 + 1 ) 2 − n 2 ] × [ k 3 2 − n 3 , ( k 3 + 1 ) 2 − n 3 ] .
(3)

A basis V m may be generated from a scaling function Φ. In order to deal with 3-D deformation field, to each component of the displacement field, a multiresolution decomposition is applied. At scale m, i.e., in the space V m , the displacement field u m =( u 1 m , u 2 m , u 3 m ) will be parameterized by the vector

α m := [ α x 1 , i , j , k m , α x 2 , i , j , k m , α x 3 , i , j , k m ]

as

u m ( x 1 , x 2 , x 3 ,α)= [ u 1 m ( x 1 , x 2 , x 3 , α ) u 2 m ( x 1 , x 2 , x 3 , α ) u 3 m ( x 1 , x 2 , x 3 , α ) ] = [ ∑ i , j , k α x 1 , i , j , k m Φ i , j , k m ( x 1 , x 2 , x 3 , α ) ∑ i , j , k α x 2 , i , j , k m Φ i , j , k m ( x 1 , x 2 , x 3 , α ) ∑ i , j , k α x 3 , i , j , k m Φ i , j , k m ( x 1 , x 2 , x 3 , α ) ] .
(4)

Elements (scaling functions) of a basis V m are 3-D functions that are translated across the cubical grid Ω n , k . These functions are a tensor product of the 1-D scaling and wavelet functions as

Φ 1 = ϕ ( 2 − j x 1 − k 1 ) ϕ ( 2 − j x 2 − k 2 ) ϕ ( 2 − j x 3 − k 3 ) , Φ 2 = ϕ ( 2 − j x 1 − k 1 ) ϕ ( 2 − j x 2 − k 2 ) ψ ( 2 − j x 3 − k 3 ) , Φ 3 = ϕ ( 2 − j x 1 − k 1 ) ψ ( 2 − j x 2 − k 2 ) ϕ ( 2 − j x 3 − k 3 ) , Φ 4 = ϕ ( 2 − j x 1 − k 1 ) ψ ( 2 − j x 2 − k 2 ) ψ ( 2 − j x 3 − k 3 ) , Φ 5 = ψ ( 2 − j x 1 − k 1 ) ϕ ( 2 − j x 2 − k 2 ) ϕ ( 2 − j x 3 − k 3 ) , Φ 6 = ψ ( 2 − j x 1 − k 1 ) ϕ ( 2 − j x 2 − k 2 ) ψ ( 2 − j x 3 − k 3 ) , Φ 7 = ψ ( 2 − j x 1 − k 1 ) ψ ( 2 − j x 2 − k 2 ) ϕ ( 2 − j x 3 − k 3 ) , Φ 8 = ψ ( 2 − j x 1 − k 1 ) ψ ( 2 − j x 2 − k 2 ) ψ ( 2 − j x 3 − k 3 ) .

3 Optimal control formulation of data integration

The state-of-the-art image registration problem can be expressed as an optimal control problem by

min ϕ ∈ Γ J[R,T; ϕ u ]
(5)

for the functional

J[R,T; ϕ u ]= C sim [R,T; ϕ u ]+λ C reg [u],
(6)

where C sim [R,T; ϕ u ] denotes a similarity measure between the template image T and the reference image R, ϕ u (x):=x+u(x) is the deformation field, u is the displacement field, Γ is the set of all possible admissible transformations, C reg [u] is a regularization term, and λ is a regularization constant.

We choose the L 2 -norm type similarity measure defined as

C sim [ R ( x ) , T ( x ) ; ϕ u ( x ) ] := ∫ Ω ∇⋅ ( T ( x + u ( x ) ) − R ( x ) ) dx.
(7)

Note that some other similarity measures might be selected depending on the problem. We choose (7) because, as of our best knowledge, this similarity measure has not been associated with any volumetric image registration algorithm in the literature and to test the convenience of this measure in these types of applications.

Without the regularizing term in functional (6), the image registration problem (5) is ill-posed [8]; furthermore, imaging data usually is not smooth due to edges, folding, or other unwanted deformations. Ill-posed problems are widely used in PDE-based image processing problems and inverse problems. An optimization problem is said to be well posed if the solution of the problem uniquely exists and the solution depends continuously on the data of the problem. If one of these two conditions is not satisfied, it is called an ill-posed problem. Image registration is an ill-posed optimal control problem. In order to overcome the ill-posedness of the optimization problem (5) and to assure smooth solutions, we introduce additional regularization terms. The main idea behind adding a regularization term is to smoothen the problem with respect to both the functional and the solution so that well-posedness is assured and efficient computational methods can be defined to determine minimizers. Typical regularization terms associated with image registration problems include curvature, diffusion, elasticity, and fluid. Details about each of these regularization approaches can be seen, for example, in [1] and the references therein.

In this paper, we introduce a regularization term that consists of summation of two different terms defined as follows:

C reg [ u ( x ) ] := λ 1 ∫ Ω | ∇ u ( x ) | 2 + β dx+ λ 2 ∫ Ω log ( u ( x ) ) dx.
(8)

Let us further point out that the regularization term (8) has not also been associated with any volumetric data integration problem in the literature. The term ∫ Ω | ∇ u ( x ) | 2 + β dx is known as a perturbed total-variation model and has been used in image restoration problems. This model was obtained by modifying the regularization term mostly known as the Dirichlet regularization term given by

∫ Ω | ∇ u ( x ) | 2 dx,
(9)

which penalizes non-smooth images. Major shortcomings of (9) is that some image features, like edges of the original image, may show up blurred in the reconstructed image. To overcome this drawback, Rudin, Osher, and Fatemi (ROF) proposed replacing (9) with so-called total-variation (TV) seminorm ∫ Ω | ∇ u ( x ) | dx. In the solution of the optimal control problem (5), in order to prevent the degeneracy of the resulting Euler-Lagrange equations, we modify the TV-model as ∫ Ω | ∇ u ( x ) | 2 + β dx, where β is an arbitrarily small perturbation parameter. Another regularization term that we use is ∫ Ω log(u(x))dx. This term is added to make the regularization term original and to see its impact on the volumetric data integration problems.

Having said these, we can express the cost function of the optimization problem (5) as

J [ R , T ; ϕ u ] = ∫ Ω ∇ ⋅ ( T ( x + u ( x ) ) − R ( x ) ) d x + λ 1 ∫ Ω | ∇ u ( x ) | 2 + β d x + λ 2 ∫ Ω log ( u ( x ) ) d x .

This is a variational [7] convex optimization problem. Necessary and sufficient conditions for the existence and uniqueness of the solutions was given in [4]. Because we set up a connection between this variational optimization problem and 3-D wavelet transforms, for a given scale m, the optimal control problem can be expressed as

α ˆ m = argmin α m ∈ A m J [ C sim ( x ) , C reg ( x ) , ϕ u ( x , α m ) ] ,

where A m stands for the admissible parameter set. We apply a blockwise descent algorithm. During the minimization, the cost functional J needs to be evaluated only on Ω i , j , k m , defined as

Ω i , j , k m := [ i − 1 2 m , i + 1 2 m ] × [ j − 1 2 m , j + 1 2 m ] × [ k − 1 2 m , k + 1 2 m ] ,

which is the support of Φ i , j , k m . Inside the block, the direction of descent d∈ R 3 is computed as the opposite of the gradient ∂ J ∂ α m of the cost function J where

∂ J ∂ α m = ∫ Ω Δ ( T u ( x ) − R u ( x ) ) ∇ T u ( x ) ( ∂ u ( x ) ∂ ( α m ) t ) t d x + λ 1 ∫ Ω ∇ u ( x ) | ∇ u ( x ) | 2 ( ∂ u ( x ) ∂ ( α m ) t ) t d x + λ 2 ∫ Ω ∇ u ( x ) ′ ∇ u ( x ) ( ∂ u ( x ) ∂ ( α m ) t ) t d x .

4 Experimental results

In this section, we demonstrate the registration of brain MR images in the size of 257×257×65 as an application of the present method. The template, reference, and integrated images are shown in Figure 1. Duration of the registration is about 2 minutes, which is quite fast for 3-D medical image integration. We applied the presented method to some other brain MR images and obtained similar results.

Figure 1
figure 1

Template (top), reference (bottom left) and integrated (bottom right) images.

5 Conclusion

In this paper, we present a method for integration of 3-D medical data by utilizing the advantages of 3-D multiresolution analysis and techniques of variational calculus. We first express the data integration problem as a variational optimal control problem where we express the displacement field in terms of wavelet expansions and, secondly, we express the components of the displacement field in terms of wavelet coefficients. We solve the aforementioned optimization problem with a blockwise descent algorithm. We demonstrate the registration of 3-D brain MR images in the size of 257×257×65 as an application of the present method. Experimental results indicate that the method can integrate 3-D MR images better than only variational or only wavelet based methods. In a related work [9], a 3-D wavelet based method was presented for deformable image registration where different similarity measure, different regularization term, and different types of wavelets were used.

In future work, we will investigate the applications of this image matching technique to the registration of noisy and blurred images. Furthermore, we plan to compare the strength of these registration techniques with some well-known image registration methods in terms of speed, quality, and effectiveness in detail.

References

  1. Akinlar, MA: A new method for non-rigid registration of 3D images. Ph.D. thesis, The University of Texas at Arlington (2009)

    Google Scholar 

  2. Akinlar MA, Ibragimov RN: Application of an image registration method to noisy images. Sarajevo J. Math. 2011, 7(1):1-9.

    MathSciNet  Google Scholar 

  3. Akinlar MA, Celenk M: Quality assessment for an image registration. Int. J. Contemporary Math. Sciences 2011, 6(30):1483-1490.

    MathSciNet  Google Scholar 

  4. Akinlar MA, Kurulay M, Secer A, Bayram M: Efficient variational approaches for deformable registration of images. Abstr. Appl. Anal. 2012. doi:10.1155/2012/704567

    Google Scholar 

  5. Akinlar, MA, Kurulay, M, Secer, A, Celenk, M: Curvature driven diffusion based medical image registration methods, ICAAM (2012)

    Google Scholar 

  6. Mallat S: A Wavelet Tour of Signal Processing. Academic Press, San Diego; 2008.

    Google Scholar 

  7. Sun J, Chen H: Variational Method to the Impulsive Equation with Neumann Boundary Conditions. Bound. Value Probl. 2009., 2009: Article ID 316812. doi:10.1155/2009/316812

    Google Scholar 

  8. Denche M, Djezzar S: A modified quasi-boundary value method for a class of abstract parabolic ill-posed problems. Bound. Value Probl. 2006., 2006: Article ID 37524. doi:10.1155/BVP/2006/37524

    Google Scholar 

  9. Noblet V, Heinrich C, Heitz F, Armspach JP: 3-D deformable image registration: a topology preservation scheme based on hierarchical deformation models and interval analysis optimization. IEEE Trans. Image Process. 2005, 14(5):553-566.

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Aydin Secer.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

MAA and MK came up with the idea of combining variational methods with 3-D wavelets techniques in 3-D data integration. They designed the optimization problem in an original format and solved mathematical part of the problem. AS wrote the program of numerical solutions and implemented the solution scheme. MC suggested both to work on brain MR images and to deal with 3-D Haar type wavelets. He also interpreted the results and helped in the applications of multiresolution to MR images.

Authors’ original submitted files for images

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Akinlar, M.A., Kurulay, M., Secer, A. et al. A computational method using multiresolution for volumetric data integration. Bound Value Probl 2012, 115 (2012). https://doi.org/10.1186/1687-2770-2012-115

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1687-2770-2012-115

Keywords