Abstract
In this paper, we present a new method for integration of 3D medical data by utilizing
the advantages of 3D multiresolution analysis and techniques of variational calculus.
We first express the data integration problem as a variational optimal control problem
where we express the displacement field in terms of wavelet expansions and, secondly,
we write the components of the displacement field in terms of wavelet coefficients.
We solve this optimization problem with a blockwise descent algorithm. We demonstrate
the registration of 3D brain MR images in the size of
MSC: 68U10, 65D18, 65J05, 97N40.
Keywords:
inverse problems; variational optimization; multiresolution; image integration1 Introduction
The main purpose of this paper is to present an efficient 3D medical data (image) integration technique. Image integration (sometimes called registration or matching) can be described as finding a spatial correspondence between pixels (or voxels) of two images that maximizes the similarity between the two images. The images could be of the same or different objects and imaging modalities and possibly be taken at different distances, angles, and times. Detecting tumors, locating diseased areas, monitoring changes in an individual, drug discovery, image fusion, feature matching, and motion tracking are some of the important applications of the image registration problem. So far a general theory for image matching has yet to be established. Each application venue has developed its own approaches and implementations. As a result, a single standard method for image integration has not emerged. Therefore, finding reliable and efficient image integration techniques along with fast implementation methods is significantly important and active research area. Some of the wellknown image integration algorithms can be seen in [15] and in the references therein.
Structure of this paper is as follows. In Section 2, we present an algorithm for integration of 3D medical data by utilizing the advantages of 3D multiresolution analysis and techniques of variational calculus. In Section 10, we present some experimental results regarding the integration of MR images as an application of the present method. We complete the paper with a final section where we briefly summarize the paper and discuss the future extensions.
2 Multiresolution approach for deformation field
Assume that both the template
A deformation field is a vector image that maps reference image pixel coordinates to the coordinates of the corresponding template image pixels. Consider the deformations of the form
where
In this paper, we exploit 3D Haar wavelets. When expanding the displacement field
The major goal of this paper is to compute the displacement field
A multiresolution analysis of
with properties:
(1)
(2)
(3)
(4) There exists
Here
A basis
as
Elements (scaling functions) of a basis
3 Optimal control formulation of data integration
The stateoftheart image registration problem can be expressed as an optimal control problem by
for the functional
where
We choose the
Note that some other similarity measures might be selected depending on the problem. We choose (7) because, as of our best knowledge, this similarity measure has not been associated with any volumetric image registration algorithm in the literature and to test the convenience of this measure in these types of applications.
Without the regularizing term in functional (6), the image registration problem (5) is illposed [8]; furthermore, imaging data usually is not smooth due to edges, folding, or other unwanted deformations. Illposed problems are widely used in PDEbased image processing problems and inverse problems. An optimization problem is said to be well posed if the solution of the problem uniquely exists and the solution depends continuously on the data of the problem. If one of these two conditions is not satisfied, it is called an illposed problem. Image registration is an illposed optimal control problem. In order to overcome the illposedness of the optimization problem (5) and to assure smooth solutions, we introduce additional regularization terms. The main idea behind adding a regularization term is to smoothen the problem with respect to both the functional and the solution so that wellposedness is assured and efficient computational methods can be defined to determine minimizers. Typical regularization terms associated with image registration problems include curvature, diffusion, elasticity, and fluid. Details about each of these regularization approaches can be seen, for example, in [1] and the references therein.
In this paper, we introduce a regularization term that consists of summation of two different terms defined as follows:
Let us further point out that the regularization term (8) has not also been associated
with any volumetric data integration problem in the literature. The term
which penalizes nonsmooth images. Major shortcomings of (9) is that some image features,
like edges of the original image, may show up blurred in the reconstructed image.
To overcome this drawback, Rudin, Osher, and Fatemi (ROF) proposed replacing (9) with
socalled totalvariation (TV) seminorm
Having said these, we can express the cost function of the optimization problem (5) as
This is a variational [7] convex optimization problem. Necessary and sufficient conditions for the existence and uniqueness of the solutions was given in [4]. Because we set up a connection between this variational optimization problem and 3D wavelet transforms, for a given scale m, the optimal control problem can be expressed as
where
which is the support of
4 Experimental results
In this section, we demonstrate the registration of brain MR images in the size of
Figure 1. Template (top), reference (bottom left) and integrated (bottom right) images.
5 Conclusion
In this paper, we present a method for integration of 3D medical data by utilizing
the advantages of 3D multiresolution analysis and techniques of variational calculus.
We first express the data integration problem as a variational optimal control problem
where we express the displacement field in terms of wavelet expansions and, secondly,
we express the components of the displacement field in terms of wavelet coefficients.
We solve the aforementioned optimization problem with a blockwise descent algorithm.
We demonstrate the registration of 3D brain MR images in the size of
In future work, we will investigate the applications of this image matching technique to the registration of noisy and blurred images. Furthermore, we plan to compare the strength of these registration techniques with some wellknown image registration methods in terms of speed, quality, and effectiveness in detail.
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
MAA and MK came up with the idea of combining variational methods with 3D wavelets techniques in 3D data integration. They designed the optimization problem in an original format and solved mathematical part of the problem. AS wrote the program of numerical solutions and implemented the solution scheme. MC suggested both to work on brain MR images and to deal with 3D Haar type wavelets. He also interpreted the results and helped in the applications of multiresolution to MR images.
References

Akinlar, MA: A new method for nonrigid registration of 3D images. Ph.D. thesis, The University of Texas at Arlington (2009)

Akinlar, MA, Ibragimov, RN: Application of an image registration method to noisy images. Sarajevo J. Math.. 7(1), 1–9 (2011)

Akinlar, MA, Celenk, M: Quality assessment for an image registration. Int. J. Contemporary Math. Sciences. 6(30), 1483–1490 (2011)

Akinlar, MA, Kurulay, M, Secer, A, Bayram, M: Efficient variational approaches for deformable registration of images. Abstr. Appl. Anal. (2012) doi:10.1155/2012/704567

Akinlar, MA, Kurulay, M, Secer, A, Celenk, M: Curvature driven diffusion based medical image registration methods, ICAAM (2012)

Mallat, S: A Wavelet Tour of Signal Processing, Academic Press, San Diego (2008)

Sun, J, Chen, H: Variational Method to the Impulsive Equation with Neumann Boundary Conditions. Bound. Value Probl.. 2009, (2009) Article ID 316812. doi:10.1155/2009/316812

Denche, M, Djezzar, S: A modified quasiboundary value method for a class of abstract parabolic illposed problems. Bound. Value Probl.. 2006, (2006) Article ID 37524. doi:10.1155/BVP/2006/37524

Noblet, V, Heinrich, C, Heitz, F, Armspach, JP: 3D deformable image registration: a topology preservation scheme based on hierarchical deformation models and interval analysis optimization. IEEE Trans. Image Process.. 14(5), 553–566 (2005). PubMed Abstract