Open Access
1 July 2008 Computer-aided recognition of a four-chamber image plane in three-dimensional echocardiographic images of children
Xiaoping Liu, Xin Yang, Lanping Wu, Kun Sun, Yanfen Shang, Rudi Deklerck
Author Affiliations +
Abstract
Automated detection of the clinically relevant image planes in a three-dimensional echocardiographic (3-DE) data set has potential applications for diagnosis of pediatric congenital heart disease. We propose a method based on template matching to automatically detect the four-chamber image plane (4CIP) in a 3-DE data set. First, a normal four-chamber image is chosen as the template. Second, to find the 4CIP in a 3-D volume, a series of cross sections are extracted from this volume. Then, a coarse-to-fine retrieval is applied to the stack of slices and the image most similar to the template is proposed as the 4CIP of this volume. We tested the method on 28 data sets of normal children and 22 data sets of children suffering from congenital heart disease, and the error rates are 7 and 9%, respectively. As will be shown, the autodetection algorithm can be straightforwardly implemented, has low computational complexity, and is robust to noise.

1.

Introduction

During the retrospective review of three-dimensional echocardiographic (3-DE) data sets for diagnosis and analysis of pediatric congenital heart disease (CHD), it takes time for the medical doctor to find the clinically relevant image planes. 3-DE images are usually acquired from the parasternal, subcostal, and apical windows, but for assessment of atrioventricular septal defects, heart valve diseases, etc., the apical data sets are, in general, preferred for making the diagnosis. Among several clinically relevant image planes, the four-chamber image plane (4CIP) is the most important one. Consequently, as a preliminary study, this paper focuses on the automated detection of the 4CIP in apical data sets. This autodetection will be a useful tool for the medical doctors during retrospective review. Furthermore, it can be a prior procedure for image registration, i.e., for merging 3-DE images with images of different modalities.

The 4CIP in a 3-DE data set can be detected by aligning the volumetric data with a 3-D template image in which the 4CIP has been previously identified. However, the computational complexity for 3-DE image registration1, 2 is high, and it is troublesome to register 3-DE images of different subjects. In order to automatically recognize the 4C image, Matthew used peak features,3 which is useful in the case of the ideal condition when the whole heart is visible and located in the middle of the image. Another group presented a method based on template matching by elastic registration,4 which can still work very well when only part of the heart is visible and the location of the heart is not in the middle. However, as a 3-D data set may contain hundreds of 2-D images, it is time-consuming to match the four-chamber (4C) image in a 3-D volume by elastic registration. In our research, we developed a fast automatic method to find the 4CIP in the 3-DE images, suitable for the real-time applications, where first, a typical end-diastolic 4C image is chosen as a template. Second, in order to find the 4CIP in a 3-D data set, an image database is built by extracting cross sections from the end-diastolic volume of the data set. Then by a coarse-to-fine search, the most similar image of the template is retrieved from the stack of images as the 4CIP of the data set.

2.

Methods

2.1.

Template Selection

As illustrated in Fig. 1 , an end-diastolic 4C image of a normal child is selected and a rectangular region located at the center of the image is chosen as a template. The distribution of the septum and chambers in the rectangular region of the end-diastolic 4C image is considerably different from that of the other image planes and is weakly affected by the variation of the heart size, shape, and the image intensities. Therefore, it can easily detect the most similar images without requiring a huge template library.

Fig. 1

Rectangular region defined in the apical 4C image.

030502_1_019803jei1.jpg

2.2.

Image Database Construction

To detect the 4CIP in a 3-DE data set, an image database including cross sections extracted from the end-diastolic volume of the data set is built. Here, the echocardiographic volume is like a truncated pyramid. As shown in Fig. 2 , we assume that the cardiac apex is the vertex of the pyramid, which is chosen as the origin O, and that the long axis of the heart passing through the apex is the vertical axis OZ. The 4CIP is recognized among the cross sections sharing a common symmetric axis OZ. The projection of each cross section in the XOY plane is a radial line like AB. A point P is located on the cross section if its coordinates satisfy the following:

Eq. 1

{x=x1+lcosθy=y1+lsinθ},(0θ<180deg),
where θ is the angle between line AB and the positive axis OX as shown in Fig. 2, ranging from 0to180deg , and l is the Euclidean distance from the projective point of P in the XOY plane to point A, ranging from 1 to L , which is the length of each cross section, defined as follows:

Eq. 2

L=AB¯=(x2x1)2+(y2y1)2.
Each cross section’s size is L×n pixels, where n is the volume’s size in the OZ direction. The units of the sizes in this paper are pixels.

Fig. 2

Coordinate system of the apical volumetric data set: (a) 3-D distribution of the cross sections and (b) Projection of the cross sections in the XOY plane.

030502_1_019803jei2.jpg

2.3.

Four-Chamber Image Retrieval

To improve the speed and accuracy of the 4C image retrieval, a coarse-to-fine strategy is utilized. First, the coarse retrieval is performed by comparing the cumulative histograms5 of the two images. Because of transducer movement artifacts and the respiration of the patient, the centered cross-shaped septum may shift away from the image center by 1020pixels . Because the image histogram is rather invariant to an affine transformation, it is quite robust for the generally occurring misalignments. The cumulative histogram is implemented in the rectangular region shown in Fig. 1, whose geometric center is the same as that of each cross section. By the coarse retrieval, the first 60 most similar images are selected from the original 180 images for each data set.

Next, to further cope with the misalignment error, a rigid registration approach is adopted to find the best match of the rectangular region in each image of the reduced image set, resulting from the coarse retrieval based on similarity in the cumulative histograms. For the rigid registration, we selected the cross-correlation as the similarity measure and the simplex optimization method to find the optimized scale, translation, and rotation parameters. The images selected by the coarse retrieval procedure are then each aligned to the template image according to their optimal transformation parameters. In this way, geometrical transformation influences on the wavelet features computed in the fine retrieval procedure will be strongly reduced.

Finally, because the rectangular region in the middle of a 4C image contains distinct edges, we selected the high-frequency details of the image as the feature for the fine retrieval. The wavelet domain yields a multiresolution decomposition so that high-frequency information can be extracted from the high-frequency subbands. The original image constrained to the rectangular region is decomposed into four subbands, LL1, HL1, HV1, and HD1, by means of the db2 wavelet. The mean E and the variance V of the wavelet coefficients of the three high-frequency subbands, HL1, HV1, and HD1, are selected as the features. E and V are defined by

Eq. 3

E=1MNm=1Mn=1Nx(m,n)

Eq. 4

andV=1MNm=1Mn=1Nx(m,n)2E2,
where M and N are the dimensions of the high-frequency subband S ; x(m,n) are its corresponding wavelet coefficients; and S{HL1,HV1,HD1} . The Euclidean distance of the feature vectors, (EHL1,VHL1,EHV1,VHV1,EHD1, VHD1) , of two images is employed to measure the image dissimilarity. In the end, the cross-section image with minimum dissimilarity is retrieved as the 4C image from the images left after the coarse selection.

3.

Experimental Results

The data used in this study were full-volume data acquired with Philips Sonos7500 US equipment and comprised 28 data sets of 16 normal subjects aged from 1monthto12years and 22 data sets of 14 patients with common atrioventricular canal (CAVC), aged from 3monthsto13years . The total calculation time is <20s for each data set on a PC with a 2.4GHz Pentium 4 processor. Figure 3 shows the 4C images detected in the datasets of six subjects by our method. The medical data of these subjects are listed in Table 1 .

Fig. 3

4C images automatically detected by our method in six data sets of three normal children and three children suffering from CAVC.

030502_1_019803jei3.jpg

Table 1

Medical data of the subjects for whom the 4C images are shown in Fig. 3 (LVDD: left ventricular end diastolic dimension; LVEF: left ventricular ejection fraction).

Figure No.Study SubjectsGenderAgeLVDD(cm)LVEF(%)
3normalmale 1month 2.7466
3normalmale 5yr 3.5073
3normalfemale 12yr 4.3064
3CAVCmale 3months 2.1874
3CAVCfemale 5yr 2.9571
3CAVCmale 13yr 3.7757

To evaluate our method quantitatively, we use θ , as shown in Fig. 2, to denote the angle of direction of the 4CIP. The image plane showing four chambers (i.e., the left and right atria and ventricles, two large atrioventricular valves, the interventricular septum, and interatrial septum) is an acceptable 4CIP, while an image plane containing the aortic valve is not considered to be a 4CIP. Three experienced sonographers were asked to manually search the 4CIP for each data set. However, because the shape of the heart changes continuously, it is impossible for the medical doctors to define a unique 4CIP in the data set, but rather a range of angles has to be considered as valid 4C image planes. The plane in the center of this range is then accepted as the reference 4CIP. In order to determine a reasonable range for the acceptable 4CIP, a 4CIP lib, which includes cross sections from all data sets with e , the absolute deviation angle from the reference 4CIP, ranging from 0to20deg , was tested by the echocardiographers. Finally, e10deg is selected as the reliable range of the acceptable 4CIP because the doctors accepted the 4CIP in this range with more than 99% confidence. We computed the cumulative frequency table (see Table 2 ) in terms of the absolute deviation angle e , calculated for each of the 4C images found automatically via our coarse-to-fine retrieval method. Considering e10deg as the range of acceptance, the error rates of our method are 7% for the 28 studies of the normal children and 9% for 22 studies of the children suffering from CAVC, respectively. When realizing tests with other templates, we observed that the template with high echo quality, in particular, with highly visible ventricular walls, performed best because less noise could affect the result.

Table 2

List of the error rates with different e .

e Error Rates ofNormal Data Sets(%)Error Rates ofAbnormal Data Sets(%)
0–33236
3–62518
6–8714
8–1079
>10 49

4.

Conclusions

With low computational complexity and a simple implementation, our method can automatically find the 4CIP in the apical data sets of different subjects by using only one 4C template image of a normal subject. With the detected 4CIP, it is easier to find the short-axis and long-axis image planes in the data sets. At this moment, we only tried the 4CIP detection in apical data sets of children, but because the variability of the heart is smaller among adults than among children, we do not expect too many problems when applying the autodetection scheme on cardiac images of adults. Furthermore, it remains worthwhile to detect clinically relevant image planes in parasternal and subcostal data sets, but for these data sets the current approach may need to be adapted.

references

1. 

R. Shekhar and V. Zagrodsky, “Mutual information-based rigid and non-rigid registration of ultrasound volumes,” IEEE Trans. Med. Imaging, 21 (1), 9 –22 (2002). https://doi.org/10.1109/42.981230 Google Scholar

2. 

R. Shekhar, V. Zagrodsky, M. J. Garcia, and J. D. Thomas, “Registration of real-time 3-D ultrasound images of the heart for novel 3-D stress echocardiography,” IEEE Trans. Med. Imaging, 23 (9), 1141 –1149 (2004). Google Scholar

3. 

E. O. Matthew, B. Jinbo, K. Sriram, R. Bharat, S. Jonathan, K. Alan, H. Jing, and P. Srinivasan, “Automatic view recognition for cardiac ultrasound images,” 187 –194 (2006). Google Scholar

4. 

S. V. Aschkenasy, C. Jansen, R. Osterwalder, A. Linka, M. Unser, S. Marsch, and P. Hunziker, “Unsupervised image classification of medical ultrasound data by multiresolution elastic registration,” Ultrasound Med. Biol., 32 (7), 1047 –1054 (2006). Google Scholar

5. 

M. Stricker and M. Orengo, “Similarity of Color Images,” Proc. SPIE, 2420 381 –392 (1995). https://doi.org/10.1117/12.205308 Google Scholar
©(2008) Society of Photo-Optical Instrumentation Engineers (SPIE)
Xiaoping Liu, Xin Yang, Lanping Wu, Kun Sun, Yanfen Shang, and Rudi Deklerck "Computer-aided recognition of a four-chamber image plane in three-dimensional echocardiographic images of children," Journal of Electronic Imaging 17(3), 030502 (1 July 2008). https://doi.org/10.1117/1.2956009
Published: 1 July 2008
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Image retrieval

3D image processing

Heart

Medical imaging

Data acquisition

Wavelets

Image registration

Back to Top