JEI Letters

Computer-aided recognition of a four-chamber image plane in three-dimensional echocardiographic images of children

[+] Author Affiliations
Xiaoping Liu, Xin Yang

Shanghai Jiaotong University, Institute of Image Processing and Pattern Recognition, Shanghai, China

Lanping Wu, Kun Sun

Shanghai Jiaotong University, Shanghai Children’s Medical Center, Shanghai, China

Yanfeng Shang

Shanghai Jiaotong University, Institute of Image Processing and Pattern Recognition, Shanghai, China

Vrije Universiteit Brussel, Department of Electronics and Informatics, Interdisciplinair Instituut voor BreedBand Technologie, 1050 Brussel, Belgium

Rudi Deklerck

Vrije Universiteit Brussel, Department of Electronics and Informatics, Interdisciplinair Instituut voor BreedBand Technologie, 1050 Brussel, Belgium

J. Electron. Imaging. 17(3), 030502 (July 15, 2008). doi:10.1117/1.2956009
History: Received February 09, 2008; Revised April 18, 2008; Accepted May 02, 2008; Published July 15, 2008
Text Size: A A A

Open Access Open Access

Automated detection of the clinically relevant image planes in a three-dimensional echocardiographic (3-DE) data set has potential applications for diagnosis of pediatric congenital heart disease. We propose a method based on template matching to automatically detect the four-chamber image plane (4CIP) in a 3-DE data set. First, a normal four-chamber image is chosen as the template. Second, to find the 4CIP in a 3-D volume, a series of cross sections are extracted from this volume. Then, a coarse-to-fine retrieval is applied to the stack of slices and the image most similar to the template is proposed as the 4CIP of this volume. We tested the method on 28 data sets of normal children and 22 data sets of children suffering from congenital heart disease, and the error rates are 7 and 9%, respectively. As will be shown, the autodetection algorithm can be straightforwardly implemented, has low computational complexity, and is robust to noise.

Figures in this Article

During the retrospective review of three-dimensional echocardiographic (3-DE) data sets for diagnosis and analysis of pediatric congenital heart disease (CHD), it takes time for the medical doctor to find the clinically relevant image planes. 3-DE images are usually acquired from the parasternal, subcostal, and apical windows, but for assessment of atrioventricular septal defects, heart valve diseases, etc., the apical data sets are, in general, preferred for making the diagnosis. Among several clinically relevant image planes, the four-chamber image plane (4CIP) is the most important one. Consequently, as a preliminary study, this paper focuses on the automated detection of the 4CIP in apical data sets. This autodetection will be a useful tool for the medical doctors during retrospective review. Furthermore, it can be a prior procedure for image registration, i.e., for merging 3-DE images with images of different modalities.

The 4CIP in a 3-DE data set can be detected by aligning the volumetric data with a 3-D template image in which the 4CIP has been previously identified. However, the computational complexity for 3-DE image registration12 is high, and it is troublesome to register 3-DE images of different subjects. In order to automatically recognize the 4C image, Matthew et al. used peak features,3 which is useful in the case of the ideal condition when the whole heart is visible and located in the middle of the image. Another group presented a method based on template matching by elastic registration,4 which can still work very well when only part of the heart is visible and the location of the heart is not in the middle. However, as a 3-D data set may contain hundreds of 2-D images, it is time-consuming to match the four-chamber (4C) image in a 3-D volume by elastic registration. In our research, we developed a fast automatic method to find the 4CIP in the 3-DE images, suitable for the real-time applications, where first, a typical end-diastolic 4C image is chosen as a template. Second, in order to find the 4CIP in a 3-D data set, an image database is built by extracting cross sections from the end-diastolic volume of the data set. Then by a coarse-to-fine search, the most similar image of the template is retrieved from the stack of images as the 4CIP of the data set.

Template Selection

As illustrated in Fig. 1, an end-diastolic 4C image of a normal child is selected and a rectangular region located at the center of the image is chosen as a template. The distribution of the septum and chambers in the rectangular region of the end-diastolic 4C image is considerably different from that of the other image planes and is weakly affected by the variation of the heart size, shape, and the image intensities. Therefore, it can easily detect the most similar images without requiring a huge template library.

Graphic Jump LocationF1 :

Rectangular region defined in the apical 4C image.

Image Database Construction

To detect the 4CIP in a 3-DE data set, an image database including cross sections extracted from the end-diastolic volume of the data set is built. Here, the echocardiographic volume is like a truncated pyramid. As shown in Fig. 2, we assume that the cardiac apex is the vertex of the pyramid, which is chosen as the origin O, and that the long axis of the heart passing through the apex is the vertical axis OZ. The 4CIP is recognized among the cross sections sharing a common symmetric axis OZ. The projection of each cross section in the XOY plane is a radial line like AB. A point P is located on the cross section if its coordinates satisfy the following:Display Formula

1{x=x1+lcosθy=y1+lsinθ},(0θ<180deg),
where θ is the angle between line AB and the positive axis OX as shown in Fig. 2, ranging from 0to180deg, and l is the Euclidean distance from the projective point of P in the XOY plane to point A, ranging from 1 to L, which is the length of each cross section, defined as follows:Display Formula
2L=AB¯=(x2x1)2+(y2y1)2.
Each cross section’s size is L×n pixels, where n is the volume’s size in the OZ direction. The units of the sizes in this paper are pixels.

Graphic Jump LocationF2 :

Coordinate system of the apical volumetric data set: (a) 3-D distribution of the cross sections and (b) Projection of the cross sections in the XOY plane.

Four-Chamber Image Retrieval

To improve the speed and accuracy of the 4C image retrieval, a coarse-to-fine strategy is utilized. First, the coarse retrieval is performed by comparing the cumulative histograms5 of the two images. Because of transducer movement artifacts and the respiration of the patient, the centered cross-shaped septum may shift away from the image center by 1020pixels. Because the image histogram is rather invariant to an affine transformation, it is quite robust for the generally occurring misalignments. The cumulative histogram is implemented in the rectangular region shown in Fig. 1, whose geometric center is the same as that of each cross section. By the coarse retrieval, the first 60 most similar images are selected from the original 180 images for each data set.

Next, to further cope with the misalignment error, a rigid registration approach is adopted to find the best match of the rectangular region in each image of the reduced image set, resulting from the coarse retrieval based on similarity in the cumulative histograms. For the rigid registration, we selected the cross-correlation as the similarity measure and the simplex optimization method to find the optimized scale, translation, and rotation parameters. The images selected by the coarse retrieval procedure are then each aligned to the template image according to their optimal transformation parameters. In this way, geometrical transformation influences on the wavelet features computed in the fine retrieval procedure will be strongly reduced.

Finally, because the rectangular region in the middle of a 4C image contains distinct edges, we selected the high-frequency details of the image as the feature for the fine retrieval. The wavelet domain yields a multiresolution decomposition so that high-frequency information can be extracted from the high-frequency subbands. The original image constrained to the rectangular region is decomposed into four subbands, LL1, HL1, HV1, and HD1, by means of the db2 wavelet. The mean E and the variance V of the wavelet coefficients of the three high-frequency subbands, HL1, HV1, and HD1, are selected as the features. E and V are defined byDisplay Formula

3E=1MNm=1Mn=1Nx(m,n)
Display Formula
4andV=1MNm=1Mn=1Nx(m,n)2E2,
where M and N are the dimensions of the high-frequency subband S; x(m,n) are its corresponding wavelet coefficients; and S{HL1,HV1,HD1}. The Euclidean distance of the feature vectors, (EHL1,VHL1,EHV1,VHV1,EHD1,VHD1), of two images is employed to measure the image dissimilarity. In the end, the cross-section image with minimum dissimilarity is retrieved as the 4C image from the images left after the coarse selection.

The data used in this study were full-volume data acquired with Philips Sonos7500 US equipment and comprised 28 data sets of 16 normal subjects aged from 1monthto12years and 22 data sets of 14 patients with common atrioventricular canal (CAVC), aged from 3monthsto13years. The total calculation time is <20s for each data set on a PC with a 2.4GHz Pentium 4 processor. Figure 3 shows the 4C images detected in the datasets of six subjects by our method. The medical data of these subjects are listed in Table 1.

Table Grahic Jump Location
Medical data of the subjects for whom the 4C images are shown in Fig. 3 (LVDD: left ventricular end diastolic dimension; LVEF: left ventricular ejection fraction).
Graphic Jump LocationF3 :

4C images automatically detected by our method in six data sets of three normal children and three children suffering from CAVC.

To evaluate our method quantitatively, we use θ, as shown in Fig. 2, to denote the angle of direction of the 4CIP. The image plane showing four chambers (i.e., the left and right atria and ventricles, two large atrioventricular valves, the interventricular septum, and interatrial septum) is an acceptable 4CIP, while an image plane containing the aortic valve is not considered to be a 4CIP. Three experienced sonographers were asked to manually search the 4CIP for each data set. However, because the shape of the heart changes continuously, it is impossible for the medical doctors to define a unique 4CIP in the data set, but rather a range of angles has to be considered as valid 4C image planes. The plane in the center of this range is then accepted as the reference 4CIP. In order to determine a reasonable range for the acceptable 4CIP, a 4CIP lib, which includes cross sections from all data sets with e, the absolute deviation angle from the reference 4CIP, ranging from 0to20deg, was tested by the echocardiographers. Finally, e10deg is selected as the reliable range of the acceptable 4CIP because the doctors accepted the 4CIP in this range with more than 99% confidence. We computed the cumulative frequency table (see Table 2) in terms of the absolute deviation angle e, calculated for each of the 4C images found automatically via our coarse-to-fine retrieval method. Considering e10deg as the range of acceptance, the error rates of our method are 7% for the 28 studies of the normal children and 9% for 22 studies of the children suffering from CAVC, respectively. When realizing tests with other templates, we observed that the template with high echo quality, in particular, with highly visible ventricular walls, performed best because less noise could affect the result.

Table Grahic Jump Location
List of the error rates with different e.

With low computational complexity and a simple implementation, our method can automatically find the 4CIP in the apical data sets of different subjects by using only one 4C template image of a normal subject. With the detected 4CIP, it is easier to find the short-axis and long-axis image planes in the data sets. At this moment, we only tried the 4CIP detection in apical data sets of children, but because the variability of the heart is smaller among adults than among children, we do not expect too many problems when applying the autodetection scheme on cardiac images of adults. Furthermore, it remains worthwhile to detect clinically relevant image planes in parasternal and subcostal data sets, but for these data sets the current approach may need to be adapted.

Shekhar  R., and Zagrodsky  V., “ Mutual information-based rigid and non-rigid registration of ultrasound volumes. ,” IEEE Trans. Med. Imaging.  0278-0062 21, (1 ), 9–22  ((2002)).
Shekhar  R., , Zagrodsky  V., , Garcia  M. J., , and Thomas  J. D., “ Registration of real-time 3-D ultrasound images of the heart for novel 3-D stress echocardiography. ,” IEEE Trans. Med. Imaging.  0278-0062 23, (9 ), 1141–1149  ((2004)).
Matthew  E. O., , Jinbo  B., , Sriram  K., , Bharat  R., , Jonathan  S., , Alan  K., , Jing  H., , and Srinivasan  P., “ Automatic view recognition for cardiac ultrasound images. ,” in  Proc. 1st MICCAI’06-CVII. , pp. 187–194  ((2006)).
Aschkenasy  S. V., , Jansen  C., , Osterwalder  R., , Linka  A., , Unser  M., , Marsch  S., , and Hunziker  P., “ Unsupervised image classification of medical ultrasound data by multiresolution elastic registration. ,” Ultrasound Med. Biol..  0301-5629 32, (7 ), 1047–1054  ((2006)).
Stricker  M., and Orengo  M., “ Similarity of Color Images. ,” Proc. SPIE.  0277-786X 2420, , 381–392  ((1995)).
© 2008 SPIE and IS&T

Citation

Xiaoping Liu ; Xin Yang ; Lanping Wu ; Kun Sun ; Yanfeng Shang, et al.
"Computer-aided recognition of a four-chamber image plane in three-dimensional echocardiographic images of children", J. Electron. Imaging. 17(3), 030502 (July 15, 2008). ; http://dx.doi.org/10.1117/1.2956009


Figures

Graphic Jump LocationF1 :

Rectangular region defined in the apical 4C image.

Graphic Jump LocationF2 :

Coordinate system of the apical volumetric data set: (a) 3-D distribution of the cross sections and (b) Projection of the cross sections in the XOY plane.

Graphic Jump LocationF3 :

4C images automatically detected by our method in six data sets of three normal children and three children suffering from CAVC.

Tables

Table Grahic Jump Location
Medical data of the subjects for whom the 4C images are shown in Fig. 3 (LVDD: left ventricular end diastolic dimension; LVEF: left ventricular ejection fraction).
Table Grahic Jump Location
List of the error rates with different e.

References

Shekhar  R., and Zagrodsky  V., “ Mutual information-based rigid and non-rigid registration of ultrasound volumes. ,” IEEE Trans. Med. Imaging.  0278-0062 21, (1 ), 9–22  ((2002)).
Shekhar  R., , Zagrodsky  V., , Garcia  M. J., , and Thomas  J. D., “ Registration of real-time 3-D ultrasound images of the heart for novel 3-D stress echocardiography. ,” IEEE Trans. Med. Imaging.  0278-0062 23, (9 ), 1141–1149  ((2004)).
Matthew  E. O., , Jinbo  B., , Sriram  K., , Bharat  R., , Jonathan  S., , Alan  K., , Jing  H., , and Srinivasan  P., “ Automatic view recognition for cardiac ultrasound images. ,” in  Proc. 1st MICCAI’06-CVII. , pp. 187–194  ((2006)).
Aschkenasy  S. V., , Jansen  C., , Osterwalder  R., , Linka  A., , Unser  M., , Marsch  S., , and Hunziker  P., “ Unsupervised image classification of medical ultrasound data by multiresolution elastic registration. ,” Ultrasound Med. Biol..  0301-5629 32, (7 ), 1047–1054  ((2006)).
Stricker  M., and Orengo  M., “ Similarity of Color Images. ,” Proc. SPIE.  0277-786X 2420, , 381–392  ((1995)).

Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging & repositioning the boxes below.

Related Book Chapters

Topic Collections

Advertisement
  • Don't have an account?
  • Subscribe to the SPIE Digital Library
  • Create a FREE account to sign up for Digital Library content alerts and gain access to institutional subscriptions remotely.
Access This Article
Sign in or Create a personal account to Buy this article ($20 for members, $25 for non-members).
Access This Proceeding
Sign in or Create a personal account to Buy this article ($15 for members, $18 for non-members).
Access This Chapter

Access to SPIE eBooks is limited to subscribing institutions and is not available as part of a personal subscription. Print or electronic versions of individual SPIE books may be purchased via SPIE.org.