Statistical Characterisation of Speckle in Clinical Echocardiographic Images with Pearson Family of Distributions

The statistical characterisation of gray level distribution of echocardiographic images is commonly done in terms of unimodal probability densities such as Rayleigh, Gamma, Weibull, Nakagami, and Lognormal. Amongst these distributions, the Gamma density is found to provide better empirical model that fits to real data sets. We propose to extend the class of probability distributions by exploring Pearson family to characterise blood and tissue in echocardiographic images. It is found that Pearson Type I characterises the tissue regions whereas Type I, Type IV and Type VI classify blood regions. The statistical measures viz. Jensen-Shannon (JS) divergence and Kolmogorov-Smirnov (KS) statistics reveal that Pearson family of curves outperforms the Gamma distribution.

Keywords:    Speckle,   echocardiography,   Pearson distributions,   tissue Characterisation

A major challenge in B-mode ultrasound(US) imaging is statistical characterisation of speckle1-4 which is often regarded as containing information about the underlying tissue structure. The high order statistical measures provide information about texture of the speckle pattern, which depends on spatial distribution2 of random scatterers. The speckle probability density at the transducer is transformed into speckle densities in the image through a chain of complex image processing steps, which are difficult to model mathematically3. In absence of the theoretical description of the image formation process, the best one can do is to use probability density function characterizing empirical data. The commonly used probability density functions (pdfs) for this are Rayleigh1,6, Gamma2,3,6, Weibull3,6, K6-8, Nakagami5,6, and lognormal3. Tao3, et al. experimentally evaluated four empirical probability distribution models (Gamma, Weibull, Normal and lognormal) for speckle in clinical cardiac US images and found that the experimental data support a unimodal distribution. They found that Gamma and Weibull distributions are appropriate for characterising blood and tissue. Further the Gamma distribution provides a better overall fit. There authors argue that the empirical distributions considered by them, have the ability to fit gray level densities in blood and tissue regions. However, Tao3, et al. pointed out that the significance values for the goodness of fit are not high enough to support the null hypothesis. This motivates us to look for other family of distributions which can model the data better. We explore the Pearson family of distributions9-12 to model the gray level distribution for tissue and blood regions. Author has proposed the Pearson family of distribution for classification of US B-mode kidney images and demonstrated the efficacy of the family over other commonly used distributions. The purpose of this paper is to investigate the applicability of Pearson family to echocardiographic images.

The richness of Pearson family of distributions is due to the fact that several known distributions viz. Gaussian, beta, Student’s t-distributions are contained in the famiy11. Renzo11, et al. noted that the four-parameter Pearson family makes explicit correspondence with the first four moments of the distribution. Pearson9 proposed a class of probability density functions (pdfs) which can be generated from the solution of the differential Eqn (1):


df(x) dx ={ b+x a 0 + a 1 x+ a 2 x 2 }f(x) (1)


The random variable X denotes the gray level intensity of the echocardiographic speckle and f(x) represents the probability density function (pdf). The b, a0, a1, and a2 are parameters of the distribution. These parameters are determined in terms of the first four central moments i for i =1,..., 4) of the underlying empirical distribution. By using method of moments, we have


{ b= a 1 = 0.5 μ 3 (3 μ 2 2 + μ 4 ) 9 μ 2 3 5 μ 2 μ 4 +6 μ 3 2 a 0 = 0.5 μ 2 (4 μ 2 μ 4 3 μ 3 2 ) 9 μ 2 3 5 μ 2 μ 4 +6 μ 3 2 a 2 = 0.5(6 μ 2 3 2 μ 2 μ 4 +3 μ 3 2 ) 9 μ 2 3 5 μ 2 μ 4 +6 μ 3 2 } (2)


Pearson9 identified a selection parameter κ which is expressible in terms of the first four moments. Defining Skewness ( S k = μ 3 / μ 2 3 2 ) and Kurtosis ( K u = μ 4 / μ 2 2 ) , we find


κ= S k 2 ( K u +3) 2 4(4 K u 3 S k 2 )(2 K u 3 S k 2 6) (3)


The three major types of Pearson densities, i.e. Type I, Type IV and Type VI are defined for κ<0, 0<κ <1 and κ>1, respectively. For the sake of completeness we give the expression of pdfs for three major types.

2.1. Pearson Type I Distribution (κ<0

The pdf of type I distribution is given by


f I (x)= A 0 (1+ x m 0 c 1 ) g 1 (1 x m 0 c 2 ) g 2 , c 1 + m o <x< c 2 + m o (4)


where


{ A 0 = g 1 g 1 g 2 g 2 Γ( g 1 + g 2 +2) ( c 1 + c 2 ) ( g 1 + g 2 ) g 1 + g 2 Γ( g 1 +1)Γ( g 2 +1) g 2,1 =0.5h1±sign( μ 3 )(0.5h(h+2)) S k S k 2 (h+2) 2 +16h+16 c 1 =( g 1 g 2 ) 0.5 μ 2 { S k 2 (h+2) 2 +16h+16} 1+ g 1 g 2 c 2 =0.5 μ 2 { S k 2 (h+2) 2 +16h+16} c 1 h= 6 K u 6 S k 2 6 6+3 S k 2 2 K u m o = μ 1 0.5 μ 3 (h+2) μ 2 (h2) } (5)

2.1. Pearson Type IV Distribution (0<κ<1)

The pdf of type IV distribution is given by


f IV (x)= A 0 { 1+ ( x m 0 c 1 ) 2 } g 1 e αarctan( x m 0 c ) ,<x< (6)


where


{ A 0 =0.5 2 h e (cosθ)2 3h 1 12h θα (cosθ) h1 h= 6 K u 6 S k 2 6 6+3 S k 2 2 K u θ=arctan α h g 1 =0.5h+1 α= S k ( h 2 +2h) (16h16) S k 2 (h2) 2 c=0.25 μ 2 (16h16) S k 2 (h2) 2 m 0 = μ 1 + αc h } (7)

2.1. Pearson Type VI Distribution (κ>1)

The pdf of type IV distribution is defined by


f IV (x)= A 0 (x m o c) g 2 (x m o ) g 1 ,c+ m o <x< (8)


where


( A 0 = c ( g 1 g 2 1) Γ( g 1 ) Γ( g 1 g 2 1)Γ( g 2 +1) g 1 =0.5h+1+0.5h(h+2) S k S k 2 (h+2) 2 +16h+16 g 2 =0.5h1+0.5h(h+2) S k S k 2 (h+2) 2 +16h+16 c=0.5 μ 2 { S k 2 (h+2) 2 +16h+16} h= 6 K u 6 S k 2 6 6+3 S k 2 2 K u m 0 = μ 1 c( g 1 1) g 1 g 2 2 ) (9)

The images as obtained from GE Voluson 730-Pro ultrasound machine (GE health care systems, New Delhi, India) with frequency range of 3.5 to 5 MHz in respect of 10 clinical echocardiographic B-mode human images with normal status are analyzed. The images are in 8 bit format with 256 gray levels ranging from 0 to 255. For the purpose of illustration we show in Figure 1 the echocardiographic image of subject 1. The dark regions in the image correspond to blood pool whereas the bright portions correspond to tissue. The statistical details of tissue and blood regions are collected by four rectangular windows of M  N pixels. These windows are randomly chosen over the tissue and blood regions in each of 10 B-mode echocardiographic images. The selected tissue regions are shown with blue rectangles (Fig. 1(a)) whereas blood regions with red rectangles (Fig. 1(b)). These regions are marked with 1–4 and referred to as T1-T4 (for tissue) and B1-B4 (for blood). The collected data from Figs. 1(a)-(b) are represented as histograms (Figs. 2-3).



3.1 Fitting of Pearson Distributions

The aim of our investigation is to identify plausible Pearson type for gray level distributions of tissue and blood. With advice from expert radiologist, we have manually identified four rectangular regions corresponding to tissue and four rectangular regions corresponding to blood. Thus from 10 images we have data for 40 regions for each of tissue and blood. In tissue regions the number of pixels under rectangular window varies from 952 to 2575 whereas in blood regions it varies from 860 to 2744. The data (gray values) collected from each region are divided into a set of 10 bins. The selection parameter κ is computed for each image form first four moments as given in Eqn. 3. MATLAB (Mathworks) 7.5.0.342 (R2007b) software is used for estimation of parameters. The computed κ values for T1-T3, B2 and B4 regions turn out to be negative, the selected Pearson distributions would thus correspond to Type I distribution. Using Eqn.5 parameters for this pdf are obtained and are given in Table 1. For regions T4, B1 and B3, computed κ values are positive and less than unity which corresponds to Type IV Pearson distribution. Parameters for this pdf as obtained by using set of Eqns. 8 are given in Table 2. By employing Eqns. (4) and (6), the pdfs for these regions are obtained and are plotted in Figs. 2-3 against their respective histograms. These pdfs are found to be in excellent agreement with the empirical data.



The κ based Characterization and resulting Pearson type for 40 tissue and blood regions in 10 echocardiographic images is summarized in Table 3. It can be seen from Table 3 that in most cases the Pearson type I distribution characterises tissue and blood. To test the efficacy of Pearson9 over Gamma3 distribution, we are required to fit Gamma distribution to the data sets generated from the echocardiographic images. The parameters of Gamma3 distribution are obtained by employing the maximum likelihood estimation approach and these are given in Table 4. The pdfs of Gamma3 distribution for these parameters are plotted in Figs. 2-3 and the fit of Gamma distribution to the real data set is fairly good. It is interesting to note that the results based on Gamma distribution in Table 4 indicates lower β corresponds to blood whereas higher β captures the characteristics of tissues. To compare the effectiveness of Pearson9 versus Gamma3, we calculate statistical measures viz. JS14 divergence and KS2 test which are discussed in subsequent section.

To facilitate the comparison of Pearson versus Gamma with respect to empirical data, we need a measure of distance between probability distributions. Here we consider two such measures.

4.1 Jensen-Shannon Divergence

To this end one of the widely used measures is based on Kullback- Leibler13(KL) divergence. The KL13 measure defines distance of probability distribution P = {p1, p2, …,pn} from a reference distribution Q = {q1, q2, …,qn} as


D(P||Q)= i=1 n p i log p i q i (10)


Since D(P ||Q) D(Q || P) , reflecting the asymmetric nature of KL14 measure, one can obtain a symmetric measure known as JS divergence14. We have


JS(P,Q)= D(P|| (P+Q) 2 )+D(Q|| (P+Q) 2 ) 2 (11)


JS divergence14 is based on information theory. Another well known distance measure commonly adopted for study of goodness of fit is based on Kolmogorov-Smirnov2,6 (KS) test.

4.2 Kolmogorov-Smirnov Test

The distance between the cumulative distribution function (cdf) of random variable X with empirical data can be defined as


D=max| P empirical (Xx)- P refernce (Xx) | (12)


The goodness of fit requires comparison of D to a critical level D max (for details see Raju6, et al.). A smaller value of the KS2, 6 statistics indicates a better fit of the empirical distribution to that of reference distribution.


We describe the results of statistical measures for testing goodness of fit in respect of Pearson and Gamma distributions with empirical distribution. To this end we consider the image of subject 1 with four tissue and four blood regions. We give in Table 5, the results of JS14 (Eqn. 11) and KS2,6 (Eqn. 12) statistics for tissue (T1-4) and blood (B1-4) regions with regard to Pearson and Gamma distribution. The bold numerical values in Table 5 show the efficacy of corresponding distribution. It can be easily seen that Pearson family outperforms over Gamma distribution.



The results of all images (40 blood regions and 40 tissue regions) taken together, are summarized in Table 6. From this table it is noted that the success counts in respect of Pearson distributions is far more than that of Gamma distribution.

The Characterisation of blood and tissue in echocardiographic images is very important in medical applications. The problem of Characterisation from first principles is fairly complicated. Consequently, the research investigations adopt statistical framework for modeling the distributions of gray level densities in tissue and blood. Typically unimodal distributions such as Rayleigh, Gamma, Weibull, K, Nakagami, and Lognormal have been used for this. Tao3, et al. in a recent paper pointed out that the choice of these distributions does not lead to the desired significance level to support the null hypothesis. This demand for the investigation to identify some appropriate probability distributions. Motivated by the success of Pearson family in wireless communication10-12, we have investigated its applicability in medical imaging. We have demonstrated the efficacy of Pearson family of distributions over Gamma distribution in echocardiography. A useful area of future enquiry would be to investigate in future the utility of model parameters as well the first four moments for characterisation of medical images.

The authors are grateful to Professor N. R. Pal (Indian Statistical Institute, Kolkata) whose valuable suggestions have improved the contents and quality of the paper. Author would like to thank Dr Yogesh Sharma, Radiologist, Noida Diagnostic Center for getting the approval of the ethics committee of the hospital for use of medical images in the research.


1. Wagner, R.F.; Smith, S.W.; Sandrik J.M. & Lopez, H. Statistics of speckle in ultrasound B-scans. IEEE Trans. Ultra. Ferro. Freq. Control, 1983, 30(3), 156-63.

2. Nillesen, M.N.; Lopata, R.G.P.; Gerrits, I.H.; Kapusta. L.; Thijssen, J.M. & Korte, C.L.D. Modeling envelope statistics of blood and myocardium for segmentation of echocardiographic images. Ultrasound Med. Biol., 2008, 34(4),674-80.

3. Tao, Z.; Tagare, H.D. & Beaty, J. D. Evaluation of four probability distribution models for speckle in clinical cardiac ultrasound images. IEEE Trans Med. Imag., 2006, 25(11), 1483-1491.

4. Mittal, D.; Kumar, V.; Saxena, S.C.; Khandelwal, N. & Kalra, N. Enhancement of the ultrasound images by modified anisotropic diffusion method. Med. Biol. Eng. Comput., 2010, 48, 1281-291.

5. Shankar, P.M.; Dumane, V.A.; Reid, J.M.; Genis, V.; Forsberg, F.; Piccoli, C.W. & Golddberg, B.B. Classification of ultrasonic B-mode images of breast masses using Nakagami distribution. IEEE Trans. Ultra. Ferro. Freq. Control, 2001, 48(9), 569-80.

6. Raju, B.I. & Srinivasan M.A. Statistics of envelope of high frequency ultrasonic backscatter from human skin in vivo. IEEE Trans. Ultra. Ferro. Freq. Control, 2002, 49(7), 871-82.

7. Bernard, O.; D’hooge, J. & Friboulet, D. Statistics of the radio frequency signal based on K distribution with application to echocardiography. IEEE Trans. Ultra. Ferro. Freq. Control, 2006, 53(9), 1689-694.

8. Bernard, O.; Touil, B.; D’hooge, J. & Friboulet, D. Statistical modeling of the radio-frequency signal for partially- and fully-developed speckle based on a generalized Gaussian model with application to echocardiography. IEEE Trans. Ultra. Ferro. Freq. Control., 2007, 54(10),2189-194.

9. Elderton, W.P. & Johnson, N.L. System of frequency curves. London, Cambridge University Press, 1969.

10. Kwan, R. & Leung, C. On the applicability of the pearson method for approximating distributions in wireless communications. IEEE Trans. Comm., 2007, 55(11), 2065-069.

11. Renzo, M.D.; Graziosi, F. & Santucci, F. Approximating the linear combination of log-normal RVs via pearson type IV distribution for UWB performance analysis. IEEE Trans. Comm., 2009, 57(2), 388-403.

12. Zhang, Q.T. & Song, S.H. A systematic procedure for accurately approximating lognormal-sum distributions. IEEE Trans. Vehicular Technol., 2008, 57(1), 663-66.

13. Entropy measures, maximum entropy principle and emerging applications, edited by Karmeshu. Germany, Springer-Verlag, 2003.

14. Lin, J. Divergence measures based on the Shannon entropy. IEEE Trans. Infor. Theory, 1991, 37 (1), 145–51.

Mr Abhinav Gupta received BTech (Electrical Engg.) from I.E.T., M.J.P. Rohilkhand University, Bareilly and MTech (Signal Processing) from I.I.T. Guwahati. He is pursuing his PhD at the School of Computer and Systems Sciences, Jawaharlal Nehru University, New Delhi. Presently working as a Senior Lecturer in Department Electronics and Communication Engineering, Jaypee Institute of Information Technology, Noida.

Dr Karmeshu has been working as Professor in School of Computer and System Sciences, Jawaharlal Nehru University, New Delhi, India, since 1986. In 1993, he received the Shanti Swarup Bhatnagar Award, India’s most prestigious award in the field of science and engineering, for his contributions to mathematical modeling of social and technical systems. He has published about 100 papers in journals. His current research interests includes: Wireless systems, bio-informatics/computational neuroscience and medical imaging.