Skip to main content
placeholder image

Smooth tests of fit for Gaussian mixtures

Conference Paper


Abstract


  • Model based clustering and classification are often based on a finite mixture distribution. The most popular choice for the mixture component distribution is the Gaussian distribution (Fraley and Raftery, J Stat Softw 18(6):1–13, 2007). Many tests, for example those based on goodness of fit measures, focus on detecting the order of the mixture. However what is often neglected are diagnostic tests to confirm the distributional assumptions. This may lead to the cluster analysis having invalid conclusions.

    Smooth tests (Rayner et al., Smooth tests of goodness of fit: using R, 2nd edn. Wiley, Singapore, 2009) can be used to test the distributional assumptions against the so-called general smooth alternatives in the sense of Neyman (Skandinavisk Aktuarietidskr 20:150–99, 1937). To test for a mixture distribution we present smooth tests that have the additional advantage that they permit the testing of sub-hypotheses using components. These test statistics are asymptotically chi-squared distributed. Results of the simulation study show that bootstrapping needs to be applied for small to medium sample sizes to maintain the P(type I error) at the nominal level and that the proposed tests have high power against various alternatives. Lastly the tests are illustrated on a data set on the average amount of precipitation in inches for each of 70 United States and Puerto Rico cities (Mcneil, Interactive data analysis. Wiley, New York, 1977).

Publication Date


  • 2015

Citation


  • Suesse, T., Rayner, J. & Thas, O. (2015). Smooth tests of fit for Gaussian mixtures. In B. Lausen, S. Krolak-Schwerdt & M. Böhmer (Eds.), Data Science, Learning by Latent Structures, and Knowledge Discovery (pp. 133-142). Germany: Springer Berlin Heidelberg.

Scopus Eid


  • 2-s2.0-84945585554

Ro Metadata Url


  • http://ro.uow.edu.au/eispapers/5288

Start Page


  • 133

End Page


  • 142

Abstract


  • Model based clustering and classification are often based on a finite mixture distribution. The most popular choice for the mixture component distribution is the Gaussian distribution (Fraley and Raftery, J Stat Softw 18(6):1–13, 2007). Many tests, for example those based on goodness of fit measures, focus on detecting the order of the mixture. However what is often neglected are diagnostic tests to confirm the distributional assumptions. This may lead to the cluster analysis having invalid conclusions.

    Smooth tests (Rayner et al., Smooth tests of goodness of fit: using R, 2nd edn. Wiley, Singapore, 2009) can be used to test the distributional assumptions against the so-called general smooth alternatives in the sense of Neyman (Skandinavisk Aktuarietidskr 20:150–99, 1937). To test for a mixture distribution we present smooth tests that have the additional advantage that they permit the testing of sub-hypotheses using components. These test statistics are asymptotically chi-squared distributed. Results of the simulation study show that bootstrapping needs to be applied for small to medium sample sizes to maintain the P(type I error) at the nominal level and that the proposed tests have high power against various alternatives. Lastly the tests are illustrated on a data set on the average amount of precipitation in inches for each of 70 United States and Puerto Rico cities (Mcneil, Interactive data analysis. Wiley, New York, 1977).

Publication Date


  • 2015

Citation


  • Suesse, T., Rayner, J. & Thas, O. (2015). Smooth tests of fit for Gaussian mixtures. In B. Lausen, S. Krolak-Schwerdt & M. Böhmer (Eds.), Data Science, Learning by Latent Structures, and Knowledge Discovery (pp. 133-142). Germany: Springer Berlin Heidelberg.

Scopus Eid


  • 2-s2.0-84945585554

Ro Metadata Url


  • http://ro.uow.edu.au/eispapers/5288

Start Page


  • 133

End Page


  • 142