go-v.orgdoi

Improving the Sensitivity of Statistical Testing for Clusterability with Mirrored-Density Plots

Michael Christoph Thrun · Eurographics · 2020

  • DOI 10.2312/mlvis.20201102
  • Publisher OpenAlex
  • Type article
  • Issued 2020

Not cached yet. This record was fetched live for this request and is stored after the lookup. Reopening the page should serve the cached copy.

Eurographics · OpenAlex · article · 2020

Abstract

For many applications, it is crucial to decide if a dataset possesses cluster structures. This property is called clusterability and is usually investigated with the usage of statistical testing. Here, it is proposed to extend statistical testing with the Mirrored- Density plot (MDplot). The MDplot allows investigating the distributions of many variables with automatic sampling in case of large datasets. Statistical testing of clusterability is compared with MDplots of the 1st principal component and the distance distribution of data. Contradicting results are evaluated with topographic maps of cluster structures derived from planar projections using the generalized U-Matrix technique.

A collection of artificial and natural datasets is used for the comparison. This collection is specially designed to have a variety of clustering problems that any algorithm should be able to handle. The results demonstrate that the MDplot improves statistical testing but, even then, almost touching cluster structures of low intercluster distances without a predominant direction of variance remain challenging.

Open the resolved locator · 10.2312/mlvis.20201102

Metadata licence: OpenAlex metadata (CC0)