Global approach for the comparison of Clustering Results

• Author(s): Silva, Osvaldo ; Bacelar-Nicolau, Helena ; Nicolau, Fernando C.
• Date: 2012
• Persistent ID: http://hdl.handle.net/10400.3/2730
• Origin: Repositório da Universidade dos Açores
• Subject(s): Cluster Analysis; VL Methodology; Affinity Coefficient; Comparing Partitions; Cluster Stability; Cluster Validation
• Document Type: Conference Object
• Language: English

Description

6th Workshop on Statistics, mathematics and Computation – 3 rd Portuguese-Polish workshop on Biometry (6wsmc2012). July 3 - 4, 2012, Covilhã, Portugal (Comunicação). The extraction of useful knowledge from a Hierarchical Cluster Analysis (HCA) is a complex process which depends on many factors, such as the applied clustering algorithms and the strategies developed in the initial stage of the HCA. We present a global approach for evaluating the quality of clustering results based on the comparison of partitions from the different clustering algorithms using the most relevant information available (e.g. stability, isolation and homogeneity of the clusters). In addition, we suggest a visual method to facilitate the evaluation of the quality of the partitions that allows us a quick perception of the similarities and the differences between the partitions, including the behaviour of the elements in the partitions. We illustrate our approach using a real data set (horse data). We applied HCA based on the weighted generalized affinity coefficient (similarity coefficient) to the case of complex data (symbolic data), combined with 26 clustering (classic and probabilistic) algorithms. Finally, we discuss the obtained results and the contribution of this approach to a better knowledge on the cluster structure of a data set.