SMILE: A novel dissimilarity-based procedure for detecting sparse-specific profiles in sparse contingency tables

Mathieu Emily (1, 2) , Christophe Hitte (3) , Alain Mom (2)

1 LMA2 - Laboratoire de Mathématiques Appliquées Agrocampus
2 IRMAR - Institut de Recherche Mathématique de Rennes
3 IGDR - Institut de Génétique et Développement de Rennes

A novel statistical procedure for clustering individuals characterized by sparse-specific profiles is introduced in the context of data summarized in sparse contingency tables. The proposed procedure relies on a single-linkage clustering based on a new dissimilarity measure designed to give equal influence to sparsity and specificity of profiles. Theoretical properties of the new dissimilarity are derived by characterizing single-linkage clustering using Minimum Spanning Trees. Such characterization allows the description of situations for which the proposed dissimilarity outperforms competing dissimilarities. Simulation examples are performed to demonstrate the strength of the new dissimilarity compared to 11 other methods. The analysis of a genomic data set dedicated to the study of molecular signatures of selection is used to illustrate the efficiency of the proposed method in a real situation

Keywords: Conditional profile; Dissimilarity; Single-linkage clustering; Sparse contingency table

Domains: Life Sciences [q-bio]

Mathieu Emily, Christophe Hitte, Alain Mom. SMILE: A novel dissimilarity-based procedure for detecting sparse-specific profiles in sparse contingency tables. Computational Statistics and Data Analysis, 2016, 99, pp.171-188. ⟨10.1016/j.csda.2016.01.017⟩. ⟨hal-01269901⟩