Constellation Loss: Improving the Efficiency of Deep Metric Learning Loss Functions for the Optimal Embedding of histopathological images.

Publisher: Elsevier Inc Country of Publication: United States NLM ID: 101528849 Publication Model: eCollection Cited Medium: Print ISSN: 2229-5089 (Print) NLM ISO Abbreviation: J Pathol Inform Subsets: PubMed not MEDLINE

Publication: 2022- : [New York] : Elsevier Inc.
Original Publication: Ghatkopar, Mumbai : Medknow Publications and Media, 2010-

Background: Deep learning diagnostic algorithms are proving comparable results with human experts in a wide variety of tasks, and they still require a huge amount of well-annotated data for training, which is often non affordable. Metric learning techniques have allowed a reduction in the required annotated data allowing few-shot learning over deep learning architectures.
Aims and Objectives: In this work, we analyze the state-of-the-art loss functions such as triplet loss, contrastive loss, and multi-class N-pair loss for the visual embedding extraction of hematoxylin and eosin (H&E) microscopy images and we propose a novel constellation loss function that takes advantage of the visual distances of the embeddings of the negative samples and thus, performing a regularization that increases the quality of the extracted embeddings.
Materials and Methods: To this end, we employed the public H&E imaging dataset from the University Medical Center Mannheim (Germany) that contains tissue samples from low-grade and high-grade primary tumors of digitalized colorectal cancer tissue slides. These samples are divided into eight different textures (1. tumour epithelium, 2. simple stroma, 3. complex stroma, 4. immune cells, 5. debris and mucus, 6. mucosal glands, 7. adipose tissue and 8. background,). The dataset was divided randomly into train and test splits and the training split was used to train a classifier to distinguish among the different textures with just 20 training images. The process was repeated 10 times for each loss function. Performance was compared both for cluster compactness and for classification accuracy on separating the aforementioned textures.
Results: Our results show that the proposed loss function outperforms the other methods by obtaining more compact clusters (Davis-Boulding: 1.41 ± 0.08, Silhouette: 0.37 ± 0.02) and better classification capabilities (accuracy: 85.0 ± 0.6) over H and E microscopy images. We demonstrate that the proposed constellation loss can be successfully used in the medical domain in situations of data scarcity.
(Copyright: © 2020 Journal of Pathology Informatics.)

Science. 2006 Jul 28;313(5786):504-7. (PMID: 16873662)
IEEE Trans Pattern Anal Mach Intell. 1979 Feb;1(2):224-7. (PMID: 21868852)
Sci Rep. 2016 Jun 16;6:27988. (PMID: 27306927)

Keywords: Few-shot learning; histopathology; metric learning

Date Created: 20210408 Latest Revision: 20220729

20250114

PMC8020841

10.4103/jpi.jpi_41_20

33828896