Item request has been placed! ×
Item request cannot be made. ×
loading  Processing Request

A Methodology for the Comparison of Human Judgments With Metrics for Coreference Resolution

Item request has been placed! ×
Item request cannot be made. ×
loading   Processing Request
اقرأ أكثر حفظ في قائمتي
  • معلومة اضافية
    • Contributors:
      Mathématiques et Informatique Appliquées du Génome à l'Environnement Jouy-En-Josas (MaIAGE); Institut National de Recherche pour l’Agriculture, l’Alimentation et l’Environnement (INRAE); Modèles, Dynamiques, Corpus (MoDyCo); Université Paris Nanterre (UPN)-Centre National de la Recherche Scientifique (CNRS); Laboratoire d'Informatique Fondamentale d'Orléans (LIFO); Université d'Orléans (UO)-Institut National des Sciences Appliquées - Centre Val de Loire (INSA CVL); Institut National des Sciences Appliquées (INSA)-Institut National des Sciences Appliquées (INSA); Lattice - Langues, Textes, Traitements informatiques, Cognition - UMR 8094 (Lattice); Université Sorbonne Nouvelle - Paris 3-Université Sorbonne Paris Cité (USPC)-Centre National de la Recherche Scientifique (CNRS)-Université Paris Sciences et Lettres (PSL)-Département Littératures et langage - ENS-PSL (LILA); École normale supérieure - Paris (ENS-PSL); Université Paris Sciences et Lettres (PSL)-Université Paris Sciences et Lettres (PSL)-École normale supérieure - Paris (ENS-PSL); Université Paris Sciences et Lettres (PSL)
    • بيانات النشر:
      CCSD
      Association for Computational Linguistics
    • الموضوع:
      2022
    • الموضوع:
      Dublin; Ireland
    • نبذة مختصرة :
      International audience ; We propose a method for investigating the interpretability of metrics used for the coreference resolution task through comparisons with human judgments. We provide a corpus with annotations of different error types and human evaluations of their gravity. Our preliminary analysis shows that metrics considerably overlook several error types and overlook errors in general in comparison to humans. This study is conducted on French texts, but the methodology should be language-independent.
    • الرقم المعرف:
      10.18653/v1/2022.humeval-1.2
    • الدخول الالكتروني :
      https://hal.science/hal-03650294
      https://hal.science/hal-03650294v1/document
      https://hal.science/hal-03650294v1/file/A_Methodology_for_the_Comparison_of_Human_Judgments_With_Metrics_for_Coreference_Resolution.pdf
      https://doi.org/10.18653/v1/2022.humeval-1.2
    • Rights:
      info:eu-repo/semantics/OpenAccess
    • الرقم المعرف:
      edsbas.28EEB49C