Item request has been placed! ×
Item request cannot be made. ×
loading  Processing Request

SHERLOCK: Experimental evaluation of a conversational agent for mobile information tasks

Item request has been placed! ×
Item request cannot be made. ×
loading   Processing Request
  • معلومة اضافية
    • بيانات النشر:
      Institute of Electrical and Electronics Engineers (IEEE)
    • الموضوع:
      2017
    • Collection:
      Cardiff University: ORCA (Online Research @ Cardiff)
    • نبذة مختصرة :
      —Controlled Natural Language (CNL) has great potential to support human-machine interaction (HMI) because it provides an information representation that is both human readable and machine processable.We investigated the effectiveness of a CNL-based conversational interface for HMI in a behavioural experiment called Simple Human Experiment Regarding Locally Observed Collective Knowledge (SHERLOCK). In SHERLOCK, individuals acted in groups to discover and report information to the machine using natural language (NL), which the machine then processed into CNL. The machine fused responses from different users to form a common operating picture, a dashboard showing the level of agreement for distinct information. To obtain information to add to this dashboard, users explored the real world in a simulated crowd-sourced sensing scenario. This scenario represented a simplified, controlled analogue for tactical intelligence (i.e., direct intelligence of the environment), which is key for rapidly planning military, law enforcement, and emergency operations. Overall, despite close to zero training, 74% of the users inputted NL that was machine interpretable and addressed the assigned tasks. An experimental manipulation aimed to increase user-machine interaction, however, did not improve performance as hypothesised. Nevertheless, results indicate the conversational interface may be effective in assisting humans with collection and fusion of information in a crowd-sourcing context.
    • File Description:
      application/pdf
    • Relation:
      https://orca.cardiff.ac.uk/id/eprint/100131/13/07936494.pdf; Preece, Alun https://orca.cardiff.ac.uk/view/cardiffauthors/A1248919.html orcid:0000-0003-0349-9057 orcid:0000-0003-0349-9057, Webberley, William, Braines, Dave https://orca.cardiff.ac.uk/view/cardiffauthors/A2323425C.html, Zaroukian, Erin G. and Bakdash, Jonathan Z. 2017. SHERLOCK: Experimental evaluation of a conversational agent for mobile information tasks. IEEE Transactions on Human-Machine Systems 47 (6) , pp. 1017-1028. 10.1109/THMS.2017.2700625 https://doi.org/10.1109/THMS.2017.2700625 file https://orca.cardiff.ac.uk/id/eprint/100131/13/07936494.pdf
    • الرقم المعرف:
      10.1109/THMS.2017.2700625
    • Rights:
      cc_by
    • الرقم المعرف:
      edsbas.E984C748