Reformulation of symptom descriptions in dialogue systems for fault diagnosis: How to ask for clarification

Research output: Contribution to journalResearch articleContributedpeer-review

Contributors

Abstract

Psycholinguistic research can inform the design of dialogue systems for fault diagnosis. When users provide ambiguous symptom descriptions, dialogue systems can reformulate these descriptions to check the correctness of their interpretation. The present study investigated whether such reformulations should be performed by users or dialogue systems, and how they should be phrased. In a Wizard-of-Oz study, subjects described faults symptoms to a chatbot, which subsequently asked for clarification. Experiment 1 compared the effects of requests for subjects to self-correct their descriptions and reformulations provided by the dialogue system in either common or technical terms. Experiment 2 combined reformulations in common and technical terms with each other and with pictures of fault symptoms. The results revealed that requests for self-correction increased solution times and verbal effort, that common terms decreased solution times but led to errors when seemingly easy reformulations were incorrect, and that technical terms did not mislead subjects into accepting them uncritically. Enrichments with pictures reduced the risk of accepting incorrect reformulations and were considered particularly helpful when combined with common terms. Lexical alignment with dialogue system reformulations was low, but subjects adopted its technical terms most readily when no common terms were provided. Taken together, the results suggest that combining reformulations in everyday language with visual information is most suitable to support grounding.

Details

Original languageEnglish
Article number102516
Pages (from-to)1-19
Number of pages19
JournalInternational journal of human - computer studies : IJHCS
Volume145
Publication statusPublished - Jan 2021
Peer-reviewedYes

External IDs

Scopus 85088359782
Mendeley 1fd1e1ae-b489-3000-b9bc-a602e6053c4e

Keywords

Keywords

  • Fault diagnosis, Grounding, Miscommunication, Reformulation, Dialogue system, Repair