Logic-Guided Message Generation from Raw Real-Time Sensor Data
Research output: Contribution to book/Conference proceedings/Anthology/Report › Conference contribution › Contributed › peer-review
Contributors
Abstract
Natural language generation in real-time settings with raw sensor data is a challenging task. We find that formulating the task as an end-to-end problem leads to two major challenges in content selection - the sensor data is both redundant and diverse across environments, thereby making it hard for the encoders to select and reason on the data. We here present a new corpus for a specific domain that instantiates these properties. It includes handover utterances that an assistant for a semi-autonomous drone uses to communicate with humans during the drone flight. The corpus consists of sensor data records and utterances in 8 different environments. As a structured intermediary representation between data records and text, we explore the use of description logic (DL). We also propose a neural generation model that can alert the human pilot of the system state and environment in preparation of the handover of control.
Details
Original language | English |
---|---|
Title of host publication | Proceedings of the 13th Language Resources and Evaluation Conference (LREC’22) |
Editors | Nicoletta Calzolari, Frederic Bechet, Philippe Blache, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, Helene Mazo, Jan Odijk, Stelios Piperidis |
Pages | 6899-6908 |
Number of pages | 10 |
ISBN (electronic) | 9791095546726 |
Publication status | Published - 2022 |
Peer-reviewed | Yes |
External IDs
Scopus | 85144349715 |
---|---|
ORCID | /0000-0001-9936-0943/work/142238134 |
Keywords
Research priority areas of TU Dresden
DFG Classification of Subject Areas according to Review Boards
Subject groups, research areas, subject areas according to Destatis
ASJC Scopus subject areas
Keywords
- content selection, description logic, domain variability, experiment, low resources, message generation