ProofTeller: Exposing Recency Bias in LLM Reasoning and Its Side Effects on Communication (Extended Abstract)

Publikation: Beitrag in Buch/Konferenzbericht/Sammelband/Gutachten › Beitrag in Konferenzband › Beigetragen › Begutachtung

Beitragende

Abstract

This abstract is for a paper [1] published in 2025 in the proceedings of the 14th International Joint Conference on Natural Language Processing and the 4th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics, and we extend it here with a new study that closes the gap with previous research. Large language models (LLMs) are increasingly applied in domains that demand reliable and interpretable reasoning. While formal reasoning methods can generate correct proofs, these proofs are often inaccessible to non-expert users. This raises a natural question: Can LLMs, when given a proof, faithfully interpret its reasoning and communicate it clearly? Recently, we have introduced ProofTeller, a benchmark that evaluates this ability across three tasks: (1) identifying key proof steps, (2) summarizing the reasoning, and (3) explaining the result in concise natural language. The benchmark covers three domains: Biology, Drones, and Recipes, representing scientific, safety-critical, and everyday reasoning scenarios. We find a consistent near-conclusion bias: LLMs tend to focus on steps closest to the final proof conclusion rather than on the most informative ones. A targeted human study confirms that explanations based on such steps are rated less appropriate for end users. These findings indicate that even when reasoning is provided, current LLMs face challenges in communicating key information in a useful manner, highlighting the need for LLMs that can communicate important details reliably.

Details

OriginalspracheEnglisch
TitelProceedings of the 39th International Workshop on Description Logics, DL 2026
Seitenumfang9
PublikationsstatusVeröffentlicht - 2026
Peer-Review-StatusJa

Publikationsreihe

ReiheCEUR workshop proceedings
Band4230
ISSN1613-0073

Workshop

Titel39th International Workshop on Description Logics
KurztitelDL 2026
Veranstaltungsnummer39
Beschreibungco-located with several events as part of FLoC 2026, including KR 2026 and NMR 2026
Dauer17 - 19 Juli 2026
Webseite
OrtInstituto Universitario de Lisboa (ISCTE-IUL)
StadtLisbon
LandPortugal

Externe IDs

ORCID /0000-0001-9936-0943/work/228956494

Schlagworte

ASJC Scopus Sachgebiete

Schlagwörter

  • benchmark, faithfulness, LLM evaluation, proofs, reliability