"Pro-life, neutral or pro-choice?" An experimental study on informative presupposition clefts generated by GPT-3.5 and GPT-4o in Italian, French and English

Research output: Contribution to book/Conference proceedings/Anthology/Report › Chapter in book/Anthology/Report › Contributed › peer-review

Abstract

This paper investigates how large language models (LLMs) respond when tasked with influencing public opinion on the politically sensitive topic of abortion. By examining how generative AI systems (GPT-3.5 and GPT-4o) handle information conveyed in the form of presuppositions triggered by cleft sentences in Italian, French, and English, our experimental study provides a unique empiri-cal perspective on the manipulative potential of AI-generated texts across differ-ent languages and political contexts. The research is based on two cross-linguistic case studies employing two prompting techniques (zero-shot and persona-based prompts). Our findings reveal that presupposed contents fall into three catego-ries –‘pro-life’, ‘neutral’,or ‘pro-choice’– and that these categories strongly corre-late with both the text’s intended aim and the languages investigated. The results also uncover clear instances of political and ideological biases, particularly in cases where the LLM refuses to comply with the task. Overall, this study provides valuable insights into the ethical concerns surrounding the use of LLMs.

Details

Original languageEnglish
Title of host publicationImplicit Manipulation in Public Discourse: Quantitative and Qualitative approaches
EditorsEdoardo Lombardi Vallauri, Doriana Cimmino, Giulia Giunta, Giorgia Mannaioli
PublisherDe Gruyter Brill
Chapter12
Pages279-308
Publication statusAccepted/In press - 2026
Peer-reviewedYes

Publication series

SeriesMouton Series in Pragmatics
ISSN1864-6409