"Pro-life, neutral or pro-choice?" An experimental study on informative presupposition clefts generated by GPT-3.5 and GPT-4o in Italian, French and English
Research output: Contribution to book/Conference proceedings/Anthology/Report › Chapter in book/Anthology/Report › Contributed › peer-review
Contributors
Abstract
This paper investigates how large language models (LLMs) respond when tasked with influencing public opinion on the politically sensitive topic of abortion. By examining how generative AI systems (GPT-3.5 and GPT-4o) handle information conveyed in the form of presuppositions triggered by cleft sentences in Italian, French, and English, our experimental study provides a unique empiri-cal perspective on the manipulative potential of AI-generated texts across differ-ent languages and political contexts. The research is based on two cross-linguistic case studies employing two prompting techniques (zero-shot and persona-based prompts). Our findings reveal that presupposed contents fall into three catego-ries –‘pro-life’, ‘neutral’,or ‘pro-choice’– and that these categories strongly corre-late with both the text’s intended aim and the languages investigated. The results also uncover clear instances of political and ideological biases, particularly in cases where the LLM refuses to comply with the task. Overall, this study provides valuable insights into the ethical concerns surrounding the use of LLMs.
Details
| Original language | English |
|---|---|
| Title of host publication | Implicit Manipulation in Public Discourse: Quantitative and Qualitative approaches |
| Editors | Edoardo Lombardi Vallauri, Doriana Cimmino, Giulia Giunta, Giorgia Mannaioli |
| Publisher | De Gruyter Brill |
| Chapter | 12 |
| Pages | 279-308 |
| Publication status | Accepted/In press - 2026 |
| Peer-reviewed | Yes |
Publication series
| Series | Mouton Series in Pragmatics |
|---|---|
| ISSN | 1864-6409 |