[2601.16130] Replicating Human Motivated Reasoning Studies with LLMs

Computer Science > Human-Computer Interaction arXiv:2601.16130 (cs) [Submitted on 22 Jan 2026 (v1), last revised 7 May 2026 (this version, v2)] Title:Replicating Human Motivated Reasoning Studies with LLMs Authors:Neeley Pate, Adiba Mahbub Proma, Hangfeng He, James N. Druckman, Daniel C. Molden, Gourab Ghoshal, Ehsan Hoque View a PDF of the paper titled Replicating Human Motivated Reasoning Studies with LLMs, by Neeley Pate and 6 other authors View PDF HTML (experimental) Abstract:Motivated reasoning - the idea that individuals processing information may be motivated to either arrive at accurate beliefs or arrive at desired conclusions - has been well-explored as a human phenomenon. However, it remains unclear whether base LLMs are affected by motivational manipulations. Replicating 4 prior political motivated reasoning studies, we find that base LLM behavior does not align with expected human behavior. Furthermore, base LLM behavior across models shares some similarities, such as when selecting to abstain from question answering and incorporating provided arguments into opinions. The results suggest that base LLMs may not emulate human motivated reasoning processes. We emphasize the importance of these findings for researchers using LLMs to for certain tasks such as opinion replication and argument assessment. Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI) Cite as: arXiv:2601.16130 [cs.HC]   (or arXiv:2601.16130v2 [cs.HC] for this version)  ...