A Survey of Attributions and Preferences Regarding Higher-Order Mental States in Artificial AgentsShow others and affiliations
2023 (English)In: PROCEEDINGS OF THE 11TH CONFERENCE ON HUMAN-AGENT INTERACTION, HAI 2023, ASSOC COMPUTING MACHINERY , 2023, p. 97-104Conference paper, Published paper (Refereed)
Abstract [en]
Understanding how people attribute behavior to underlying mental states is crucial to the study of human social interactions. Previous research has established that people rely on attributing mental states to interpret and interact with artificial agents. For example, a pedestrian encountering a driverless vehicle at a crosswalk might view the vehicle as knowing (or not) that there is a pedestrian in front of it. Nevertheless, little attention has been devoted to investigating people's attributions of higher-order mental states, i.e., mental states that are about the mental states of others (e.g., the vehicle's beliefs about the pedestrian's intentions). Addressing this research gap, the present study conducted a survey to explore people's attributions and preferences concerning higher-order mental states in three types of artificial agents (AI chatbot, virtual assistant, and self-driving car), alongside two human agents (participants themselves, referred to as you, and five-year-old child). The survey revealed that: (1) artificial agents, in contrast to humans, may be perceived as more likely to have higher-order mental states than first-order mental states, depending on the purpose or function of the agent; (2) people may prefer some artificial agents to have mental states of a particular order (but not others); (3) attributions and preferences regarding mental states in artificial agents do not always match. The study also contributes insights regarding the methodological challenge of constructing a survey that effectively captures participants' higher-order attributions while minimizing excessive cognitive demands. We posit that human-agent interaction research and design stand to benefit from further exploration of people's attributions and preferences regarding higher-order mental states in artificial agents.
Place, publisher, year, edition, pages
ASSOC COMPUTING MACHINERY , 2023. p. 97-104
Keywords [en]
mental state attribution; theory of mind; human-agent interaction
National Category
Sociology (Excluding Social Work, Social Anthropology, Demography and Criminology)
Identifiers
URN: urn:nbn:se:liu:diva-201066DOI: 10.1145/3623809.3623897ISI: 001148034200014ISBN: 9798400708244 (print)OAI: oai:DiVA.org:liu-201066DiVA, id: diva2:1840382
Conference
11th International Conference on Human-Agent Interaction (HAI), Chalmers Univ Technol, Gothenburg, SWEDEN, dec 04-07, 2023
Note
Funding Agencies|ELLIIT, the Excellence Center at Linkoping-Lund in Information Technology; Swedish Research Council (VR) [2022-04602]
2024-02-232024-02-232025-02-17