Decoding the Neural Stages from Action and Object Recognition to Mentalizing

Abstract

Higher-level action interpretation, such as inferring underlying intentions and predicting future actions, requires the integration of conceptual action information (e.g., “opening”) with semantic knowledge about persons and objects (e.g., “my friend Anna,” “pizza box”). However, how the neural systems for action and object recognition and memory interact with each other to form the basis for inferring higher-level mental states remains unclear. Here we use fMRI-based crossmodal multiple regression representational similarity analysis in human female and male participants to elucidate the processing stages from basic action and object recognition to mentalizing. We show that inferring intentions from observed actions or written sentences involves a modality-general network of lateral and medial frontoparietal and temporal brain regions associated with conceptual action and object representation and mentalizing. The representational profiles in these regions are explained by models capturing different types of conceptual information, revealing distinct but partially overlapping networks for action, object, and mental state representation. There was no strict separation of networks for action, object, and mental state representations, arguing against a sequential bottom–up hierarchy from action and object understanding pathways to the mentalizing network. Rather, left-hemispheric regions, specifically ventrolateral prefrontal, inferior parietal, and anterior lateral occipitotemporal cortex, showed strong representational overlap, pointing toward a core network for making meaning of action–object structures at a conceptual level. We argue that this core network represents a distributional semantic hub between classic networks for action and object understanding and the mentalizing network.