Identifying thematic roles from neural representations measured by functional magnetic resonance imaging

Jing Wang, Vladimir L. Cherkassky, Ying Yang, Kai min Kevin Chang, Robert Vargas, Nicholas Diana, Marcel Adam Just

Research output: Contribution to journalArticlepeer-review

24 Scopus citations

Abstract

The generativity and complexity of human thought stem in large part from the ability to represent relations among concepts and form propositions. The current study reveals how a given object such as rabbit is neurally encoded differently and identifiably depending on whether it is an agent (“the rabbit punches the monkey”) or a patient (“the monkey punches the rabbit”). Machine-learning classifiers were trained on functional magnetic resonance imaging (fMRI) data evoked by a set of short videos that conveyed agent–verb–patient propositions. When tested on a held-out video, the classifiers were able to reliably identify the thematic role of an object from its associated fMRI activation pattern. Moreover, when trained on one subset of the study participants, classifiers reliably identified the thematic roles in the data of a left-out participant (mean accuracy =.66), indicating that the neural representations of thematic roles were common across individuals.

Original languageEnglish
Pages (from-to)257-264
Number of pages8
JournalCognitive Neuropsychology
Volume33
Issue number3-4
DOIs
StatePublished - 18 May 2016
Externally publishedYes

Keywords

  • Functional magnetic resonance imaging
  • multivariate pattern analysis
  • propositional representation
  • thematic roles

Fingerprint

Dive into the research topics of 'Identifying thematic roles from neural representations measured by functional magnetic resonance imaging'. Together they form a unique fingerprint.

Cite this