論文

査読有り
2015年6月

Inter-subject neural code converter for visual image representation

NEUROIMAGE
  • Kentaro Yamada
  • ,
  • Yoichi Miyawaki
  • ,
  • Yukiyasu Kamitani

113
開始ページ
289
終了ページ
297
記述言語
英語
掲載種別
研究論文(学術雑誌)
DOI
10.1016/j.neuroimage.2015.03.059
出版者・発行元
ACADEMIC PRESS INC ELSEVIER SCIENCE

Brain activity patterns differ from person to person, even for an identical stimulus. In functional brain mapping studies, it is important to align brain activity patterns between subjects for group statistical analyses. While anatomical templates are widely used for inter-subject alignment in functional magnetic resonance imaging (fMRI) studies, they are not sufficient to identify the mapping between voxel-level functional responses representing specific mental contents. Recent work has suggested that statistical learning methods could be used to transform individual brain activity patterns into a common space while preserving representational contents. Here, we propose a flexible method for functional alignment, "neural code converter," which converts one subject's brain activity pattern into another's representing the same content. The neural code converter was designed to learn statistical relationships between fMRI activity patterns of paired subjects obtained while they sawan identical series of stimuli. It predicts the signal intensity of individual voxels of one subject from a pattern of multiple voxels of the other subject. To test this method, we used fMRI activity patterns measured while subjects observed visual images consisting of random and structured patches. We show that fMRI activity patterns for visual images not used for training the converter could be predicted from those of another subject where brain activity was recorded for the same stimuli. This confirms that visual images can be accurately reconstructed from the predicted activity patterns alone. Furthermore, we show that a classifier trained only on predicted fMRI activity patterns could accurately classify measured fMRI activity patterns. These results demonstrate that the neural code converter can translate neural codes between subjects while preserving contents related to visual images. While this method is useful for functional alignment and decoding, it may also provide a basis for brain-to-brain communication using the converted pattern for designing brain stimulation. (C) 2015 Elsevier Inc. All rights reserved.

リンク情報
DOI
https://doi.org/10.1016/j.neuroimage.2015.03.059
Web of Science
https://gateway.webofknowledge.com/gateway/Gateway.cgi?GWVersion=2&SrcAuth=JSTA_CEL&SrcApp=J_Gate_JST&DestLinkType=FullRecord&KeyUT=WOS:000354392700028&DestApp=WOS_CPL
ID情報
  • DOI : 10.1016/j.neuroimage.2015.03.059
  • ISSN : 1053-8119
  • eISSN : 1095-9572
  • Web of Science ID : WOS:000354392700028

エクスポート
BibTeX RIS