PDF(2279 KB)
Affective brain-computer interfaces: Insights from psychology and neuroscience
Jingjing CHEN, Xin HU, Xinke SHEN, Dan ZHANG
Journal of Tsinghua University(Science and Technology) ›› 2025, Vol. 65 ›› Issue (12) : 2341-2350.
PDF(2279 KB)
PDF(2279 KB)
Affective brain-computer interfaces: Insights from psychology and neuroscience
Significance: Empowering machines to understand human emotions remains one of the primary challenges in developing artificial intelligence (AI). The affective brain-computer interface (BCI), which decodes emotional states based on brain signals, is an emerging field combining psychology, neuroscience, and AI. Brain signals are inherently uncontrollable, contain rich emotion-specific information, and provide a promising physiological basis for developing computing systems that support continual emotion monitoring. Since its inception, affective BCI research has required close collaboration across various disciplines: it depends on the use of information science for feature engineering and algorithm development, psychology for theoretical frameworks of emotion, and neuroscience for revealing the neural mechanisms underlying emotional processes. Such a demand for multidisciplinary co-operation forms the core focus of this review. Specifically, this paper focuses on the methods by which psychology-and neuroscience-based insights can inspire and advance affective BCI research. Progress: We summarize the current progress at three levels: theoretical, technical, and applied. In the first one, recent advances in affective science offer new perspectives for shaping affective BCI paradigms. The traditional discrete and dimensional frameworks have laid the groundwork for emotion decoding but often overlook positive emotions and the dynamic intensity of affective experiences. Recent emotion theories emphasizing refined positive emotions, mixed emotions, and context-dependent emotions provide valuable directions for improving emotion representation. Affective computing should align with these developments, integrating them into computational models to enhance ecological validity. In turn, affective BCI research may also contribute to psychology by offering evidence to test and refine emotion theories, fostering reciprocal progress across disciplines. At the technical level, neuroscience provides crucial insights for building more robust affective BCIs. Findings on emotional valence lateralization and distributed emotion-associated brain representations can inform the design of models that better capture emotional processing complexity. Moreover, inter-subject brain synchronization research has revealed mechanisms that enhance model generalizability across users, suggesting that incorporating neuroscientific findings can substantially improve the performance and reliability of affective BCIs. At the application level, affective BCIs are expanding beyond emotion recognition toward understanding emotion-related individual differences. Variability between individuals—often treated as noise—may instead offer meaningful information about personality traits or mental health conditions. In the long term, the goal of affective BCI systems may evolve from accurately identifying emotions to comprehensively understanding each individual's psychological tendencies and dynamic affective patterns across multimodal neural and behavioral data. We advocate for stronger integration between affective BCI technologies and practical domains. Such integration allows practical demands to drive technological development, ensuring that affective BCI remains human-centered. Conclusions and Prospects: Finally, we discuss the technical challenges of affective BCI, including extending algorithms from controlled laboratory settings to real-world scenarios, advancing sensor technology for more convenient and reliable brain-signal acquisition, and leveraging large models to enhance performance for affective BCI. Specifically, we emphasize the vital role of ethical considerations: as affective BCIs move from passive emotion detection toward active emotional support or intervention, the responsibility of humans as rational moral agents in a future era of man-computer symbiosis must be considered, ensuring the autonomy of human emotions.
brain-computer interface / affective computing / psychology / neuroscience
| 1 |
|
| 2 |
|
| 3 |
|
| 4 |
|
| 5 |
赵国朕, 宋金晶, 葛燕, 等. 基于生理大数据的情绪识别研究进展[J]. 计算机研究与发展, 2016, 53 (1): 80- 92.
|
| 6 |
UDOVI AČG I AĆG G, DEREK J, RUSSO M, et al. Wearable emotion recognition system based on GSR and PPG signals[C]//Proceedings of the 2nd International Workshop on Multimedia for Personal Health and Health Care. Mountain View, USA: Association for Computing Machinery, 2017: 53-59.
|
| 7 |
|
| 8 |
|
| 9 |
|
| 10 |
|
| 11 |
|
| 12 |
|
| 13 |
|
| 14 |
|
| 15 |
|
| 16 |
|
| 17 |
|
| 18 |
|
| 19 |
|
| 20 |
|
| 21 |
|
| 22 |
|
| 23 |
|
| 24 |
|
| 25 |
|
| 26 |
|
| 27 |
|
| 28 |
|
| 29 |
|
| 30 |
PEKRUN R, LINNENBRINK-GARCIA L. Academic emotions and student engagement[M]//CHRISTENSON S L, RESCHLY A L, WYLIE C. Handbook of Research on Student Engagement. Boston, USA: Springer, 2012: 259-282.
|
| 31 |
|
| 32 |
|
| 33 |
胡鑫, 蒋俏蕾, 宋磊, 等. "萌"的媒介效果: 基于脑电情感计算的"萌"视频情绪分析[J]. 全球传媒学刊, 2021, 8 (6): 27- 44.
|
| 34 |
|
| 35 |
陈菁菁, 王非, 高小榕, 等. 教育领域中的脑-机接口应用: 动向与挑战[J]. 科技导报, 2022, 40 (12): 90- 101.
|
| 36 |
|
| 37 |
|
| 38 |
|
| 39 |
|
| 40 |
|
| 41 |
|
| 42 |
|
| 43 |
|
| 44 |
|
| 45 |
|
| 46 |
|
| 47 |
|
| 48 |
|
| 49 |
|
| 50 |
|
| 51 |
|
| 52 |
|
| 53 |
|
| 54 |
|
| 55 |
|
| 56 |
|
| 57 |
|
| 58 |
|
| 59 |
|
| 60 |
|
| 61 |
SHEN X K, GAN R M, WANG K X, et al. Dynamic-attention-based EEG state transition modeling for emotion recognition[J/OL]. IEEE Transactions on Affective Computing. (2025-07-29)[2025-07-30]. https://ieeexplore.ieee.org/document/11098886.
|
| 62 |
权学良, 曾志刚, 蒋建华, 等. 基于生理信号的情感计算研究综述[J]. 自动化学报, 2021, 47 (8): 1769- 1784.
|
| 63 |
|
| 64 |
|
| 65 |
|
| 66 |
|
| 67 |
|
| 68 |
FREY J, DANIEL M, CASTET J, et al. Framework for electroencephalography-based evaluation of user experience[C]//Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. San Jose, USA: Association for Computing Machinery, 2016: 2283-2294.
|
| 69 |
|
| 70 |
|
| 71 |
|
| 72 |
|
| 73 |
|
| 74 |
|
| 75 |
|
| 76 |
|
| 77 |
|
| 78 |
|
| 79 |
|
| 80 |
WATSON D, CLARK L A. Chapter 29-Extraversion and its positive emotional core[M]//HOGAN R, JOHNSON J, BRIGGS S. Handbook of Personality Psychology. San Diego, USA: Academic Press, 1997: 767-793.
|
| 81 |
|
| 82 |
|
| 83 |
|
| 84 |
|
| 85 |
|
| 86 |
|
| 87 |
|
| 88 |
|
| 89 |
|
| 90 |
|
| 91 |
|
| 92 |
|
| 93 |
LI J L, LEE C C. Attention learning with retrievable acoustic embedding of personality for emotion recognition[C]//2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII). Cambridge, UK: IEEE, 2019: 171-177.
|
| 94 |
|
| 95 |
JIANG W B, ZHAO L M, LU B L. Large brain model for learning generic representations with tremendous EEG data in BCI[EB/OL]. (2024-05-29)[2025-07-04]. http://arxiv.org/abs/2405.18765.
|
| 96 |
|
| 97 |
|
| 98 |
|
| 99 |
|
| 100 |
张丹, 李佳蔚. 探索思维的力量: 脑机接口研究现状与展望[J]. 科技导报, 2017, 35 (9): 62- 67.
|
| 101 |
|
| 102 |
|
| 103 |
|
| 104 |
柯晓宇. 情感脑机智能中的责任反思[N]. 社会科学报, 2025-04-10(6).
KE X Y. Reflections on responsibility in emotional brain-computer intelligence[N]. Social Sciences Weekly, 2025-04-10(6). (in Chinese)
|
| 105 |
|
/
| 〈 |
|
〉 |