不同语种及非言语情感声音的ERP研究

畅江; 张雪英; 张奇萍; 陈宏涛; 孙颖; 胡凤云

doi:10.16511/j.cnki.qhdxxb.2016.22.050

PDF(1220 KB)

清华大学学报（自然科学版） ›› 2016, Vol. 56 ›› Issue (10) : 1131-1136. DOI: 10.16511/j.cnki.qhdxxb.2016.22.050

信息工程

不同语种及非言语情感声音的ERP研究

畅江¹, 张雪英¹, 张奇萍^1,2, 陈宏涛¹, 孙颖¹, 胡凤云³

作者信息 +

ERP research on the emotional voice for different languages and non-speech utterances

CHANG Jiang¹, ZHANG Xueying¹, ZHANG Qiping^1,2, CHEN Hongtao¹, SUN Ying¹, HU Fengyun³

Author information +

文章历史 +

摘要

事件相关电位（ERP）技术是一种研究人脑对声音运行机制的有效方法。该文从语言种类出发，研究语义理解程度在情感语音感知中是否存在显著性影响；从言语和非言语角度出发，研究言语是否对情感声音感知存在影响。实验中，首先采用端点检测法对声音信号进行预处理，使它的起始位置和内容在时间进程上基本一致，便于ERP波形的叠加；再根据实验设计进行ERP实验。实验结果发现：在ERP波形距离起始点200 ms左右出现在颞区的负走向波形可能与韵律感知和语义理解相关。根据该波形的潜伏期及波幅推测，人脑对熟悉的情感语音更具有敏感性，且对非言语情感声音处理的时间进程相对较快。

Abstract

The event-related potential (ERP) is an effective method to study the brain mechanism of voice processing. This investigation studies how semantic understanding affects the emotional voice during speech and how speech influences the emotional voice for speech and non-speech utterances. In the tests, the audio signals are preprocessed using the endpoint detection technique to synchronize the ERP starting position with its corresponding signal content to enable superposition of the ERP waveforms. The ERP tests show that the negative waveform at around 200 ms in the temporal region may be associated with the prosody perception and the semantic understanding. In addition, the latency and amplitude results suggest that the brain is more sensitive to native emotional language than foreign emotional language and that the brain more quickly processes emotional non-speech utterances than emotional speech.

关键词

事件相关电位 / 情感语音 / 非言语情感声音 / 语音信号处理

Key words

引用本文

EndNote

Ris (Procite)

Bibtex

导出引用

畅江, 张雪英, 张奇萍, 陈宏涛, 孙颖, 胡凤云. 不同语种及非言语情感声音的ERP研究[J]. 清华大学学报（自然科学版）. 2016, 56(10): 1131-1136 https://doi.org/10.16511/j.cnki.qhdxxb.2016.22.050

CHANG Jiang, ZHANG Xueying, ZHANG Qiping, CHEN Hongtao, SUN Ying, HU Fengyun. ERP research on the emotional voice for different languages and non-speech utterances[J]. Journal of Tsinghua University(Science and Technology). 2016, 56(10): 1131-1136 https://doi.org/10.16511/j.cnki.qhdxxb.2016.22.050

中图分类号： Q189

参考文献

[1] 孙颖, 姚慧, 张雪英, 等. 基于混沌特性的情感语音特征提取[J]. 天津大学学报: 自然科学与工程技术, 2015, 48(8): 681-685.SUN Ying, YAO Hui, ZHANG Xueying, et al. Feature extraction of emotional speech based on chaotic characteristics [J]. Journal of Tianjin University: Science and Technology, 2015, 48(8): 681-685. (in Chinese)
[2] Meng X, Yuan J, Li H. Automatic processing of valence differences in emotionally negative stimuli: Evidence from an ERP study [J]. Neuroscience Letters, 2009, 464(3): 228-232.
[3] Rohaut B, Faugeras F, Chausson N, et al. Probing ERP correlates of verbal semantic processing in patients with impaired consciousness [J]. Neuropsychologia, 2015, 66: 279-292.
[4] 曹晓华, 李超, 张焕婷, 等.字词认知N170成分及其发展[J]. 心理科学进展, 2013, 21(7): 1162-1172.CAO Xiaohua, LI Chao, ZHANG Huanting, et al. N170 component in words processing: The development and its mechanisms [J]. Advances in Psychological Science, 2013, 21(7): 1162-1172. (in Chinese)
[5] Rabovsky M, McRae K. Simulating the N400 ERP component as semantic network error: Insights from a feature-based connectionist attractor model of word meaning [J]. Cognition, 2014, 132(1): 68-89.
[6] Lepistö T, Kujala T, Vanhala R, et al. The discrimination of and orienting to speech and non-speech sounds in children with autism [J]. Brain Research, 2005, 1066(S1/2): 147-157.
[7] 席洁, 张林军, 张亚静, 等. 言语和非言语信号加工的早期分离: 来自 ERP 研究的证据[J]. 心理科学, 2010(2): 258-261.XI Jie, ZHANG Linjun, ZHANG Yajing, et al. The early dissociation of speech and nonspeech sounds: An ERP study [J]. Psychological Science, 2010(2): 258-261. (in Chinese)
[8] Schirmer A, Kotz S A. Beyond the right hemisphere: Brain mechanisms mediating vocal emotional processing [J]. Trends in Cognitive Sciences, 2006, 10(1): 24-30.
[9] Belin P, Fecteau S, Bedard C. Thinking the voice: Neural correlates of voice perception [J]. Trends in Cognitive Sciences, 2004, 8(3): 129-135.
[10] Paulmann S, Pell M D, Kotz S A. How aging affects the recognition of emotional speech [J]. Brain and Language, 2008, 104(3): 262-269.
[11] Paulmann S, Ott D V M, Kotz S A. Emotional speech perception unfolding in time: The role of the basal ganglia [J]. PLoS One, 2011, 6(3), e17694.
[12] Pinheiro A P, Vasconcelos M, Dias M, et al. The music of language: An ERP investigation of the effects of musical training on emotional prosody processing [J]. Brain and Language, 2015, 140: 24-34.

PDF(1220 KB)

Accesses

Citation

Detail

段落导航

收稿日期	出版日期
2016-06-20	2016-10-15
发布日期
2016-10-15

选择文件类型/文献管理软件名称

选择包含的内容

摘要

Abstract

关键词

Key words

引用本文

{{custom_sec.title}}

{{custom_sec.title}}

参考文献

访问统计

模态框（Modal）标题

选择文件类型/文献管理软件名称

选择包含的内容

摘要

Abstract

关键词

Key words

引用本文

{{custom_sec.title}}

{{custom_sec.title}}

参考文献

访问统计