Please wait a minute...
 首页  期刊介绍 期刊订阅 联系我们 横山亮次奖 百年刊庆
 
最新录用  |  预出版  |  当期目录  |  过刊浏览  |  阅读排行  |  下载排行  |  引用排行  |  横山亮次奖  |  百年刊庆
清华大学学报(自然科学版)  2016, Vol. 56 Issue (10): 1131-1136    DOI: 10.16511/j.cnki.qhdxxb.2016.22.050
  信息工程 本期目录 | 过刊浏览 | 高级检索 |
不同语种及非言语情感声音的ERP研究
畅江1, 张雪英1, 张奇萍1,2, 陈宏涛1, 孙颖1, 胡凤云3
1. 太原理工大学 信息工程学院, 太原 030024, 中国;
2. 长岛大学 帕默图书馆和信息科学学院, 纽约 11548, 美国;
3. 山西省人民医院 神经内科, 太原 030024
ERP research on the emotional voice for different languages and non-speech utterances
CHANG Jiang1, ZHANG Xueying1, ZHANG Qiping1,2, CHEN Hongtao1, SUN Ying1, HU Fengyun3
1. College of Information Engineering, Taiyuan University of Technology, Taiyuan 030024, China;
2. Palmer School of Library and Information Science, Long Island University, New York 11548, USA;
3. Department of Neurology, Shanxi Provincial Hospital, Taiyuan 030024, China
全文: PDF(1220 KB)  
输出: BibTeX | EndNote (RIS)      
摘要 事件相关电位(ERP)技术是一种研究人脑对声音运行机制的有效方法。该文从语言种类出发,研究语义理解程度在情感语音感知中是否存在显著性影响;从言语和非言语角度出发,研究言语是否对情感声音感知存在影响。实验中,首先采用端点检测法对声音信号进行预处理,使它的起始位置和内容在时间进程上基本一致,便于ERP波形的叠加;再根据实验设计进行ERP实验。实验结果发现:在ERP波形距离起始点200 ms左右出现在颞区的负走向波形可能与韵律感知和语义理解相关。根据该波形的潜伏期及波幅推测,人脑对熟悉的情感语音更具有敏感性,且对非言语情感声音处理的时间进程相对较快。
服务
把本文推荐给朋友
加入引用管理器
E-mail Alert
RSS
作者相关文章
畅江
张雪英
张奇萍
陈宏涛
孙颖
胡凤云
关键词 事件相关电位情感语音非言语情感声音语音信号处理    
Abstract:The event-related potential (ERP) is an effective method to study the brain mechanism of voice processing. This investigation studies how semantic understanding affects the emotional voice during speech and how speech influences the emotional voice for speech and non-speech utterances. In the tests, the audio signals are preprocessed using the endpoint detection technique to synchronize the ERP starting position with its corresponding signal content to enable superposition of the ERP waveforms. The ERP tests show that the negative waveform at around 200 ms in the temporal region may be associated with the prosody perception and the semantic understanding. In addition, the latency and amplitude results suggest that the brain is more sensitive to native emotional language than foreign emotional language and that the brain more quickly processes emotional non-speech utterances than emotional speech.
Key wordsevent-related potential    emotional speech utterance    emotional non-speech utterance    speech signal processing
收稿日期: 2016-06-20      出版日期: 2016-10-15
ZTFLH:  Q189  
通讯作者: 张雪英,教授,E-mail:tyzhangxy@163.com     E-mail: tyzhangxy@163.com
引用本文:   
畅江, 张雪英, 张奇萍, 陈宏涛, 孙颖, 胡凤云. 不同语种及非言语情感声音的ERP研究[J]. 清华大学学报(自然科学版), 2016, 56(10): 1131-1136.
CHANG Jiang, ZHANG Xueying, ZHANG Qiping, CHEN Hongtao, SUN Ying, HU Fengyun. ERP research on the emotional voice for different languages and non-speech utterances. Journal of Tsinghua University(Science and Technology), 2016, 56(10): 1131-1136.
链接本文:  
http://jst.tsinghuajournals.com/CN/10.16511/j.cnki.qhdxxb.2016.22.050  或          http://jst.tsinghuajournals.com/CN/Y2016/V56/I10/1131
  表1 实验所需的刺激材料说明
  图 未经声音预处理所得到的ERP波形(TP7)
  图 经过声音预处理后得到的ERP波形(TP7)
  图 实验程序流程
  图 实验指导语
  图 言语悲伤情感与非言语负性情感的ERP波形
  图6 言语高兴情感与非言语正性情感的ERP波形
  表 不同情感语音库的波形成分的峰值方差分析
  表 TYUT2.0和TYUT2.1中的负性情感ERP波形成分比较
  表 TYUT2.0和TYUT2.1中的正性情感ERP波形成分比较
  表 EMO-DB和TYUT2.1中的负性情感ERP波形成分比较
  表6 EMO-DB和TYUT2.1中的正性情感ERP波形成分比较
[1] 孙颖, 姚慧, 张雪英, 等. 基于混沌特性的情感语音特征提取[J]. 天津大学学报: 自然科学与工程技术, 2015, 48(8): 681-685.SUN Ying, YAO Hui, ZHANG Xueying, et al. Feature extraction of emotional speech based on chaotic characteristics [J]. Journal of Tianjin University: Science and Technology, 2015, 48(8): 681-685. (in Chinese)
[2] Meng X, Yuan J, Li H. Automatic processing of valence differences in emotionally negative stimuli: Evidence from an ERP study [J]. Neuroscience Letters, 2009, 464(3): 228-232.
[3] Rohaut B, Faugeras F, Chausson N, et al. Probing ERP correlates of verbal semantic processing in patients with impaired consciousness [J]. Neuropsychologia, 2015, 66: 279-292.
[4] 曹晓华, 李超, 张焕婷, 等.字词认知N170成分及其发展[J]. 心理科学进展, 2013, 21(7): 1162-1172.CAO Xiaohua, LI Chao, ZHANG Huanting, et al. N170 component in words processing: The development and its mechanisms [J]. Advances in Psychological Science, 2013, 21(7): 1162-1172. (in Chinese)
[5] Rabovsky M, McRae K. Simulating the N400 ERP component as semantic network error: Insights from a feature-based connectionist attractor model of word meaning [J]. Cognition, 2014, 132(1): 68-89.
[6] Lepistö T, Kujala T, Vanhala R, et al. The discrimination of and orienting to speech and non-speech sounds in children with autism [J]. Brain Research, 2005, 1066(S1/2): 147-157.
[7] 席洁, 张林军, 张亚静, 等. 言语和非言语信号加工的早期分离: 来自 ERP 研究的证据[J]. 心理科学, 2010(2): 258-261.XI Jie, ZHANG Linjun, ZHANG Yajing, et al. The early dissociation of speech and nonspeech sounds: An ERP study [J]. Psychological Science, 2010(2): 258-261. (in Chinese)
[8] Schirmer A, Kotz S A. Beyond the right hemisphere: Brain mechanisms mediating vocal emotional processing [J]. Trends in Cognitive Sciences, 2006, 10(1): 24-30.
[9] Belin P, Fecteau S, Bedard C. Thinking the voice: Neural correlates of voice perception [J]. Trends in Cognitive Sciences, 2004, 8(3): 129-135.
[10] Paulmann S, Pell M D, Kotz S A. How aging affects the recognition of emotional speech [J]. Brain and Language, 2008, 104(3): 262-269.
[11] Paulmann S, Ott D V M, Kotz S A. Emotional speech perception unfolding in time: The role of the basal ganglia [J]. PLoS One, 2011, 6(3), e17694.
[12] Pinheiro A P, Vasconcelos M, Dias M, et al. The music of language: An ERP investigation of the effects of musical training on emotional prosody processing [J]. Brain and Language, 2015, 140: 24-34.
[1] 张健, 徐杰, 包秀国, 周若华, 颜永红. 应用于语种识别的加权音素对数似然比特征[J]. 清华大学学报(自然科学版), 2017, 57(10): 1038-1041,1047.
[2] 陈萧, 徐波. 改进的用于口语处理的基频提取算法[J]. 清华大学学报(自然科学版), 2017, 57(1): 95-99.
[3] 孔江平, 林悠然. “发嗲”的情感语音基频特征分析[J]. 清华大学学报(自然科学版), 2016, 56(11): 1149-1153.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
版权所有 © 《清华大学学报(自然科学版)》编辑部
本系统由北京玛格泰克科技发展有限公司设计开发 技术支持:support@magtech.com.cn