| INFORMATIONENGINEERING |
|
|
|
|
|
ERP research on the emotional voice for different languages and non-speech utterances |
| CHANG Jiang1, ZHANG Xueying1, ZHANG Qiping1,2, CHEN Hongtao1, SUN Ying1, HU Fengyun3 |
1. College of Information Engineering, Taiyuan University of Technology, Taiyuan 030024, China;
2. Palmer School of Library and Information Science, Long Island University, New York 11548, USA;
3. Department of Neurology, Shanxi Provincial Hospital, Taiyuan 030024, China |
|
|
|
|
Abstract The event-related potential (ERP) is an effective method to study the brain mechanism of voice processing. This investigation studies how semantic understanding affects the emotional voice during speech and how speech influences the emotional voice for speech and non-speech utterances. In the tests, the audio signals are preprocessed using the endpoint detection technique to synchronize the ERP starting position with its corresponding signal content to enable superposition of the ERP waveforms. The ERP tests show that the negative waveform at around 200 ms in the temporal region may be associated with the prosody perception and the semantic understanding. In addition, the latency and amplitude results suggest that the brain is more sensitive to native emotional language than foreign emotional language and that the brain more quickly processes emotional non-speech utterances than emotional speech.
|
| Keywords
event-related potential
emotional speech utterance
emotional non-speech utterance
speech signal processing
|
|
|
|
Issue Date: 15 October 2016
|
|
|
[1] 孙颖, 姚慧, 张雪英, 等. 基于混沌特性的情感语音特征提取[J]. 天津大学学报: 自然科学与工程技术, 2015, 48(8): 681-685.SUN Ying, YAO Hui, ZHANG Xueying, et al. Feature extraction of emotional speech based on chaotic characteristics [J]. Journal of Tianjin University: Science and Technology, 2015, 48(8): 681-685. (in Chinese)
[2] Meng X, Yuan J, Li H. Automatic processing of valence differences in emotionally negative stimuli: Evidence from an ERP study [J]. Neuroscience Letters, 2009, 464(3): 228-232.
[3] Rohaut B, Faugeras F, Chausson N, et al. Probing ERP correlates of verbal semantic processing in patients with impaired consciousness [J]. Neuropsychologia, 2015, 66: 279-292.
[4] 曹晓华, 李超, 张焕婷, 等.字词认知N170成分及其发展[J]. 心理科学进展, 2013, 21(7): 1162-1172.CAO Xiaohua, LI Chao, ZHANG Huanting, et al. N170 component in words processing: The development and its mechanisms [J]. Advances in Psychological Science, 2013, 21(7): 1162-1172. (in Chinese)
[5] Rabovsky M, McRae K. Simulating the N400 ERP component as semantic network error: Insights from a feature-based connectionist attractor model of word meaning [J]. Cognition, 2014, 132(1): 68-89.
[6] Lepistö T, Kujala T, Vanhala R, et al. The discrimination of and orienting to speech and non-speech sounds in children with autism [J]. Brain Research, 2005, 1066(S1/2): 147-157.
[7] 席洁, 张林军, 张亚静, 等. 言语和非言语信号加工的早期分离: 来自 ERP 研究的证据[J]. 心理科学, 2010(2): 258-261.XI Jie, ZHANG Linjun, ZHANG Yajing, et al. The early dissociation of speech and nonspeech sounds: An ERP study [J]. Psychological Science, 2010(2): 258-261. (in Chinese)
[8] Schirmer A, Kotz S A. Beyond the right hemisphere: Brain mechanisms mediating vocal emotional processing [J]. Trends in Cognitive Sciences, 2006, 10(1): 24-30.
[9] Belin P, Fecteau S, Bedard C. Thinking the voice: Neural correlates of voice perception [J]. Trends in Cognitive Sciences, 2004, 8(3): 129-135.
[10] Paulmann S, Pell M D, Kotz S A. How aging affects the recognition of emotional speech [J]. Brain and Language, 2008, 104(3): 262-269.
[11] Paulmann S, Ott D V M, Kotz S A. Emotional speech perception unfolding in time: The role of the basal ganglia [J]. PLoS One, 2011, 6(3), e17694.
[12] Pinheiro A P, Vasconcelos M, Dias M, et al. The music of language: An ERP investigation of the effects of musical training on emotional prosody processing [J]. Brain and Language, 2015, 140: 24-34. |
|
Viewed |
|
|
|
Full text
|
|
|
|
|
Abstract
|
|
|
|
|
Cited |
|
|
|
|
| |
Shared |
|
|
|
|
| |
Discussed |
|
|
|
|
2016,
Vol. 56
