Geodesic
Using audio signal modification to validate the acoustic features relevance
Zapiski Nauchnykh Seminarov POMI, Investigations on applied mathematics and informatics. Part II–1, Tome 529 (2023), pp. 86-101 Cet article a éte moissonné depuis la source Math-Net.Ru

Voir la notice du chapitre de livre

In this work, we focus on experiments using modifications of prosodic parameters separately and in various combinations. For this purpose, original homonymous neutral and ironic utterances were modified to achieve the opposite effect, i.e. to get ironic utterances from neutral ones and vice versa. These original homonymous utterances were read by Russian native speakers in mini-texts and dialogues implying neutral or ironic meaning, then they were extracted from the context, any markers of ironic or non-ironic meaning were eliminated, then they were suggested to native listeners during the auditory perceptual experiments. The acoustic analysis was done for pairs of homonymous ironic and non-ironic utterances whose meaning was correctly recognized by the majority of listeners. The most salient acoustic features of ironic meaning were calculated. Then, modifications were done in the pairs of ironic and non-ironic utterances containing these features. In the three series of experiments, temporal, dynamic, and melodic parameters were modified using Wave Assistant and Praat software. The results of perceptual experiments with modified stimuli not only demonstrated the prevalence of the melodic pattern, but also revealed the complex of acoustic features of irony and indicated the challenges with modified ironic stimuli due to their spectral density. 
@article{ZNSL_2023_529_a6,
     author = {U. Kochetkova and P. Skrelin and V. Evdokimova and D. Novoselova},
     title = {Using audio signal modification to validate the acoustic features relevance},
     journal = {Zapiski Nauchnykh Seminarov POMI},
     pages = {86--101},
     year = {2023},
     volume = {529},
     language = {en},
     url = {http://geodesic.mathdoc.fr/item/ZNSL_2023_529_a6/}
}
TY  - JOUR
AU  - U. Kochetkova
AU  - P. Skrelin
AU  - V. Evdokimova
AU  - D. Novoselova
TI  - Using audio signal modification to validate the acoustic features relevance
JO  - Zapiski Nauchnykh Seminarov POMI
PY  - 2023
SP  - 86
EP  - 101
VL  - 529
UR  - http://geodesic.mathdoc.fr/item/ZNSL_2023_529_a6/
LA  - en
ID  - ZNSL_2023_529_a6
ER  - 
%0 Journal Article
%A U. Kochetkova
%A P. Skrelin
%A V. Evdokimova
%A D. Novoselova
%T Using audio signal modification to validate the acoustic features relevance
%J Zapiski Nauchnykh Seminarov POMI
%D 2023
%P 86-101
%V 529
%U http://geodesic.mathdoc.fr/item/ZNSL_2023_529_a6/
%G en
%F ZNSL_2023_529_a6
U. Kochetkova; P. Skrelin; V. Evdokimova; D. Novoselova. Using audio signal modification to validate the acoustic features relevance. Zapiski Nauchnykh Seminarov POMI, Investigations on applied mathematics and informatics. Part II–1, Tome 529 (2023), pp. 86-101. http://geodesic.mathdoc.fr/item/ZNSL_2023_529_a6/

[1] A. Abu-Shnein, “Acoustic prosodic features in sarcastic utterances”, J. Kufa Studies Center, 1:46 (2017)

[2] L. Anolli, M. Infantino, M. Ciceri, “From “blame by praise” to “praise by blame”: Analysis of vocal patterns in ironic communication”, Intern. J. Psychology - INT J PSYCHOL, 37 (2002), 266–276

[3] J. Barnes, S. Shattuck-Hufnagel, Prosodic theory and practice, MIT Press, 2022

[4] A. Braun, A. Schmiedel, “The phonetics of ambiguity: A study on verbal irony”, Cultures and Traditions of Wordplay and Wordplay Research, 10 2018, 111–136

[5] G. Bryant, “Prosodic contrasts in ironic speech”, Discourse Processes - DISCOURSE PROCESS, 47 (2010), 545–566

[6] G. Bryant, J. Fox Tree, Is there an ironic tone of voice?, Language and Speech, 48 (2005), 257–77

[7] G. Bryant, J. Fox Tree, Is there an ironic tone of voice?, Language and Speech, 48 (2005), 257–77

[8] M. Bulut, C. Busso, S. Yildirim, A. Kazemzadeh, C. Lee, S. Lee, S. Narayanan, “Investigating the role of phoneme-level modifications in emotional speech resynthesis”, Proc. Interspeech, 09 2005, 801–804

[9] M. Bulut, S. Lee, S. Narayanan, “Recognition for synthesis: Automatic parameter selection for resynthesis of emotional speech from neutral speech”, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing, 05 2008, 4629–4632

[10] F. Burkhardt, B. Weiss, F. Eyben, J. Deng, B. Schuller, “Detecting vocal irony”, GSCL 2017: Language Technologies for the Challenges of the Digital Age, 01 2018, 11–22

[11] H. Cheang, M. Pell, “Acoustic markers of sarcasm in cantonese and english”, The Journal of the Acoustical Society of America, 126 (2009), 1394–405

[12] A. Del Ré, F. Hirsch, C. Dodane, “L'ironie dans le discours : des premiéres productions enfantines aux productions des adultes”, Cahiers de praxématique, 2018

[13] J. L. Flanagan, Speech analysis, synthesis and perception, Springer, Berlin–Heidelberg, 1965

[14] S. González-Fuente, P. Prieto, I. Noveck, A fine-grained analysis of the acoustic cues involved in verbal irony recognition in French, 06 2016

[15] M. Igras-Cybulska, B. Ziolko, Acoustic correlates of ironic intonation, 01 2015

[16] U. Kochetkova, P. Skrelin, V. Evdokimova, D. Novoselova, “Perception of irony in speech”, Proceedings of the 4th International Conference on Neurobiology of Speech and Language (Saint-Petersburg, Russia), 2020, 72–73

[17] U. Kochetkova, P. Skrelin, V. Evdokimova, D. Novoselova, “The speech corpus for studying phonetic properties of irony”, Language, Music and Gesture: Informational Crossroads, LMGIC 2021, eds. Tatiana Chernigovskaya, Polina Eismont, and Tatiana Petrova, Springer Singapore, Singapore, 2021, 203–214

[18] H. Leykum, Acoustic characteristics of verbal irony in standard austrian german, 2019

[19] S. Li, W. Gu, Prosodic profiles of the mandarin speech conveying ironic compliment, 01 2021

[20] H. Loevenbruck, M. Jannet, M. D'Imperio, M. Spini, M. Champagne-Lavau, Prosodic cues of sarcastic speech in french: Slower, higher, wider, 08 2013

[21] A. Nauke, A. Braun, The production and perception of irony in short context-free utterances, 2023

[22] S. V. Rybin, Sintez rechi [speech synthesis], Saint Petersburg, Russia, 2014

[23] P. Skrelin, U. Kochetkova, V. Evdokimova, D. Novoselova, “Can we detect irony in speech using phonetic characteristics only? – looking for a methodology of analysis”, Speech and Computer, eds. Alexey Karpov and Rodmonga Potapova, Springer International Publishing, Cham, 2020, 544–553