Gesture and voice in the perception of declarative and interrogative statements in Spanish
DOI
https://doi.org/10.25267/Pragmalinguistica.2017.i25.19Info
Authors
- Hernán Martínez (VE) Universidad de Los Andes
- Elsa Mora
Abstract
In the sound wave of declarative and interrogative sentences the acoustic distinction between these two types of statements is coded. We are going to focus on the fact of wanting to determine until what point hearers use visual information to establish the grammatical category of the statements they perceive. We consider that access to visual information during the perception of speech have influence on the result of the perception process. After the application of two tests (an auditory perception test and an audiovisual perception test) we affirm that the access to visual information during speech perception has influence on the result of these process.
Keywords
Downloads
Supporting Agencies
How to Cite
License
Copyright (c) 2018 Pragmalingüística
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
References
ASTRUC, LL. et al. (2010): “Venezuelan Andean Spanish Intonation”. Prieto, P. y Roseano, P. (eds.): Transcription of Intonation of the Spanish Language. München: Lincom Europa, pp. 191-226.
BERTELSON, P. et al. (2000): “The ventriloquist effect does not depend on the direction of deliberate visual attention”, Perception and Psychophysics, 62, pp. 321-332.
BORRÁS, J. et al. (2013): “Audiovisual correlates of interrogativity: A comparative analysis of Catalan and Dutch”, Journal Nonverbal Behavior, 38, pp. 53-66.
CAVE, CH. (2003): “Illusions auditives”, Dossier Pour la Science, 39, pp. 60-63.
CANGEMI, F. & D’IMPERIO, M. (2013): “Tempo and perception of sentence modality”, Journal of the Association for Laboratory Phonology, 4, 1, pp. 191-219.
COLLIGNON, O. et al. (2008): “Audiovisual integration of emotion expression”, Brain research,
, pp. 126-135.
CRESPO, V. et al. (2013): “Perceiving incredulity: The role of intonation and facial gestures”, Journal of pragmatics, 47, pp. 1-13.
DIJKSTRA, C. et al. (2006): “Manipulating uncertainty: The contribution of different audiovisual prosodic cues to the perception of confidence”, Proceedings of the 3rd International Conference on Speech Prosody, Desden. Publicación electrónica: http://arno.uvt.nl/show.cgi?fi d=95687.
DORTA, J. et al. (2013): “Comparación de la entonación canario-venezolana. La frecuencia fundamental (F0)”.
Dorta, J. (ed). Estudio comparativo preliminar de la entonación de Canarias, Cuba y Venezuela. Tenerife: La página, pp. 171-216.
ESTEVE-GIBERT, N. & PRIETO, P. (2013): “Prosodic structure shapes the temporal realization of intonation and manual gesture movements”, Journal of Speech, Language, and Hearing Research, 1, 56, pp. 850-864.
FROTA, S. et al. (2013): “Infants' perception of intonation: Is it a statement or a question?”, Infancy, 19, 2, pp. 194-213.
GUSSENHOVEN, C. & CHEN, A. (2000): “Universal and language-specific effects in the perception of question intonation”. Yuan, B. et al. (eds.) International Conference on the Processing of Spoken Language. pp. 91-94.
HIGUERA, L. (2013): Influencia de la información visual durante la percepción de frases interrogativas y declarativas del español venezolano. Memoria de grado. Mérida: Universidad de Los Andes.
JAEKL, P. et al. (2011): “Configural vs motion processing in audiovisual enhancement of speech”, Perception, 40, pp. 79-86.
LATINUS, M. et al. (2011): “Conjoint and independent neural coding of bimodal face/voice identity investigated with fMRI”. Perception, 40, pp. 139-146.
MACDONALD, I. & MCGURK, H. (1978): “Visual influences on speech perception process”, Perception & Psychophysics, 24, pp. 253-257.
MALTIN, M. & FOLEY, H. (1996): Sensación y percepción. México: Prentice Hall.
MARRERO, V. (2001): Fonética perceptiva, Madrid: Universidad Nacional de Educación a Distancia.
MARTÍNEZ, H. (2009): Evaluación de la percepción y producción del habla. Tesis doctoral. Mérida: Universidad de Los Andes.
MARTÍNEZ, H. et al. (2012): “Influencia de la información visual durante la percepción de la prosodia de las emociones actuadas”, Estudios de Fonética Experimental, XXI, pp.163-193.
MASSARO, D. (1987): Speech perception by ear and by eye, Hillsdale: Erlbaum.
MASSARO, D. & COHEN, M. (1983): “Integration of visual and auditory information in speech perception”, Journal of Experimental Psychology: Human Perception and Performance, 9, pp. 753-771.
MÉNDEZ, J. (2010): “Interacción de los parámetros acústicos duración y frecuencia fundamental en frases declarativas neutras e interrogativas absolutas de los andes venezolanos”, Estudios de Fonética experimental. XIX, pp.147-164.
MORA, E. et al. (2008): “Declarativas e interrogativas del español venezolano. Percepción de la emisión con y sin contenido léxico”, Language Design, 2, pp. 231238.
OUNI, S. et al. (2006): “Visual contribution to speech perception: Measuring the intelligibility of animated talking heads”, Journal on Audio, Speech, and Music Processing, 17, pp. 1-12.
PIETROSEMOLI, L. & MORA, E. (1998): “Synchronisation des mouvements des mains et de la ligne de fréquence fondamentale en espagnol parlé”, Actes du Congrès International Orage'98 ORAlité et Gestualité, Communication multimodale et interaction. París. pp. 555-559.
PRIETO, P. et al. (2013): “Prosody and gesture constrain the interpretation of double negation”, Lingua, 131, pp. 136-150.
ROBINSON, C. & SLOUTSKY, V. (2004): “Auditory dominance and its change in the course of development”, Child Development, 75, 5, pp. 1387-1401.
SEKIYAMA, K. et al. (2003): “Auditory-visual speech perception examined by fMRI and PET”, Neuroscience Research, 47, pp. 277-287.
SODERSTROM, M. et al. (2011): “It’s a question? Infants attend differently to yes/no questions and declaratives”, Infant Behavior and Development, 34, pp. 107110.
SOTO, M. (2000): Influencia de la percepción visual del rostro del hablante en la credibilidad de su voz. Tesis doctoral. Barcelona: Universitat Autònoma de Barcelona.
SRINIVASAN, R. & MASSARO, D. (2003): “Perceiving prosody from the face and voice. Distinguishing statements from echoic questions in English”, Language and Speech, 46, pp. 122.
SWERTS, M. Y KRAHMER, E. (2005): “Audiovisual prosody and feeling of knowing”, Journal of Memory and Language, 53, 1, pp. 81-94.
TUBAU, S. et al. (2014): “Prosody and gesture in the interpretation of yes-answers to negative yes/no-questions”, The Linguistic Review, 31, 4, pp. 781-808.
YANG, X. & LIANG, J. (2012): “Declarative and interrogative intonations by brain-damaged speakers of Uygur and Mandarin Chinese”. Ma, Q. et al. (eds.), Proceedings of the Sixth International Conference on Speech Prosody. Shanghai. pp. 701-704.
YENI-KOMSHIAN, G. (1999): “Percepción del habla”. Berko Gleason, J. y Bernstein, N. (eds.): Psicolingüística, Madrid: Mc Graw Hill.
YUAN, J. et al. (2002): “Comparison of declarative and interrogative intonation in Chinese”. Bel, B. y Marlien, I. (eds.), Proceedings of the First International Conference on Speech Prosody. Aix-en-Provence. pp. 711-714.