Beauchamp:McGurkStimuli: Difference between revisions

From OpenWetWare
Jump to navigationJump to search
No edit summary
(15 intermediate revisions by 2 users not shown)
Line 3: Line 3:
<div style="padding: 8px; color: #000000; background-color: #ffffff; width: 730px; border: 2px solid #666666;">
<div style="padding: 8px; color: #000000; background-color: #ffffff; width: 730px; border: 2px solid #666666;">


==Notes on the McGurk Stimuli==
==Audiovisual Speech Stimuli==
<b>[[Media:McGurkAndControlStimuli.zip|Archive of many different McGurk and control stimuli]]</b>


The McGurk-MacDonald effect is an audiovisual illusion. Here are some audiovisual files that can be used to demonstrate the effect. McGurk stimuli consist of an auditory syllable and an incongruent visual syllable that produce the percept of a different syllable (e.g. auditory "ba" + visual "ga" perceived as "da"). Other incongruent stimuli (e.g. auditory "ga" + visual "ba") do not produce the effect. Here is an archive of some the stimuli used in our publications, referenced in [[Beauchamp:Publications]].
The McGurk-MacDonald effect is an audiovisual illusion. McGurk stimuli consist of an auditory syllable and an incongruent visual syllable that produce the percept of a different syllable (e.g. auditory "ba" + visual "ga" perceived as "da"). Other incongruent stimuli (e.g. auditory "ga" + visual "ba") do not produce the effect. The archive contains movies that demonstrate the effect.  If you use the stimuli in a scientific publication, please cite the appropriate reference in [[Beauchamp:Publications]]. Note that some of the videos in the archive require a particular video codec that is freely available in the VLC player, available from http://www.videolan.org/vlc/
[[]]
[[Media:McGurkAndControlStimuli.zip|McGurk and Other Stimuli Archive|]]


Note that some of these files require a particular video CODEC, the VLC player, available from
To see the stimuli without downloading the archive, you may view them on YouTube
http://www.videolan.org/vlc/
#Auditory "ba" + Visual "ga" --> AV "da"  http://www.youtube.com/watch?v=WK3T7LWIkP8
#Auditory "pa" + Visual "ka" --> AV "ta" http://www.youtube.com/watch?v=An5vvn-gcwA


To see the stimuli on any platform, you may view them on YouTube
See also
McGurk stimulus: Auditory "ba" + Visual "ga" --> AV "da"
[[Beauchamp:Stimuli]] for other McGurk YouTube examples.
http://www.youtube.com/watch?v=WK3T7LWIkP8
 
==Single-syllable audiovisual words==
Please cite
# Nath, AR and Beauchamp, MS. A Neural Basis for Interindividual Differences in the McGurk Effect, a Multisensory Speech Illusion. Neuroimage. 2012 59:781-787.
# Nath, AR, Fava EE and Beauchamp, MS. Neural Correlates of Interindividual Differences in Children's Audiovisual Speech Perception. Journal of Neuroscience. 2011 Sept 28;31(39)13963-13971.


McGurk stimulus: Auditory "pa" + Visual "ka" --> AV "ta"
The following is from the methods section of Nath and Beauchamp (2012):
http://www.youtube.com/watch?v=An5vvn-gcwA


Word stimuli for the localizer were selected from two hundred single-syllable words from the MRC Psycholinguistic Database with Brown verbal frequency of 20 to 200, imageability rating greater than 100, age of acquisition less than 7 years and Kucera-Francis written
frequency greater than 80 (Wilson, M., 1988. The MRC Psycholinguistic Database: Machine Readable Dictionary, Version 2. Behav. Res. Methods Instrum. Comput. 20, 6–11.). The duration of the words ranged from 0.5 to 0.7 seconds. The total length of each video clip
ranged from 1.1 to 1.8 seconds in order to start and end each video with the speaker in a neutral, mouth-closed position and to include all mouth movements from mouth opening to closing.


See also
Here is a link to a ZIP file containing all of the words. Please contact MSB if the link is broken.
[[Beauchamp:Stimuli]] for other McGurk YouTube examples.
https://dl.dropboxusercontent.com/u/70081110/MRC_Words_1_syl_words.zip
 
==Unisensory Stimuli==
===Auditory stimuli===
The stimuli were presented with a grey background on the monitor. If you would like to use any of the following stimuli please cite as: Basu Mallick, D., Magnotti, J.F. & Beauchamp, M.S. (2013). Wide variability in McGurk perception across stimuli. Manuscript in preparation.
==== Male Speaker====
* [http://openwetware.org/wiki/Image:John_ba_aonly.wav /ba/]
* [http://openwetware.org/wiki/Image:John_pa_aonly.wav /pa/]
* [http://openwetware.org/wiki/Image:John_baba_aonly.wav /baba/]
* [http://openwetware.org/wiki/Image:John_papa_aonly.wav /papa/]
 
==== Female Speaker====
* [http://openwetware.org/wiki/Image:Sarah_ba_aonly.wav /ba/]
* [http://openwetware.org/wiki/Image:Sarah_pa_aonly.wav /pa/]
* [http://openwetware.org/wiki/Image:Sarah_baba_aonly.wav /baba/]
* [http://openwetware.org/wiki/Image:Sarah_papa_aonly.wav /papa/]

Revision as of 13:18, 24 September 2014

Brain picture
Beauchamp Lab




Audiovisual Speech Stimuli

Archive of many different McGurk and control stimuli

The McGurk-MacDonald effect is an audiovisual illusion. McGurk stimuli consist of an auditory syllable and an incongruent visual syllable that produce the percept of a different syllable (e.g. auditory "ba" + visual "ga" perceived as "da"). Other incongruent stimuli (e.g. auditory "ga" + visual "ba") do not produce the effect. The archive contains movies that demonstrate the effect. If you use the stimuli in a scientific publication, please cite the appropriate reference in Beauchamp:Publications. Note that some of the videos in the archive require a particular video codec that is freely available in the VLC player, available from http://www.videolan.org/vlc/

To see the stimuli without downloading the archive, you may view them on YouTube

  1. Auditory "ba" + Visual "ga" --> AV "da" http://www.youtube.com/watch?v=WK3T7LWIkP8
  2. Auditory "pa" + Visual "ka" --> AV "ta" http://www.youtube.com/watch?v=An5vvn-gcwA

See also Beauchamp:Stimuli for other McGurk YouTube examples.

Single-syllable audiovisual words

Please cite

  1. Nath, AR and Beauchamp, MS. A Neural Basis for Interindividual Differences in the McGurk Effect, a Multisensory Speech Illusion. Neuroimage. 2012 59:781-787.
  2. Nath, AR, Fava EE and Beauchamp, MS. Neural Correlates of Interindividual Differences in Children's Audiovisual Speech Perception. Journal of Neuroscience. 2011 Sept 28;31(39)13963-13971.

The following is from the methods section of Nath and Beauchamp (2012):

Word stimuli for the localizer were selected from two hundred single-syllable words from the MRC Psycholinguistic Database with Brown verbal frequency of 20 to 200, imageability rating greater than 100, age of acquisition less than 7 years and Kucera-Francis written frequency greater than 80 (Wilson, M., 1988. The MRC Psycholinguistic Database: Machine Readable Dictionary, Version 2. Behav. Res. Methods Instrum. Comput. 20, 6–11.). The duration of the words ranged from 0.5 to 0.7 seconds. The total length of each video clip ranged from 1.1 to 1.8 seconds in order to start and end each video with the speaker in a neutral, mouth-closed position and to include all mouth movements from mouth opening to closing.

Here is a link to a ZIP file containing all of the words. Please contact MSB if the link is broken. https://dl.dropboxusercontent.com/u/70081110/MRC_Words_1_syl_words.zip

Unisensory Stimuli

Auditory stimuli

The stimuli were presented with a grey background on the monitor. If you would like to use any of the following stimuli please cite as: Basu Mallick, D., Magnotti, J.F. & Beauchamp, M.S. (2013). Wide variability in McGurk perception across stimuli. Manuscript in preparation.

Male Speaker

Female Speaker