Multisensory integration of audiovisual information in avatar faces : an experimental investigation of McGurk effect

2023
journal article
conference proceedings
dc.abstract.enThe McGurk effect is a multisensory phenomenon, an audiovisual illusion that shows how speech sounds may interfere with the visual sense. In case of an incongruency between a speech sound and a human face articulating the speech sound, human interlocutors tend to perceive an audiovisual percept different from the sound percept and the visual percept. For example, if the speech sound is ba and the visual presentation of the articulation is fa, human interlocutors usually perceive a third sound, va. What can we learn about audiovisual integration using an avatar face? To what extent do we observe the McGurk effect? The present study reports an empirical investigation that tested the extent of the effect in an avatar face designed for the purpose of the study. Our findings suggest that systematic patterns may obtained from the analysis of a specific avatar face, designed for the purpose of the study. The results also reveal the potential use of avatar designs for evaluating the impact of avatar designs on human multisensory integration by employing human responses to audiovisual illusions on avatar faces.pl
dc.affiliationWydział Filozoficzny : Instytut Filozofiipl
dc.conference45th Annual Conference of the Cognitive Science Society (CogSci 2023)
dc.conference.citySydney
dc.conference.countryAustralia
dc.conference.datefinish2023-07-29
dc.conference.datestart2023-07-26
dc.conference.indexscopustrue
dc.conference.seriesAnnual Meeting of the Cognitive Science Society
dc.conference.seriesshortcutCogSci
dc.conference.seriesweblinkhttps://cognitivesciencesociety.org/cogsci-2023
dc.conference.shortcutCogSci 2023
dc.conference.weblinkhttps://cognitivesciencesociety.org/cogsci-2023
dc.contributor.authorAllahgholipour, Babakpl
dc.contributor.authorYaz, Furkanpl
dc.contributor.authorÖzkan, Ayşegül - 464547 pl
dc.contributor.authorAcartürk, Cengiz - 458441 pl
dc.date.accession2024-02-28pl
dc.date.accessioned2024-03-20T12:25:48Z
dc.date.available2024-03-20T12:25:48Z
dc.date.issued2023pl
dc.date.openaccess0
dc.description.accesstimew momencie opublikowania
dc.description.additionalBadania zostały dofinansowane w ramach grantu "Poznawcze aspekty interakcji i komunikacji w agentach naturalnych i sztucznych" z Priorytetowego Obszaru Badawczego DigiWorld w ramach Programu Strategicznego Inicjatywa Doskonałości Uniwersytetu Jagiellońskiego w Krakowiepl
dc.description.conftypeinternationalpl
dc.description.physical3137-3143pl
dc.description.versionostateczna wersja wydawcy
dc.description.volume45pl
dc.identifier.eissn1069-7977pl
dc.identifier.urihttps://ruj.uj.edu.pl/xmlui/handle/item/328156
dc.identifier.weblinkhttps://escholarship.org/uc/item/1mq2z9mppl
dc.languageengpl
dc.language.containerengpl
dc.rightsDodaję tylko opis bibliograficzny*
dc.rights.licenceCC-BY
dc.rights.uri*
dc.share.typeotwarte czasopismo
dc.subject.enmultisensory integrationpl
dc.subject.enMcGurk effectpl
dc.subject.enavatar facepl
dc.subject.enface processingpl
dc.subtypeConferenceProceedingspl
dc.titleMultisensory integration of audiovisual information in avatar faces : an experimental investigation of McGurk effectpl
dc.title.journalProceedings of the Annual Meeting of the Cognitive Science Societypl
dc.typeJournalArticlepl
dspace.entity.typePublication
dc.abstract.enpl
The McGurk effect is a multisensory phenomenon, an audiovisual illusion that shows how speech sounds may interfere with the visual sense. In case of an incongruency between a speech sound and a human face articulating the speech sound, human interlocutors tend to perceive an audiovisual percept different from the sound percept and the visual percept. For example, if the speech sound is ba and the visual presentation of the articulation is fa, human interlocutors usually perceive a third sound, va. What can we learn about audiovisual integration using an avatar face? To what extent do we observe the McGurk effect? The present study reports an empirical investigation that tested the extent of the effect in an avatar face designed for the purpose of the study. Our findings suggest that systematic patterns may obtained from the analysis of a specific avatar face, designed for the purpose of the study. The results also reveal the potential use of avatar designs for evaluating the impact of avatar designs on human multisensory integration by employing human responses to audiovisual illusions on avatar faces.
dc.affiliationpl
Wydział Filozoficzny : Instytut Filozofii
dc.conference
45th Annual Conference of the Cognitive Science Society (CogSci 2023)
dc.conference.city
Sydney
dc.conference.country
Australia
dc.conference.datefinish
2023-07-29
dc.conference.datestart
2023-07-26
dc.conference.indexscopus
true
dc.conference.series
Annual Meeting of the Cognitive Science Society
dc.conference.seriesshortcut
CogSci
dc.conference.seriesweblink
https://cognitivesciencesociety.org/cogsci-2023
dc.conference.shortcut
CogSci 2023
dc.conference.weblink
https://cognitivesciencesociety.org/cogsci-2023
dc.contributor.authorpl
Allahgholipour, Babak
dc.contributor.authorpl
Yaz, Furkan
dc.contributor.authorpl
Özkan, Ayşegül - 464547
dc.contributor.authorpl
Acartürk, Cengiz - 458441
dc.date.accessionpl
2024-02-28
dc.date.accessioned
2024-03-20T12:25:48Z
dc.date.available
2024-03-20T12:25:48Z
dc.date.issuedpl
2023
dc.date.openaccess
0
dc.description.accesstime
w momencie opublikowania
dc.description.additionalpl
Badania zostały dofinansowane w ramach grantu "Poznawcze aspekty interakcji i komunikacji w agentach naturalnych i sztucznych" z Priorytetowego Obszaru Badawczego DigiWorld w ramach Programu Strategicznego Inicjatywa Doskonałości Uniwersytetu Jagiellońskiego w Krakowie
dc.description.conftypepl
international
dc.description.physicalpl
3137-3143
dc.description.version
ostateczna wersja wydawcy
dc.description.volumepl
45
dc.identifier.eissnpl
1069-7977
dc.identifier.uri
https://ruj.uj.edu.pl/xmlui/handle/item/328156
dc.identifier.weblinkpl
https://escholarship.org/uc/item/1mq2z9mp
dc.languagepl
eng
dc.language.containerpl
eng
dc.rights*
Dodaję tylko opis bibliograficzny
dc.rights.licence
CC-BY
dc.rights.uri*
dc.share.type
otwarte czasopismo
dc.subject.enpl
multisensory integration
dc.subject.enpl
McGurk effect
dc.subject.enpl
avatar face
dc.subject.enpl
face processing
dc.subtypepl
ConferenceProceedings
dc.titlepl
Multisensory integration of audiovisual information in avatar faces : an experimental investigation of McGurk effect
dc.title.journalpl
Proceedings of the Annual Meeting of the Cognitive Science Society
dc.typepl
JournalArticle
dspace.entity.type
Publication
Affiliations

* The migration of download and view statistics prior to the date of April 8, 2024 is in progress.

Views
27
Views per month
Views per city
Krakow
8
Warsaw
2
Istanbul
1
Krzeszowice
1
Lille
1
Sosnowiec
1

No access

No Thumbnail Available