17th December SSF - Dr. Linda Drijvers

Talk Title: Multimodal language processing in the brain

Abstract:

During communication in real-life settings, the brain integrates information from auditory (e.g., speech) and visual (e.g., gestures) signals to form a unified percept of our environment. In this talk, I will first focus briefly on previous work that investigated whether and how visual signals enhance speech comprehension in adverse listening conditions. I will then discuss our more recent work, where we used rapid invisible frequency tagging to generate steady-state evoked fields to study how visual and auditory signals interact in the brain. Finally, I will present some (preliminary) findings on multimodal language processing in interactive settings, including corpus-based work and experimental findings from dual-eeg.