Role of visuoauditory cues in understanding events
September 30, 2022·
Vipul Nair
Abstract
The talk discussed several of our research that investigates how visuoauditory cues— such as gaze, speech, motion, hand action etc —guide visual attention during passive observation of everyday human interactions. Particular focus was given to using a structured event model and eye-tracking data from 90 participants across 27 acted interaction scenarios, we analyze how these cues individually and collectively influence where people look. The findings reveal strong intra- and cross-modal attentional effects, offering new insights into the dynamics of attention in real-world contexts. This framework provides a robust method for studying human attention vis-à-vis human interaction and has broad applications in human-centered design, cognitive modeling, and interactive systems.
Type
Publication
EU COST ACTION Training School on Multi3Generation: Multi-task, Multilingual, Multi-modal Language Generation. ASchloss Etelsen, Germany, Sept 26-30, 2022 (Training School Multi3Generation 2022)
