A Naturalistic Multimodal Human Interaction Dataset: Annotated Visuo-Auditory Cue and Attention Data
This naturalistic multimodal dataset captures 27 everyday interaction scenarios with detailed visuo-spatial & auditory cue annotations and eye-tracking data, offering rich insights for research in human interaction, attention modeling, and cognitive media studies.
May 1, 2025
Modeling Visual Attention in Naturalistic Human Interactions
We explore how cues like gaze, speech, and motion guide visual attention in observing everyday interactions, revealing cross-modal patterns through eye-tracking data and structured event analysis.
January 30, 2025
The Observer Lens: Characterizing Visuospatial Features in Multimodal Interactions
This doctoral thesis examines how visuospatial features both low- (e.g., kinematics) and high-level (e.g., gaze, speech) shape perception and attention in human interactions, combining cognitive science and computational modeling to inform human-centric technologies.
May 24, 2024
Visual Attention Mapping
A multimodal analysis of visuo-auditory & spatial cues and their role in guiding human attention during real-world social interactions.
April 1, 2024
Attentional synchrony in films: A window to visuospatial characterization of events
This study analyzes how visuospatial features in film scenes shape attentional synchrony, using eye-tracking data to reveal how scene complexity guides visual attention during event perception.
September 22, 2022
Anticipatory Instances in Films: What Do They Tell Us About Event Understanding?
This study explores how visuospatial features in film scenes—like occlusion or movement—relate to anticipatory gaze and event segmentation, using eye-tracking data and multimodal analysis to uncover patterns in human event understanding.
June 1, 2022
Event Segmentation Through the Lens of Multimodal Interaction
This research develops a conceptual cognitive model to examine how multimodal cues—like gaze, motion, and speech—influence event segmentation and prediction in narrative media, using detailed scene analysis and eye-tracking data from naturalistic movie viewing.
September 17, 2021