Abstract Feng Feng 18 Oct 2017
Crossmodal correspondence is a perceptual feature which refers to the associated perceptual relationship between two or more sensory modalities. This phenomenon has long been investigated through behavioural and cognitive neuroscience studies and it has been confirmed that they can modulate perception, recognition, and processing in respect to our physical environment. However, most behavioural research on crossmodal perception is based on discrete and non-interactive signals, which may not be consistent in a different experimental paradigm or study environment.
Our research focus of crossmodal correspondence is on the behavioural research in human-computer interaction field. We hope to investigate the influence of crossmodal correspondence in an interactive environment, without specifying what response is expected and required.
In this seminar, I will talk about two user studies that we’ve conducted to investigate people’s information processing ability based on continuous and dynamically changing crossmodal stimuli in an interactive environment.