Abstract Harry Witchel 25 Oct 2017
Eliciting and recognising complex emotional and cognitive states, and allowing digital systems to respond to them, will be useful for eLearning, human factors (including vigilance), and responsive systems including human-robot interaction. This talk will present our recent work towards the elicitation and recognition of embodied conscious or subconscious responses. Engineering and psychological solutions to non-invasively determine such mental states and complex emotions may detect movements, postures, facial expressions, physiology, and sounds. Furthermore, our team has shown that what people suppress is as revealing as what they do. Our stimuli include reading, music listening, movie watching, game playing, and quiz-taking. The mental states of engagement, boredom, frustration and mind wandering are considered in relation to fidgeting and to Non-Instrumental Movement Inhibition (NIMI), in order to clarify fundamental research problems and direct research design toward improved solutions.