Sensitive systems Incorporating affect recognition into Computer based learning

Abstract

Advances in video and audio feature extraction methodology combined with adaptive processing techniques using pattern analysis models have profound implications for incorporating affect recognition into future tutoring agents. This report gives an overview of current affect recognition methodologies and the type of features that can be extracted from digital signals in the form of movement and sound analysis. There is some discussion of translating features into a set of observable human sentic data, which can be in turn ‘fuzzy-mapped’ to internal affective states. Issues concerning the digital representation and the resolution granularity of affective states are discussed. The final discussion concerns issues of implementing affect recognition methodology into tutoring agents.