CogniMouse: On detecting users' task completion difficulty through computer mouse interaction

Abstract

This paper presents a method for analyzing users' computer mouse interaction data with the aim to implicitly identify task completion difficulty while interacting with a system. Computer mouse motion streams and users' skin conductance signals, acquired via an in-house developed computer mouse, and users' feedback were investigated as reactions to task difficulty raising events. A classification algorithm was developed, producing real-time user models of user hesitation states. Preliminary results of a study in progress with seven older adults at work (age 56+) provide initial indications about links between mouse triggering states of user hesitation and task completion difficulty. Copyright is held by the author/owner(s).