Referent: Prof. Dr. Andrew Duchowski (Clemson University, USA)
In this talk I will review gaze-based interaction, distinguishing eye movement analysis from synthesis in virtual reality and games for serious applications. My focus is on four forms of gaze-based interaction: diagnostic (off-line measurement), active (selection, look to shoot), passive (foveated rendering, a.k.a. gaze-contingent displays), and expressive (gaze synthesis). Diagnostic interaction is the bread and butter of serious applications such as training or assessment of expertise. Active interaction is rooted in the desire to use the eyes to point and click, with gaze gestures recently growing in popularity. Passive interaction is the manipulation of scene elements in response to gaze direction, with an example goal of improvement of frame rate. Expressive eye movement centers on synthesis, which involves the development of a procedural (stochastic) model of microsaccadic jitter, embedded within a directed gaze model, given goal-oriented tasks such as reading. In discussing each form of interaction, I will briefly review classic works and recent advancements and highlight outstanding research problems.