Non-verbal human behaviour for human-centred computing

The wearable and ubiquitous computing revolution is vastly increasing our capabilities to sense, model, and thereby better understand everyday human behaviour. Machine understanding of human behaviour is key to realise the vision of human-centred computing, i.e. the development of intelligent user interfaces that offer human-like perceptual, interactive, and social capabilities. While research on social signal processing typically focuses on facial expressions and vocal behaviour, I envision a new generation of human-machine interfaces to also exploit users' visual (gaze) and physical behaviour (body language). Both of these non-verbal behavioural cues are particularly promising given their fundamental importance in human-human interactions and the variety of information they convey about users, whether their context, activities, emotions or – in case of gaze – cognition, attention, and personality. In my talk I will provide an overview and showcase selected examples of our past and ongoing research efforts towards this vision. The first line of work is concerned with everyday human behaviour sensing, i.e. the development of computational methods to sense visual and physical human behaviour in daily-life settings. This includes computer vision methods for ambient sensing as well as methods for on-body sensing, for example using head-mounted eye trackers. The second line of work focuses on computational human behaviour analysis, i.e. the development of signal processing and machine learning methods to model and analyse non-verbal visual and physical human behaviour - including long-term monitoring in daily life. The third line of work is concerned with the development of novel humancomputer interfaces that leverage non-verbal behaviour to enable natural, spontaneous, and seamless interactions with ubiquitous digital media using gaze and body input, as well as new applications in usable security and privacy.
Andreas Bulling is head of the Perceptual User Interfaces Group at the Max Planck Institute for Informatics and the Cluster of Excellence on Multimodal Computing and Interaction (MMCI) at Saarland University. He received his MSc. (Dipl.-Inform.) in Computer Science from the Technical University of Karlsruhe, Germany, and a PhD in Information Technology and Electrical Engineering from the Swiss Federal Institute of Technology (ETH) Zurich, Switzerland. Dr. Bulling was previously a Feodor Lynen Research Fellow and a Marie Curie Research Fellow in the Computer Laboratory at the University of Cambridge, UK, and a postdoctoral research associate in the School of Computing and
Communications at Lancaster University, UK. He is principal investigator at the Intel Visual Computing Institute and serves on the editorial boards of the ACM Transactions on Interactive Intelligent Systems and the Journal of Eye Movement Research. He also served as co-chair, TPC member, and reviewer for major conferences, most recently as TPC co-chair for UbiComp 2016 and PerCom 2015 as well as associate chair for ETRA 2016, CHI 2014, CHI 2013.

Es laden ein die Projektleiter des Sonderforschungsbereich / Transregio 62.



Herr Dr. Andreas Bulling
Max-Planck-Institut für Informatik


Montag, 24. Oktober 2016, 16 Uhr c.t.


Universität Ulm, O28, Raum 1002 (Videoübertragung zur Otto-von-Guericke-Universität Magdeburg, Raum G26.1-010)