Mark Colley, M.Sc.

Mark Colley joined the HCI group in April 2019 as a research associate and doctoral candidate. Prior to that, he worked as a software engineer at Airbus since 2015.

Mark holds an M. Sc. in Computer Science (2018) from the University of Ulm. The title of the master thesis was: Identification, Investigation and Classification of Use Cases for Cooperation in Highly Autonomous Driving and the Applicability thereof. This was done within the project KoFFI - Kooperative Fahrer-Fahrzeug-Interaktion.

Mark received his B. Eng. in Information Technology in 2015 at the Duale Hochschule Baden-Württemberg Ravensburg/Friedrichshafen in cooperation with Airbus.

Research interests

  • Autonomous Driving
  • Driver-Vehicle Interaction
  • Augmented Reality
  • Virtual Reality
  • Mobile Devices
  • Head Mounted Displays

Projects

  • Intuitiver

    As part of the "Smart Mobility" research funding program of the state of Baden-Württemberg, the "Intuitiver" project for interaction between automated vehicles and easily vulnerable road users will start in November 2018. The project focuses on how autonomous vehicles and pedestrians can recognize each other's intentions, for example when crossing the road, and how autonomous vehicles inform occupants of their intentions. Prof. Dr. Martin Baumann (Psychology), Prof. Dr. Klaus Dietmayer (Measurement, Control and Microtechnology), Prof. Dr. Christian Waldschmidt (Microwave Technology) and Prof. Dr. Enrico Rukzio (Media Informatics) of the University of Ulm are part of the consortium.

     

    Mark examines in the context of the joint project Intuitiver communication possibilities between highly automated vehicles and easily vulnerable road users (pedestrians, cyclists, etc.)

  • SituWare - detection of driver situation awareness for adaptive cooperative transfer strategies in highly automated driving

    Cooperation partner: Ulm University, AVL Software & Functions GmbH, Human-Factors-Consult GmbH, Humatects GmbH, OFFIS e.V..

    SituWare addresses a central obstacle to the introduction of highly automated vehicles (see also BASt) into complex traffic: The required time reserve for a safe transfer of control to distracted Driver. Even medium-term available environment sensors cannot always guarantee large time reserves. SituWare reduces the takeover time by means of a targeted, driver situational awareness
    Adapted driver guidance and allows a fluid vehicle behaviour with high user acceptance by adapting the automation to the driver's situation awareness.

     

    Mark examines how transfer processes can be made safer and faster through multimodal attention and information guidance.

  • SEMULIN

    The goal of the project SEMULIN (Self-supporting Multimodal Interaction) is the development of a self-supporting, natural and consistent human-machine interface for automated driving vehicles by means of multimodal input and output concepts.

    In cooperation with Elektrobit Automotive GmbH (project lead), audEERING GmbH, Eesy Innovation GmbH, Fraunhofer Institute for Integrated Circuits, Infineon Technologies AG, University of Ulm, and the associated partner Mercedes-Benz AG, novel interaction concepts are developed considering multimodal input and output concepts.


    Mark investigates how previous interaction takes place in vehicles and how it can be improved by multimodal interaction.

     

     

  • Towards Inclusive External Communication of Autonomous Vehicles for Pedestrians with Vision Impairments

    People with vision impairments (VIP) are among the most vulnerable road users in traffic. Autonomous vehicles are believed to reduce accidents but still demand some form of external communication signaling relevant information to pedestrians. Recent research on the design of vehicle-pedestrian communication (VPC) focuses strongly on concepts for a non-disabled population. Our work presents an inclusive user-centered design for VPC, beneficial for both vision impaired and seeing pedestrians. We conducted a workshop with VIP (N=6), discussing current issues in road traffic and comparing communication concepts proposed by literature...

    Read more...

Teaching

  • Open Topics for Theses

    I am happy to supervise Bachelor and Master theses with a focus on the interaction with (partially) autonomous vehicles and their bigger scale effects. The focus is on the interaction in the car, but also on the interaction of outsiders (passers-by, cyclists, ...) with autonomous vehicles. I am always open to suggestions for topics from you.

    Please contact me by e-mail if you are interested. Below are listed some potential fields of work.

    I am looking forward to our cooperation.

     

    Open Topics:

    Multimodal Interaction in Automated Driving
    Uncertainty Visualization in Automated Driving
    Aiding Impaired Persons Through Autonomous Vehicles External Communication
    Information Needs in Highly Automated Driving
    External Communication in Highly Automated Driving

    Implicit Communication of (Highly Automated) Vehicles

    Incorporating Human Operators in Vehicle-Human Communication

    Macroscopic Effects of eHMIs on Traffic

    Further topics can be found under this Link

  • Supervised Theses

     

    Master Theses

    • Investigations on the Use of Augmented Reality for Information Visualization in Connected Automated Driving
    • Exploring the Social Context of Collaborative Driving
    • Optimizing Localization of Sound for the Hearing Impaired in Traffic with AVs

    Bachelor Theses

    • Informationsbedürfnisse in autonomen Fahrzeugen und Auswirkung der Visualisierung der Fußgängerintention auf Vertrauen und kognitive Belastung
    • External Communication of Heavy Machinery (or Autonomous Trucks) on Construction Sites
    • Effect of Displaying Semantic Segmentation on Trust, Situation Awareness and Cognitive Load
    • Increasing Pedestrian Safety Using External Communication of Autonomous Vehicles for Signalling Hazards
    • Auswirkung der Visualisierung der Wahrnehmung Autonomer Fahrzeuge in Kritischen Verkehrssituationen auf Vertrauen und Kognitive Belastung
    • Investigating the Effects of Prosocial External Communication of Autonomous Vehicles

Scientific Activities

Conference Reviewer: MobileHCI '19, AutoUI '19'20, CHI PLAY '19'20, CHI'20'21, TEI'21, HRI'21, IUI'21

Book Reviewer: User Experience Design in the Era of Automated Driving

Organizer: CHI'21 Late Breaking Work AC

Publications

2021

20.
Holländer, Kai; Colley, Mark; Rukzio, Enrico; Butz, Andreas
A Taxonomy of Vulnerable Road Users for HCI Based On A Systematic Literature Review
CHI 2021 (SIGCHI Conference on Human Factors in Computing Systems) Holländer and Colley are Joint First Authors
April 2021
Publisher: ACM
DOI:10.1145/3411764.3445480
Weblink:https://youtu.be/3aWUYZUr6xI
File:fileadmin/website_uni_ulm/iui.inst.100/1-hci/hci-paper/2021/CHI2021_Taxonomy_VRU.pdf
19.
Colley, Mark; Eder, Benjamin; Rixen, Jan Ole; Rukzio, Enrico
Effects of Semantic Segmentation Visualization on Trust, Situation Awareness, and Cognitive Load in Highly Automated Vehicles
CHI 2021 (SIGCHI Conference on Human Factors in Computing Systems)
April 2021
Publisher: ACM
DOI:10.1145/3411764.3445351
Weblink:https://youtu.be/xaTmurTw9TY
File:fileadmin/website_uni_ulm/iui.inst.100/1-hci/hci-paper/2021/CHI2021_Semantic_Segmentation.pdf
18.
Rixen, Jan Ole; Hirzle, Teresa; Colley, Mark; Etzel, Yannick; Rukzio, Enrico; Gugenheimer, Jan
Exploring Augmented Visual Alterations in Interpersonal Communication
CHI 2021 (SIGCHI Conference on Human Factors in Computing Systems)
April 2021
Publisher: ACM
File:fileadmin/website_uni_ulm/iui.inst.100/1-hci/hci-paper/2021/CHI_2021_AR_Color_Augmentation.pdf
17.
Colley, Mark; Li, Surong; Rukzio, Enrico
Increasing Pedestrian Safety Using External Communication of Autonomous Vehicles for Signalling Hazards
Proceedings of the 23rd International Conference on Mobile Human-Computer Interaction (MobileHCI '21)
2021
Publisher: ACM
DOI:https://doi.org/10.1145/3447526.3472024
ISBN:978-1-4503-8328-8/21/09
16.
Lanzer, Mirjam; Stoll, Tanja; Colley, Mark; Baumann, Martin
Intelligent Mobility in the City: The Influence of System and Context Factors on Drivers' Takeover Willingness and Trust in Automated Vehicles
Frontiers in Human Dynamics, section Digital Impacts (Conditionally Accepted)
2021
Publisher: Frontiers
15.
Colley, Mark; Gruler, Lukas; Woide, Marcel; Rukzio, Enrico
Investigating the Design of Information Presentation in Take-Over Requests in Automated Vehicles
Proceedings of the 23rd International Conference on Mobile Human-Computer Interaction (MobileHCI '21)
2021
Publisher: ACM
DOI:https://doi.org/10.1145/3447526.3472025
ISBN:978-1-4503-8328-8/21/09

2020

14.
Colley, Mark; Rukzio, Enrico
A Design Space for External Communication of Autonomous Vehicles
Proceedings of the 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI ’20)
September 2020
Publisher: ACM
DOI:10.1145/3409120.3410646
Weblink:https://youtu.be/127RxzS6iyA
File:fileadmin/website_uni_ulm/iui.inst.100/institut/mitarbeiterbereiche/colley/AutoUI2020_Design_Space_final.pdf
13.
Colley, Mark; Bräuner, Christian; Lanzer, Mirjam; Walch, Marcel; Baumann, Martin; Rukzio, Enrico
Effect of Visualization of Pedestrian Intention Recognition on Trust and Cognitive Load
Proceedings of the 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI ’20), Conditionally Accepted
September 2020
Publisher: ACM
DOI:10.1145/3409120.3410648
Weblink:https://youtu.be/aGWgtVbY1Lc
File:fileadmin/website_uni_ulm/iui.inst.100/institut/Papers/Prof_Rukzio/2020/AutoUI2020_Pedestrian_Intention-min.pdf
12.
Colley, Mark; Mytilineos, Stefanos; Walch, Marcel; Gugenheimer, Jan; Rukzio, Enrico
Evaluating Highly Automated Trucks as Signaling Lights
Proceedings of the 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI ’20)
September 2020
Publisher: ACM
DOI:10.1145/3409120.3410647
Weblink:https://youtu.be/SNYoO-jUwl4
File:fileadmin/website_uni_ulm/iui.inst.100/institut/mitarbeiterbereiche/colley/AutoUI2020_Truck_Signaling_Light_final.pdf
11.
Colley, Mark; Walch, Marcel; Rukzio, Enrico
Unveiling the Lack of Scalability in Research on External Communication of Autonomous Vehicles
In Extended Abstracts of CHI 2020 (SIGCHI Conference on Human Factors in Computing Systems)
April 2020
Publisher: ACM
DOI:10.1145/3334480.3382865
File:fileadmin/website_uni_ulm/iui.inst.100/institut/Papers/Prof_Rukzio/2020/CHI2020_LBW_Scalability_for_website.pdf
10.
Colley, Mark; Walch, Marcel; Gugenheimer, Jan; Askari, Ali; Rukzio, Enrico
Towards Inclusive External Communication of Autonomous Vehicles for Pedestrians with Vision Impairments
In Proc. of CHI 2020 (SIGCHI Conference on Human Factors in Computing Systems)
April 2020
Publisher: ACM
DOI:10.1145/3313831.3376472
Weblink:https://youtu.be/1L7zTJ86PE8
File:fileadmin/website_uni_ulm/iui.inst.100/institut/mitarbeiterbereiche/colley/ColleyCHI2020Towards.pdf
9.
Colley, Mark; Rukzio, Enrico
Towards a Design Space for External Communication of Autonomous Vehicles
In Extended Abstracts of CHI 2020 (SIGCHI Conference on Human Factors in Computing Systems)
April 2020
Publisher: ACM
DOI:10.1145/3334480.3382844
File:fileadmin/website_uni_ulm/iui.inst.100/institut/Papers/Prof_Rukzio/2020/CHI2020_LBW_Design_Space_for_website.pdf
8.
Colley, Mark; Walch, Marcel; Rukzio, Enrico
Towards Reducing Energy Waste through Usage of External Communication of Autonomous Vehicles
CHI 2020 Workshop - Should I Stay or Should I Go? Automated Vehicles in the Age of Climate Change,
2020
Weblink:t3://file?uid=423728
7.
Walch, Marcel; Colley, Mark; Hock, Philipp; Rukzio, Enrico; Weber, Michael
Turn Drivers Into Users and Keep Them Out-Of-The-Loop to Save Energy
CHI 2020 Workshop - Should I Stay or Should I Go? Automated Vehicles in the Age of Climate Change,
2020
File:fileadmin/website_uni_ulm/iui.inst.100/institut/Papers/Prof_Weber/2020/CHI2020_Wrkshp_KeepTheDriverOutOfTheLoop.pdf

2019

6.
Walch, Marcel; Lehr, David; Colley, Mark; Weber, Michael
Don't You See Them? Towards Gaze-Based Interaction Adaptation for Driver-Vehicle Cooperation
Adjunct Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI ’19)
September 2019
Publisher: ACM
DOI:10.1145/3349263.3351338
File:pdfhttps://www.uni-ulm.de/fileadmin/website_uni_ulm/iui.inst.100/institut/Papers/Prof_Weber/2019/Walch2019Dontyousee.pdf
5.
Walch, Marcel; Colley, Mark; Weber, Michael
Driving-Task-Related Human-Machine Interaction in Automated Driving: Towards a Bigger Picture
Adjunct Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI ’19)
September 2019
Publisher: ACM
DOI:10.1145/3349263.3351527
File:pdfhttps://www.uni-ulm.de/fileadmin/website_uni_ulm/iui.inst.100/institut/Papers/Prof_Weber/2019/Walch2019BiggerPicture.pdf
4.
Colley, Mark; Walch, Marcel; Rukzio, Enrico
For a Better (Simulated) World: Considerations for VR in External Communication Research
In Adj. Proc. of AutomotiveUI ’19 (11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications)
09 2019
Publisher: ACM
DOI:10.1145/3349263.3351523
File:fileadmin/website_uni_ulm/iui.inst.100/institut/Papers/Prof_Rukzio/2019/AutoUI2019LBW_VR_Simulator_for_website.pdf
3.
Colley, Mark; Walch, Marcel; Gugenheimer, Jan; Rukzio, Enrico
Including People with Impairments from the Start: External Communication of Autonomous Vehicles
In Adj. Proc. of AutomotiveUI ’19 (11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications)
09 2019
Publisher: ACM
DOI:10.1145/3349263.3351521
File:fileadmin/website_uni_ulm/iui.inst.100/1-hci/hci-paper/2019/AutoUI2019LBW_Accessibility_eHMI_Colley.pdf
2.
Walch, Marcel; Colley, Mark; Weber, Michael
CooperationCaptcha: On-The-Fly Object Labeling for Highly Automated Vehicles
CHI '19 Extended Abstracts on Human Factors in Computing Systems,
Publisher: ACM, New York, NY, USA
May 2019
DOI:10.1145/3290607.3313022
File:pdfhttps://www.uni-ulm.de/fileadmin/website_uni_ulm/iui.inst.100/institut/Papers/Prof_Weber/2019/Walch2019CooperationCaptcha.pdf

2018

1.
Rogers, Katja; Colley, Mark; Lehr, David; Frommel, Julian; Walch, Marcel; Nacke, Lennart E.; Weber, Michael
KickAR: Exploring Game Balancing Through Boosts and Handicaps in Augmented Reality Table Football
Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems
Publisher: ACM, New York, NY, USA
2018
DOI:10.1145/3173574.3173740