Mark Colley, M.Sc.

Mark Colley joined the HCI group in April 2019 as a research associate and doctoral candidate. Prior to that, he worked as a software engineer at Airbus since 2015.

Mark holds an M. Sc. in Computer Science (2018) from the University of Ulm. The title of the master thesis was: Identification, Investigation and Classification of Use Cases for Cooperation in Highly Autonomous Driving and the Applicability thereof. This was done within the project KoFFI - Kooperative Fahrer-Fahrzeug-Interaktion.

Mark received his B. Eng. in Information Technology in 2015 at the Duale Hochschule Baden-Württemberg Ravensburg/Friedrichshafen in cooperation with Airbus.

Research interests

  • Autonomous Driving
  • Driver-Vehicle Interaction
  • Augmented Reality
  • Virtual Reality
  • Mobile Devices
  • Head Mounted Displays

Projects

As part of the "Smart Mobility" research funding program of the state of Baden-Württemberg, the "Intuitiver" project for interaction between automated vehicles and easily vulnerable road users will start in November 2018. The project focuses on how autonomous vehicles and pedestrians can recognize each other's intentions, for example when crossing the road, and how autonomous vehicles inform occupants of their intentions. Prof. Dr. Martin Baumann (Psychology), Prof. Dr. Klaus Dietmayer (Measurement, Control and Microtechnology), Prof. Dr. Christian Waldschmidt (Microwave Technology) and Prof. Dr. Enrico Rukzio (Media Informatics) of the University of Ulm are part of the consortium.

 

Mark examines in the context of the joint project <a class="external-link-new-window" href="https://www.uni-ulm.de/in/omi/institut/blog/details/article/neues-projekt-intuitiver-zur-interaktion-zwischen-automatisierten-fahrzeugen-und-leicht-verletzbaren-verkehrsteilnehmern/" title="Opens internal link in current window">Intuitiver</a> communication possibilities between highly automated vehicles and easily vulnerable road users (pedestrians, cyclists, etc.)

Cooperation partner: Ulm University, AVL Software & Functions GmbH, Human-Factors-Consult GmbH, Humatects GmbH, OFFIS e.V..

SituWare addresses a central obstacle to the introduction of highly automated vehicles (see also BASt) into complex traffic: The required time reserve for a safe transfer of control to distracted Driver. Even medium-term available environment sensors cannot always guarantee large time reserves. SituWare reduces the takeover time by means of a targeted, driver situational awareness
Adapted driver guidance and allows a fluid vehicle behaviour with high user acceptance by adapting the automation to the driver's situation awareness.

 

Mark examines how transfer processes can be made safer and faster through multimodal attention and information guidance.

The goal of the project SEMULIN (Self-supporting Multimodal Interaction) is the development of a self-supporting, natural and consistent human-machine interface for automated driving vehicles by means of multimodal input and output concepts.

In cooperation with Elektrobit Automotive GmbH (project lead), audEERING GmbH, Eesy Innovation GmbH, Fraunhofer Institute for Integrated Circuits, Infineon Technologies AG, University of Ulm, and the associated partner Mercedes-Benz AG, novel interaction concepts are developed considering multimodal input and output concepts.


Mark investigates how previous interaction takes place in vehicles and how it can be improved by multimodal interaction.

 

 

People with vision impairments (VIP) are among the most vulnerable road users in traffic. Autonomous vehicles are believed to reduce accidents but still demand some form of external communication signaling relevant information to pedestrians. Recent research on the design of vehicle-pedestrian communication (VPC) focuses strongly on concepts for a non-disabled population. Our work presents an inclusive user-centered design for VPC, beneficial for both vision impaired and seeing pedestrians. We conducted a workshop with VIP (N=6), discussing current issues in road traffic and comparing communication concepts proposed by literature...

Read more...

Teaching

I am happy to supervise Bachelor and Master theses with a focus on the interaction with (partially) autonomous vehicles and their bigger scale effects. The focus is on the interaction in the car, but also on the interaction of outsiders (passers-by, cyclists, ...) with autonomous vehicles. I am always open to suggestions for topics from you.

Please contact me by e-mail if you are interested. Below are listed some potential fields of work.

I am looking forward to our cooperation.

 

Open Topics:

Multimodal Interaction in Automated Driving
Uncertainty Visualization in Automated Driving
Aiding Impaired Persons Through Autonomous Vehicles External Communication
Information Needs in Highly Automated Driving
External Communication in Highly Automated Driving

Implicit Communication of (Highly Automated) Vehicles

Incorporating Human Operators in Vehicle-Human Communication

Macroscopic Effects of eHMIs on Traffic

Further topics can be found under this Link

 

Master Theses

  • Investigations on the Use of Augmented Reality for Information Visualization in Connected Automated Driving
  • Exploring the Social Context of Collaborative Driving
  • Optimizing Localization of Sound for the Hearing Impaired in Traffic with AVs
  • SwiVR-Car-Seat: Utilizing a Motorized Swivel Seat to Explore Effects of Vehicle Motion on Interaction Quality in Virtual Reality Automated Driving
  • User-Centric Exploration of In-Car Augmented Reality UI Concepts for See-Through Head-Mounted Displays

Bachelor Theses

  • Informationsbedürfnisse in autonomen Fahrzeugen und Auswirkung der Visualisierung der Fußgängerintention auf Vertrauen und kognitive Belastung
  • External Communication of Heavy Machinery (or Autonomous Trucks) on Construction Sites
  • Effect of Displaying Semantic Segmentation on Trust, Situation Awareness and Cognitive Load
  • Increasing Pedestrian Safety Using External Communication of Autonomous Vehicles for Signalling Hazards
  • Auswirkung der Visualisierung der Wahrnehmung Autonomer Fahrzeuge in Kritischen Verkehrssituationen auf Vertrauen und Kognitive Belastung
  • Investigating the Effects of Prosocial External Communication of Autonomous Vehicles
  • Auswirkungen von Abstraktionsebenen in der Informationsvisualisierung auf Situationsbewusstsein, Kognitive Belastung und Benutzerfreundlichkeit bei Kontrollübernahme-Aufforderungen in Hochautomatisierten Fahrzeugen
  • Effects of Scene Detection, Scene Prediction, and Maneuver Planning Visualizations on Trust, Situation Awareness, and Cognitive Load in Highly Automated Vehicles
  • Realistic Scenarios for the Communication between Autonomous Vehicle and Pedestrians
  • Investigating the Effects of External Communication and Automation Behavior on Manual Drivers
  • Mode Confusion of External Communication

Scientific Activities

I reviewed more than 100 papers and Late-Breaking Works, for example, for:

Conference Reviewer: MobileHCI '19'21'22, AutoUI '19'20'21'22, CHI PLAY '19'20'21'22, CHI'20'21'22, TEI'21, HRI'21'22, IUI'21, DIS'21'22, ICMI'21'22, C&C'21'22, ISCW'21'22, ISMAR'21'22, IASDR'21, ISS'21, VRST '21'22, EICS'22, SUI'21'22, HAI'21'22, IEEE VR'22, OzCHI'22, ETRA'22, IDC'22, ICWSM'22, IMX'22, NordiCHI'22

Journal Reviewer: Frontiers in Human Dynamics, CSCW '21'22'23, Case Studies on Transport Policy

Book Reviewer: User Experience Design in the Era of Automated Driving

 

For this, I received some awards:

1 "Special Recognition for Outstanding Reviews" CHI 2021

1 "Special Recognition for Outstanding Reviews" CHI 2022

1 "Special Recognition for Outstanding Reviews" AutoUI 2021

 

I also helped to organize some conferences:

Organizer LBW: CHI'21'22 Late Breaking Work AC,

Organizer Full Paper: AutoUI'21'22, MuC'22 Full Paper AC

 

Conference Organizer: Workshop and Tutorial Co-Chair AutoUI'23

Publications

2022

52.
Colley, Mark; Rixen, Jan Ole; Pellegrino, Walter Italgo; Rukzio, Enrico
(Eco-)Logical to Compare? - Utilizing Peer Comparison to Encourage Ecological Driving in Manual and Automated Driving
Proceedings of the 14th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI ’22) (conditionally accepted)
09 2022
Publisher: ACM
ISSN: 978-1-4503-9415-4/22/09
DOI:10.1145/3543174.3545256
File:/fileadmin/website_uni_ulm/iui.inst.100/1-hci/hci-paper/2022/AutoUI2022_Ecocar.pdf
51.
Woide, Marcel; Colley, Mark; Damm, Nicole; Baumann, Martin
Effect of System Capability Verification on Conflict, Trust, and Behavior in Automated Vehicles
Proceedings of the 14th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI ’22) (conditionally accepted)
09 2022
Publisher: ACM
ISSN: 978-1-4503-9415-4/22/09
DOI:10.1145/3543174.3545253
File:/fileadmin/website_uni_ulm/iui.inst.100/1-hci/hci-paper/2022/AutoUI2022_Birds_Eye.pdf
50.
Bernhaupt, Regina; Colley, Mark; Goedicke, David; Meschtscherjakov, Alexander; Pfleging, Bastian; Riener, Andreas; Sadeghian, Shadan
A Critical Perspective on Radically Innovating Personal Mobility
Videos, 14th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (conditionally accepted)
09 2022
Publisher: ACM
ISSN: 978-1-4503-9428-4/22/09
DOI:10.1145/3544999.3551689
File:/fileadmin/website_uni_ulm/iui.inst.100/1-hci/hci-paper/2022/Video_Submission_AutoUI_2022_Dagstuhl_22222__2_.pdf
49.
Stampf, Annika; Colley, Mark; Rukzio, Enrico
Towards Implicit Interaction in Highly Automated Vehicles - A Systematic Literature Review
Proceedings of the 24rd International Conference on Mobile Human-Computer Interaction (MobileHCI '22)
09 2022
Publisher: ACM
DOI:10.1145/3546726
File:/fileadmin/website_uni_ulm/iui.inst.100/1-hci/hci-paper/2022/MobileHCI_2022_TowardsImplicitInteraction.pdf
48.
Kim, Young Woo; Lim, Cherin; Ji, Yong Gu; Yoon, Sol Hee; Colley, Mark; Meinhardt, Luca-Maxim
The 2nd Workshop on User Experience in Urban Air Mobility: From Ground to Aerial Transportation
14th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI '22 Adjunct)
09 2022
Publisher: ACM
File:pdf/fileadmin/website_uni_ulm/iui.inst.100/1-hci/hci-paper/2022/uam_workshop_autoui_2022.pdf
47.
Colley, Mark; Fabian, Tim; Rukzio, Enrico
Investigating the Effects of External Communication and Automation Behavior on Manual Drivers at Intersections
Proceedings of the 24rd International Conference on Mobile Human-Computer Interaction (MobileHCI '22)
09 2022
Publisher: ACM
DOI:10.1145/3546711
File:/fileadmin/website_uni_ulm/iui.inst.100/1-hci/hci-paper/2022/MobileHCI_2022_4_Way_Intersection_compressed.pdf
46.
Hock, Philipp; Colley, Mark; Askari, Ali; Wagner, Tobias; Baumann, Martin; Rukzio, Enrico
Introducing VAMPIRE -- Using Kinaesthetic Feedback in Virtual Reality for Automated Driving Experiments
Proceedings of the 14th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI ’22) (conditionally accepted) Joint First Authors
09 2022
Publisher: ACM
ISSN: 978-1-4503-9415-4/22/09
DOI:10.1145/3543174.3545252
File:/fileadmin/website_uni_ulm/iui.inst.100/1-hci/hci-paper/2022/AutoUI_2022_VRealChair_compressed-1.pdf
45.
Colley, Mark; Britten, Julian; Demharter, Simon; Hisir, Tolga; Rukzio, Enrico
Feedback Strategies for Crowded Intersections in Automated Traffic --- A Desirable Future?
Proceedings of the 14th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI ’22) (conditionally accepted)
09 2022
Publisher: ACM
ISSN: 978-1-4503-9415-4/22/09
DOI:10.1145/3543174.3545255
File:/fileadmin/website_uni_ulm/iui.inst.100/1-hci/hci-paper/2022/AutoUI2022_Critical_Intersection_compressed.pdf
44.
Haimerl, Mathias; Colley, Mark; Riener, Andreas
Evaluation of Common External Communication Concepts of Automated Vehicles for People With Intellectual Disabilities
Proceedings of the 24rd International Conference on Mobile Human-Computer Interaction (MobileHCI '22)
09 2022
Publisher: ACM
DOI:10.1145/3546717
File:/fileadmin/website_uni_ulm/iui.inst.100/1-hci/hci-paper/2022/MobileHCI_2022_ID_compressed.pdf
43.
Haimerl, Mathias; Colley, Mark; Löcken, Andreas; Riener, Andreas
Accessible Automated Automotive Workshop Series (A3WS): Focus External Human-Machine Interfaces (eHMIs)
Mensch und Computer 2022 (Adjunct)
09 2022
DOI:10.18420/muc2022-mci-ws09-116
File:pdf/fileadmin/website_uni_ulm/iui.inst.100/1-hci/hci-paper/2022/MuC_2022_WS_Inclusion.pdf
42.
Müller, Tobias; Colley, Mark; Dogru, Gülsemin; Rukzio, Enrico
AR4CAD: Creation and Exploration of a Taxonomy of Augmented Reality Visualization for Connected Automated Driving
Proceedings of the 24rd International Conference on Mobile Human-Computer Interaction (MobileHCI '22), Joint First Authors
09 2022
Publisher: ACM
DOI:10.1145/3546712
File:/fileadmin/website_uni_ulm/iui.inst.100/1-hci/hci-paper/2022/MobileHCI_2022_AR4CAD_compressed.pdf
41.
Colley, Mark; Wankmüller, Bastian; Rukzio, Enrico
A Systematic Evaluation of Solutions for the Final 100m Challenge of Highly Automated Vehicles
Proceedings of the 24rd International Conference on Mobile Human-Computer Interaction (MobileHCI '22)
09 2022
Publisher: ACM
DOI:10.1145/3546713
File:/fileadmin/website_uni_ulm/iui.inst.100/1-hci/hci-paper/2022/MobileHCI2022_Comparison_last_100m_driving_av_final.pdf
40.
Löcken, Andreas; Matviienko, Andrii; Colley, Mark; Dey, Debargha; Habibovic, Azra; Lee, Yee Mun; Riener, Andreas
Accessible Automated Automotive Workshop Series (A3WS): International Perspective on Inclusive External Human-Machine Interfaces
14th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI '22 Adjunct)
09 2022
Publisher: ACM
DOI:10.1145/3544999.3551347
ISBN:978-1-4503-9428-4/22/09
39.
Jansen, Pascal; Colley, Mark; Rukzio, Enrico
A Design Space for Human Sensor and Actuator Focused In-Vehicle Interaction Based on a Systematic Literature Review
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 6 :1-51
June 2022
Publisher: ACM
DOI:10.1145/3534617
Weblink:https://in-vehicle-interaction-design-space.onrender.com/
File:/fileadmin/website_uni_ulm/iui.inst.100/1-hci/hci-paper/2022/IMWUT_2022_In-Vehicle_Interaction_Jansen.pdf
38.
Colley, Mark; Kränzle, Taras; Rukzio, Enrico
Accessibility-Related Publication Distribution in HCI Based on a Meta-Analysis
In Extended Abstracts of CHI 2022 (SIGCHI Conference on Human Factors in Computing Systems)
05 2022
Publisher: ACM
Weblink:t3://file?uid=454504
37.
Colley, Mark; Rukzio, Enrico
Challenges of Explainability, Cooperation, and External Communication of Automated Vehicles
CHI 2022 Workshop - Engaging with Automation: Understanding and Designing for Operation, Appropriation, and Behaviour Change
May 2022
Weblink:t3://file?uid=454506
36.
Rixen, Jan Ole; Colley, Mark; Askari, Ali; Gugenheimer, Jan; Rukzio, Enrico
Consent in the Age of AR: Investigating The Comfort With Displaying Personal Information in Augmented Reality
In Proc. of CHI 2022 (SIGCHI Conference on Human Factors in Computing Systems)
05 2022
Publisher: ACM
DOI:10.1145/3491102.3502140
Weblink:https://www.youtube.com/watch?v=kOfnshoI9XY
File:/fileadmin/website_uni_ulm/iui.inst.100/institut/Papers/Prof_Rukzio/2022/CHI2022_Information_Augmentation_Ole_final.pdf
35.
Colley, Mark; Bajrovic, Elvedin; Rukzio, Enrico
Effects of Pedestrian Behavior, Time Pressure, and Repeated Exposure on Crossing Decisions in Front of Automated Vehicles Equipped with External Communication
In Proc. of CHI 2022 (SIGCHI Conference on Human Factors in Computing Systems)
05 2022
Publisher: ACM
DOI:10.1145/3491102.3517571
Weblink:https://www.youtube.com/watch?v=L7xv6sGweVY _blank
File:/fileadmin/website_uni_ulm/iui.inst.100/institut/Papers/Prof_Rukzio/2022/CHI2022_Effects_Pedestrian_Group_final.pdf
34.
Colley, Mark; Rädler, Max; Glimmann, Jonas; Rukzio, Enrico
Effects of Scene Detection, Scene Prediction, and Maneuver Planning Visualizations on Trust, Situation Awareness, and Cognitive Load in Highly Automated Vehicles
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT)
04 2022
Publisher: ACM
DOI:10.1145/3534609
File:/fileadmin/website_uni_ulm/iui.inst.100/institut/Papers/Prof_Rukzio/2022/IMWUT2022_functional_hierarchy_final.pdf
33.
Colley, Mark; Mytilineos, Stefanos; Walch, Marcel; Rukzio, Enrico; Gugenheimer, Jan
Requirements for the Interaction With Highly Automated Construction Site Delivery Trucks
Frontiers in Human Dynamics, section Digital Impacts
02 2022
Publisher: Frontiers
ISSN: 2673-2726
DOI:10.3389/fhumd.2022.794890
Weblink:https://www.frontiersin.org/article/10.3389/fhumd.2022.794890 _blank
File:pdfhttps://oparu.uni-ulm.de/xmlui/bitstream/handle/123456789/41966/Colley_2022.pdf
32.
Colley, Mark; Pickl, Sebastian; Uhlig, Frank; Rukzio, Enrico
Exploring the Social Context of Collaborative Driving
2022
Weblink:https://arxiv.org/abs/2201.11028
31.
Colley, Mark; Wankmüller, Bastian; Mend, Tim; Väth, Thomas; Rukzio, Enrico; Gugenheimer, Jan
User Gesticulation Inside an Autonomous Vehicle with External Communication can Cause Confusion in Pedestrians and a Lower Willingness to Cross
Transportation Research Part F: Traffic Psychology and Behaviour :120-137
2022
Publisher: Elsevier
ISSN: 1369-8478
DOI:10.1016/j.trf.2022.03.011
File:/fileadmin/website_uni_ulm/iui.inst.100/institut/Papers/Prof_Rukzio/2022/TRF_real_eHMI_final.pdf
30.
Colley, Mark; Hummler, Christian; Rukzio, Enrico
Effects of Mode Distinction, User Visibility, and Vehicle Appearance on Mode Confusion When Interacting With Highly Automated Vehicles
Transportation Research Part F: Traffic Psychology and Behaviour
2022
DOI:10.1016/j.trf.2022.06.020
File:/fileadmin/website_uni_ulm/iui.inst.100/1-hci/hci-paper/2022/TRF2022_Gesture_Novel_Interfaces_final.pdf

2021

29.
Colley, Mark; Jansen, Pascal; Rukzio, Enrico; Gugenheimer, Jan
SwiVR-Car-Seat: Exploring Vehicle Motion Effects on Interaction Quality in Virtual Reality Automated Driving Using a Motorized Swivel Seat
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 5 :1-26
December 2021
Publisher: ACM
DOI:10.1145/3494968
Weblink:https://youtu.be/hvxtrgGAaUE
File:/fileadmin/website_uni_ulm/iui.inst.100/1-hci/hci-paper/2021/IMWUT_2021_SwiVR_Car_Seat_Colley.pdf
28.
Haimerl, Mathias; Colley, Mark
„Du auch hier?“ – Wenn Menschen mit Einschränkungen auf autonome Fahrzeuge treffen
Weblink:https://gi-radar.de/299-informatik-und-inklusion/