Pascal Jansen, M.Sc.

Pascal Jansen joined the HCI Group in June 2021 as a research associate and Ph.D. student.

Pascal has an M.Sc. with distinction in Media Informatics (2021) from Ulm University. The title of the master thesis was: SwiVR-Car-Seat: Utilizing a Motorized Swivel Seat to Explore Effects of Vehicle Motion on Interaction Quality in Virtual Reality Automated Driving. Before that, he studied Computer Science at Ulm University and obtained his B.Sc. in 2018.

In 2021, Pascal participated in the German Computer Game Award and was nominated with his team for the serious game The Social Engineer in the category Young Talent Award: Best Prototype. With The Social Engineer, Pascal was also a finalist for Best Student Game in the 2022 Games for Change Awards. The Social Engineer was additionally nominated for the nextReality.Contest 2022 in the "Young Talent" category.

Research interests

My research explores the design space of driver- and passenger-based automotive user interfaces, introducing the novel concept of Computational Mobility Interaction centered around five key areas:

  • Mobility User Interface Design as Unique Optimization Problem
  • Computational Calibration of Driver/Passenger States
  • Optimization of Accessibility - Accessible Mobility by Default
  • Scalable Evaluation and Computational Mixed-Immersive Data Analysis
  • Simulation and Simulacra of Future Mobility

Teaching

You are welcome to contact me via email if you are generally interested in projects or theses in the field of Virtual Reality, Augmented RealityAutomotive User Interfaces, and Vehicle Motion Simulation. Of course, I am always open for topic suggestions.

I am looking forward to our cooperation.

Future Mobility:

A small step for man... Human-Computer Interaction for Space Exploration
Exploring Motion Effects on Interaction Quality in Urban Air 

Generative AI in Human-Computer Interaction:

Augmenting Human to Human Communication with Generative AI
Predicting User Interactions in Vehicles
Interfaces for Explainable In-Vehicle AI

Virtual Reality & Augmented Reality:

Social Engineering Awareness Training in Virtual Reality
ShARe: Asymmetric Multi-User Augmented Reality
Imaginary Text Entry for Virtual and Augmented Reality

Human-Robot Interaction:

Drone UI: Utilizing Drones as Mobile User Interfaces
Social Perception of Autonomous Household Robots

Automotive User Interfaces:

Novel In-Vehicle Interaction Modalities and Locations
Driver Attention Guidance in Automated Vehicles
Shape Changing Interfaces in Vehicles
You Spin Me Right Round - Using a Motorized Swivel Seat in Takeovers
Augmented Reality Window Parking Assistant
Makes Perfect Scents – Olfactory Experiences in Vehicles
Social Interplay of Ride-Sharing Passengers
Gender Influences on Take-Overs in Automated Driving

Vehicle Motion Simulation:

Vehicle Motion Simulation in Virtual Reality
Validity of Driver State Measures Across Simulators
Comparing Vehicle Motion Impacts on Interaction Quality Between Simulators

Master Theses

  • Investigating Acceptance and Trust of Auditory Cues in Vehicles - Based on a Systematic Literature Review

Bachelor Theses

  • Exploring Vehicle Motion Simulation in Virtual Reality Using a Motorized Wheelchair
  • Designing a Task-Driven Platform to Evaluate Performance Indicators’ Effects on the Understanding of Prediction Systems
  • Progress Assessment for Adaptive Hints in Educational Virtual Reality Games

AutoVis: The Mixed-Immersive Analysis Toolkit for Automotive UI Interaction Studies
https://autovis-demo.onrender.com/ 

UVID: A Virtual Reality Framework for Immersive Exploration of Vehicle Interior Design

  • Lecture Automotive User Interfaces '21 '22 '23
  • Lecture User Interface Softwaretechnologien '22 '23
  • Seminar Research Trends in Media Informatics '21 '22
  • Project User Centered Design '21 '22 '23
  • Project Design Thinking for Interactive Systems '21 '22 '23

Funded Projects

Cooperation partners: Ulm University, AVL Software & Functions GmbH, Human-Factors-Consult GmbH, Humatects GmbH, OFFIS e.V.

SituWare addresses a central obstacle for the introduction of highly automated vehicles (see also BASt) into complex traffic: the required time reserve for a safe transfer of control to the distracted driver. Even environment sensors available in the medium term cannot always guarantee large time reserves. SituWare reduces the takeover time through a targeted, situation-related driver perception adapted driver guidance and enables fluid vehicle behavior with high user acceptance by adapting automation to the driver's situational awareness.

Pascal investigates how handover processes can be made safer and faster by multimodal attention and information guidance.

Scientific Activities

Conference Reviewer: AutomotiveUI '21 '22 '23, VRST '21, CHI '22 '23 '24, IDC '22, ICWSM '22, GLS '22, MobileHCI '22 '23, IMX '22, ETRA '22, COGAIN '22, CogSci '22, DIS '22 '23, EICS PACM '22, CHI Play '22, ISS '22, ISMAR '22, Creativity & Cognition '22, MuC '22, NordiCHI '22, ICIS '22, OzCHI '22 '23, ISWC '22, IEEE VIS '23, ICMI '23, HAI '23, PacificVis '24, CSCW '24

Journal Reviewer: IMWUT '22 '23, TVCG '22


1 "Special Recognition for Outstanding Reviews" IMWUT 2022

1 "Special Recognition for Outstanding Reviews" ISS 2022

1 "Special Recognition for Outstanding Reviews" AutomotiveUI 2022

1 "Special Recognition for Outstanding Reviews" DIS 2023

1 "Special Recognition for Outstanding Reviews" IEEE VIS 2023

1 "Special Recognition for Outstanding Reviews" AutomotiveUI 2023

2 "Special Recognition for Outstanding Reviews" CHI 2024

1 "Special Recognition for Outstanding Reviews" CHI 2024 Late-Breaking Work

1 "Special Recognition for Outstanding Reviews" CSCW 2024


Organizer LBW: CHI '23 '24 Late-Breaking Work AC

Organizer Full Paper: AutomotiveUI '24 Full Paper AC

Conference Organizer: Registration and Local Co-Chair AutomotiveUI '23

Publications

% % This file was created by the TYPO3 extension % publications % --- Timezone: CEST % Creation date: 2024-04-14 % Creation time: 13:35:27 % --- Number of references % 14 % @Article { 481588770650_2024, author = {Colley, Mark and Wanner, Beate and R\{\"\{a\}dler, Max and R\{\"\{o\}\}tzer, Marcel and Frommel, Julian and Hirzle, Teresa and Jansen, Pascal and Rukzio, Enrico}, title = {Effects of a Gaze-Based 2D Platform Game on User Enjoyment, Perceived Competence, and Digital Eye Strain}, status = {1}, year = {2024}, month = {5}, reviewed = {1}, journal = {In Proc. of CHI 2024 (SIGCHI Conference on Human Factors in Computing Systems)}, publisher = {ACM}, address = {New York, NY, USA}, file_url = {t3://file?uid=485718} } @Article { 10.1145/3643558, author = {Zeqiri, Albin and Jansen, Pascal and Rixen, Jan Ole and Rietzler, Michael and Rukzio, Enrico}, title = {'Eco Is Just Marketing': Unraveling Everyday Barriers to the Adoption of Energy-Saving Features in Major Home Appliances}, abstract = {Energy-saving features (ESFs) represent a simple way to reduce the resource consumption of home appliances (HAs), yet they remain under-utilized. While prior research focused on increasing the use of ESFs through behavior change interventions, there is currently no clarity on the barriers that restrict their utilization in the first place. To bridge this gap, we conducted a qualitative analysis of 349 Amazon product reviews and 98 Reddit discussions, yielding three qualitative themes that showcase how users perceive, interact with, and evaluate ESFs in HAs. Based on these themes, we derived frequent barriers to ESF adoption, which guided a subsequent expert focus group (N=5) to assess the suitability of behavior change interventions and potential alternative strategies for ESF adoption. Our findings deepen the understanding of everyday barriers surrounding ESFs and enable the targeted design and assessment of interventions for future HAs.}, year = {2024}, month = {Mar}, DOI = {10.1145/3643558}, journal = {Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. (IMWUT)}, volume = {8}, publisher = {ACM}, pages = {27}, number = {1}, keywords = {energy-saving mechanisms, home appliances, sustainability}, file_url = {t3://file?uid=486903} } @Article { 814022980215_2024, author = {Colley, Mark and Czymmeck, Julian and K\{\"\{u\}\}c\{\"\{u\}\}kkocak, Mustafa and Jansen, Pascal and Rukzio, Enrico}, title = {PedSUMO: Simulacra of Automated Vehicle-Pedestrian Interaction Using SUMO To Study Large-Scale Effects}, year = {2024}, journal = {9th Annual ACM/IEEE International Conference on Human Robot Interaction (HRI)}, publisher = {ACM/IEEE}, address = {New York, NY, USA}, web_url = {https://github.com/M-Colley/pedsumo}, file_url = {t3://file?uid=484761} } @Article { 243166919220_2023, author = {Jansen, Pascal and Britten, Julian and H\{\"\{a\}usele, Alexander and Segschneider, Thilo and Colley, Mark and Rukzio, Enrico}, title = {A Demonstration of AutoVis: Enabling Mixed-Immersive Analysis of Automotive User Interface Interaction Studies}, year = {2023}, month = {09}, DOI = {10.1145/3581961.3610374}, journal = {Proceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI ’23 Adjunct)}, publisher = {ACM}, address = {New York, NY, USA}, web_url2 = {https://autovis-demo.onrender.com/}, file_url = {t3://file?uid=480184} } @Article { 820554852530_2023, author = {Jansen, Pascal and Britten, Julian and H\{\"\{a\}usele, Alexander and Segschneider, Thilo and Colley, Mark and Rukzio, Enrico}, title = {AutoVis: Enabling Mixed-Immersive Analysis of Automotive User Interface Interaction Studies}, status = {1}, year = {2023}, month = {1}, DOI = {10.1145/3544548.3580760}, journal = {In Proc. of CHI 2023 (SIGCHI Conference on Human Factors in Computing Systems)}, publisher = {ACM}, address = {New York, NY, USA}, web_url2 = {https://autovis-demo.onrender.com/}, file_url = {t3://file?uid=476230} } @Conference { 821723498503_2023, author = {Colley, Mark and Jansen, Pascal and Matthiesen, Jennifer Jorina and Hoberg, Hanne and Reger, Carmen and Thiermann, Isabel}, title = {How Much Home Office is Ideal? A Multi-Perspective Algorithm}, status = {1}, year = {2023}, DOI = {10.1145/3596671.3596672}, event_name = {CHIWORK 2023: 2023 Symposium on Human-Computer Interaction for Work, *First three authors are joint first authors}, event_place = {Oldenburg}, web_url2 = {https://github.com/jjmatthiesen/HOMPA}, file_url = {t3://file?uid=478855} } @Article { tochi_21_hirzle, author = {Hirzle, Teresa and Fischbach, Fabian and Karlbauer, Julian and Jansen, Pascal and Gugenheimer, Jan and Rukzio, Enrico and Bulling, Andreas}, title = {Understanding, Addressing, and Analysing Digital Eye Strain in Virtual Reality Head-Mounted Displays}, status = {1}, year = {2022}, month = {8}, DOI = {10.1145/3492802}, journal = {ACM Transactions on Computer-Human Interaction (TOCHI)}, volume = {29}, publisher = {ACM}, series = {4}, pages = {1-80}, web_url2 = {https://youtu.be/ns2HwQ2p\_hM \_blank}, file_url = {t3://file?uid=456150} } @Article { 294847077751_2022, author = {Jansen, Pascal and Colley, Mark and Rukzio, Enrico}, title = {A Design Space for Human Sensor and Actuator Focused In-Vehicle Interaction Based on a Systematic Literature Review}, year = {2022}, month = {6}, DOI = {10.1145/3534617}, journal = {Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT)}, edition = {2}, volume = {6}, publisher = {ACM}, address = {New York, NY, USA}, pages = {1-51}, web_url2 = {https://in-vehicle-interaction-design-space.onrender.com/}, file_url = {t3://file?uid=457401} } @Article { 652639926271_2021, author = {Colley, Mark and Jansen, Pascal and Rukzio, Enrico and Gugenheimer, Jan}, title = {SwiVR-Car-Seat: Exploring Vehicle Motion Effects on Interaction Quality in Virtual Reality Automated Driving Using a Motorized Swivel Seat}, year = {2021}, month = {12}, DOI = {10.1145/3494968}, journal = {Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT)}, volume = {5}, publisher = {ACM}, address = {New York, NY, USA}, pages = {1-26}, web_url2 = {https://youtu.be/hvxtrgGAaUE}, file_url = {t3://file?uid=447439} } @Article { BeingStuck, author = {Drey, Tobias and Fischbach, Fabian and Jansen, Pascal and Frommel, Julian and Rietzler, Michael and Rukzio, Enrico}, title = {To Be or Not to Be Stuck, or Is It a Continuum?: A Systematic Literature Review on the Concept of Being Stuck in Games}, year = {2021}, month = {9}, reviewed = {1}, DOI = {10.1145/3474656}, journal = {Proc. ACM Hum.-Comput. Interact. 5, CHI PLAY, Article 229 (September 2021)}, publisher = {ACM}, web_url2 = {https://youtu.be/BFDHEiZZLG8}, file_url = {t3://file?uid=444390} } @Article { Jansen_Social_2020, author = {Jansen, Pascal and Fischbach, Fabian}, title = {The Social Engineer: An Immersive Virtual Reality Educational Game to Raise Social Engineering Awareness}, abstract = {As system infrastructures are becoming more secure against technical attacks, it is more difficult for attackers to overcome them with technical means. Social engineering instead exploits the human factor of information security and can have a significant impact on organizations. The lack of awareness about social engineering favors the successful realization of social engineering attacks, as employees do not recognize them as such early enough, resulting in high costs for the affected company. Current training approaches and awareness courses are limited in their versatility and create little motivation for employees to deal with the topic. The high immersion of virtual reality can improve learning in this context. We created The Social Engineer, an immersive educational game in virtual reality, to raise awareness and to sensitize players about social engineering. The player impersonates a penetration tester and conducts security audits in a virtually simulated company. The game consists of a detailed game world containing three distinct missions that require the player to apply different social engineering attack methods. Our concept enables the game to be highly extensible and flexible regarding different playable scenarios and settings. The Social Engineer can potentially benefit companies as an immersive self-training tool for their employees, support security experts in teaching social engineering awareness as part of a comprehensive training course, and entertain interested individuals by leveraging fun and innovative gameplay mechanics.}, year = {2020}, month = {11}, day = {02}, reviewed = {1}, DOI = {10.1145/3383668.3419917}, journal = {CHI PLAY '20: Extended Abstracts of the 2020 Annual Symposium on Computer-Human Interaction in Play}, publisher = {ACM}, event_place = {Virtual Event, Canada}, keywords = {socialengineer}, web_url2 = {https://youtu.be/DrH3UVByfUc}, file_url = {t3://file?uid=442944} } @Conference { Jansen_ShARe_2020, author = {Jansen, Pascal and Fischbach, Fabian and Gugenheimer, Jan and Stemasov, Evgeny and Frommel, Julian and Rukzio, Enrico}, title = {ShARe: Enabling Co-Located Asymmetric Multi-User Interaction for Augmented Reality Head-Mounted Displays}, abstract = {Head-Mounted Displays (HMDs) are the dominant form of enabling Virtual Reality (VR) and Augmented Reality (AR) for personal use. One of the biggest challenges of HMDs is the exclusion of people in the vicinity, such as friends or family. While recent research on asymmetric interaction for VR HMDs has contributed to solving this problem in the VR domain, AR HMDs come with similar but also different problems, such as conficting information in visualization through the HMD and projection. In this work, we propose ShARe, a modifed AR HMD combined with a projector that can display augmented content onto planar surfaces to include the outside users (non-HMD users). To combat the challenge of conficting visualization between augmented and projected content, ShARe visually aligns the content presented through the AR HMD with the projected content using an internal calibration procedure and a servo motor. Using marker tracking, non-HMD users are able to interact with the projected content using touch and gestures. To further explore the arising design space, we implemented three types of applications (collaborative game, competitive game, and external visualization). ShARe is a proof-of-concept system that showcases how AR HMDs can facilitate interaction with outside users to combat exclusion and instead foster rich, enjoyable social interactions.}, status = {1}, year = {2020}, month = {10}, day = {20}, reviewed = {1}, DOI = {10.1145/3379337.3415843}, journal = {In Proceedings of UIST '20 ACM Symposium on User Interface Software and Technology)}, publisher = {ACM}, event_name = {ACM Symposium on User Interface Software and Technology (UIST)}, event_place = {Minneapolis, Minnesota, USA}, web_url2 = {https://youtu.be/6wuBt2Nv18w}, file_url = {t3://file?uid=430150} } @Article { 403392675416_2020, author = {Kraus, Matthias and Fischbach, Fabian and Jansen, Pascal and Minker, Wolfgang}, title = {A Comparison of Explicit and Implicit Proactive Dialogue Strategies for Conversational Recommendation}, abstract = {Recommendation systems aim at facilitating information retrieval for users by taking into account their preferences. Based on previous user behaviour, such a system suggests items or provides information that a user might like or find useful. Nonetheless, how to provide suggestions is still an open question. Depending on the way a recommendation is communicated influences the user’s perception of the system. This paper presents an empirical study on the effects of proactive dialogue strategies on user acceptance. Therefore, an explicit strategy based on user preferences provided directly by the user, and an implicit proactive strategy, using autonomously gathered information, are compared. The results show that proactive dialogue systems significantly affect the perception of human-computer interaction. Although no significant differences are found between implicit and explicit strategies, proactivity significantly influences the user experience compared to reactive system behaviour. The study contributes new insights to the human-agent interaction and the voice user interface design. Furthermore, we discover interesting tendencies that motivate futurework.}, year = {2020}, month = {5}, day = {11}, reviewed = {1}, isbn = {979-10-95546-34-4}, journal = {Proceedings of the 12th Language Resources and Evaluation Conference (LREC)}, publisher = {European Language Resources Association}, file_url = {https://www.aclweb.org/anthology/2020.lrec-1.54.pdf} } @Article { 682083006990_2020, author = {Drey, Tobias and Jansen, Pascal and Fischbach, Fabian and Frommel, Julian and Rukzio, Enrico}, title = {Towards Progress Assessment for Adaptive Hints in Educational Virtual Reality Games}, status = {1}, year = {2020}, month = {4}, DOI = {10.1145/3334480.3382789}, journal = {In Extended Abstracts of CHI 2020 (SIGCHI Conference on Human Factors in Computing Systems)}, publisher = {ACM}, web_url2 = {https://youtu.be/3uW-NBEatTg}, file_url = {t3://file?uid=435010} }