Dr. rer. nat. Tobias Heinroth
Dr. rer. nat.
Tobias
Heinroth
Graduation Date: 10.12.2012
First Employment: Daimler, Germany
Dr. rer. nat. Tobias Heinroth
rgtabs: Main Menue
PhD Thesis
Topic
Model-Driven Adaptation for Spoken Dialogues in Intelligent Environments
Status
completed
Description
The aim of this thesis is the development of a Spoken Dialogue Manager (SDM) for Intelligent Environments. The SDM is able to manage, smoothly and naturally, mixed-initiative dialogues about multiple interdependent tasks. It resolves task ambiguities and conflicts and allows users to interrupt and resume tasks. The multitasking nature of spoken dialogues within Intelligent Environments is one of the main challenges since the switching among tasks may depend on the user input, the input from external entities, or on the task definition itself. In case of conflicts related to overlapping dialogue domains, a problem solving dialogue can be initiated. Moreover, based on the various tasks and the dialogue domains involved, the SDM is able to guide the user’s navigation through the inter- or independent spoken dialogue domains.
Several evaluation sessions have been carried out to proof the concept, to find out how users cope with a multitasking spoken dialogue, and to investigate how the model-based approach fosters the recognition and more specifically the understanding rate of the system. The thesis is carried out within the framework of the EU-funded Project ATRACO (Adaptive and TRusted Ambient eCOlogies ATRACO).
Research Interests
- Dialogue management and modelling
- Ambient Intelligent Environments
- HCI
- Usability
For a list of publications you may also visit Google Scholar Author.
Projects
ATRACO
roles: Project Manager, Scientific Responsible of Deliverable D22 - Adaptive Dialogue Management
A Companion-Technology for Cognitive Technical Systems, SFB/Transregio 62, DFG
role: Member of Project B1
S. Ultes, F. Nothdurft, T. Heinroth and W. Minker (Eds.)
Next Generation Intelligent Environments: Ambient Adaptive Systems
Springer International Publishing, In: S. Ultes, F. Nothdurft, T. Heinroth and W. Minker (Eds.) 2nd Edition, 2016
Link to Document
DOI
Bibtex
G. Pruvost, T. Heinroth, Y. Bellik and W. Minker
User Interaction Adaptation Within Ambient Environments
Next Generation Intelligent Environments, Springer, pp. 221--263, 2016
Bibtex
F. Nothdurft, S. Ultes and W. Minker
User-Centred Spoken Dialogue Management
Next Generation Intelligent Environments, Springer International Publishing, Cham, pp. 265--294, 2016
DOI
Bibtex
M. Schmidt, S. Werner and T. Heinroth
Herausforderungen der kombinierten Verwendung von On-Board- und Off-Board- Sprachdialogsystemen in Telematikeinheiten im Automobil
Studientexte zur Sprachkommunikation: Elektronische Sprachsignalverarbeitung 2013., TUDpress, Dresden, pp. 28--35, 2013
Bibtex
F. Nothdurft, T. Heinroth and W. Minker
The Impact of Explanation Dialogues on Human-Computer Trust
Human-Computer Interaction. Users and Contexts of Use, Springer, pp. 59--67, 2013
Bibtex
T. Heinroth and W. Minker
Introducing Spoken Dialogue Systems into Intelligent Environments
Springer, Boston (USA), 2013
Link to Document
Bibtex
T. Heinroth, M. Grotz, F. Nothdurft and W. Minker
Adaptive Speech Recognition for Intuitive Model-based Spoken Dialogues
Proceedings of the Eighth Conference on International Language Resources and Evaluation (LREC'12), 2012
Bibtex
H. Hagras, C. Wagner, A. Kameas, C. Goumopoulos, A. Meliones, L. Seremeti, Y. Bellik, G. Pruvost, T. Heinroth and W. Minker
Symbiotic Ecologies in Next Generation Ambient Intelligent Environments
International Journal of Next-Generation Computing, Vol. 3, Num. 1, 2012
Link to Document
Bibtex
T. Heinroth, S. Koleva and W. Minker
Topic Switching Strategies for Spoken Dialogue Systems
Proc. of the 12th Annual Conference of the International Speech Communication Association, Florence (Italy), August 2011
Link to Document
Bibtex
T. Heinroth, D. Denich and W. Minker
A Multitasking Approach to Adaptive Spoken Dialogue Management
Proceedings of the HCI International 2011, 2011
Bibtex
S. Ultes, T. Heinroth, A. Schmitt and W. Minker
A Theoretical Framework for a User-Centered Spoken Dialog Manager
Proceedings of the Paralinguistic Information and its Integration in Spoken Dialogue Systems Workshop, Springer New York, New York, NY, Granada, Spain, pp. 241--246, 2011
DOI
Bibtex
G. Pruvost, T. Heinroth, Y. Bellik and W. Minker
User Interaction Adaptation within Ambient Environments
Springer, Boston (USA), In: Next Generation Intelligent Environments: Ambient Adaptive Systems, Chapter 5, pp. 153-194, 2011
Bibtex
T. Heinroth, A. Kameas, G. Pruvost, L. Seremeti, Y. Bellik and W. Minker
Human-Computer Interaction in Next Generation Ambient Intelligent Environments
Intelligent Decision Technologies - Special Issue on Knowledge-based environments and services in HCI, Vol. 5, Num. 1, pp. 31--46, 2011
DOI
Bibtex
T. Heinroth and W. Minker (Eds.)
Next Generation Intelligent Environments: Ambient Adaptive Systems
Springer, Boston (USA), 2011
Link to Document
DOI
Bibtex
T. Heinroth and D. Denich
Spoken Interaction within the Computed World: Evaluation of a Multitasking Adaptive Spoken Dialogue System
35th Annual IEEE International Computer Software and Applications Conference (COMPSAC 2011), IEEE, 2011
Bibtex
A. Zgorzelski, A. Schmitt, T. Heinroth and W. Minker
Repair Strategies on Trial: Which Error Recovery Do Users Like Best?
Proc. of the International Conference on Speech and Language Processing (ICSLP), Makuhari (Japan), September 2010
Link to Document
Bibtex
W. Minker and T. Heinroth
Advanced Spoken Dialogue Management in Adaptive and Trusted Ambient Ecologies
Keynote at the 5th International Workshop on Artificial Intelligence Techniques for Ambient Intelligence (AITAmI'10), July 2010
Bibtex
F. Nothdurft, G. Bertrand, T. Heinroth and W. Minker
GEEDI - Guards for Emotional and Explanatory DIalogues
6th International Conference on Intelligent Environments (IE'10), Kuala Lumpur (Malaysia), July 2010
Link to Document
Bibtex
A. Schmitt, U. Tschaffon, T. Heinroth and W. Minker
Inter-Labeler Agreement for Anger Detection in Interactive Voice Response Systems
6th International Conference on Intelligent Environments (IE'10), Kuala Lumpur (Malaysia), July 2010
Link to Document
Bibtex
T. Heinroth, D. Denich, A. Schmitt and W. Minker
Efficient Spoken Dialogue Domain Representation and Interpretation
Proceedings of the Seventh Conference on International Language Resources and Evaluation (LREC'10), European Language Resources Association (ELRA), Valetta, Malta, May 2010
Link to Document
Bibtex
A. Schmitt, G. Bertrand, T. Heinroth, J. Liscombe and W. Minker
WITcHCRafT: A Workbench for Intelligent exploraTion of Human ComputeR conversaTions
International Conference on Language Resources and Evaluation (LREC), Valetta, Malta, May 2010
Link to Document
Bibtex
T. Heinroth, D. Denich and A. Schmitt
OwlSpeak - Adaptive Spoken Dialogue within Intelligent Environments
8th IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM Workshops), Mannheim (Germany), pp. 666 - 671, March 2010
Link to Document
DOI
Bibtex
J. Bidot, S. Biundo, T. Heinroth, W. Minker, F. Nothdurft and B. Schattenberg
Verbal Plan Explanations for Hybrid Planning
24th MKWI related PuK-Workshop: Planung/Scheduling und Konfigurieren/Entwerfen, Göttingen, February 2010
Link to Document
Bibtex
T. Heinroth, D. Denich and G. Bertrand
Ontology-based Spoken Dialogue Modelling
First International Workshop on Spoken Dialogue Systems (IWSDS), Kloster Irsee (Germany), December 2009
Bibtex
A. Kameas, C. Goumopoulos, H. Hagras, M. Gardner, T. Heinroth, W. Minker, A. Meliones, D. Economou, Y. Bellik and G. Pruvost
A Pervasive System Architecture that supports Adaptation using Agents and Ontologies
The 10th International Symposium on Pervasive Systems, Algorithms and Networks (I-SPAN), IEEE Computer Society, Los Alamitos, CA, USA, pp. 148-153, December 2009
Link to Document
DOI
Bibtex
Y. Bellik, A. Kameas, C. Goumopoulos, H. Hagras, T. Heinroth, G. Pruvost, A. Meliones, D. Economou, W. Minker and M. Gardner
Multidimensional Pervasive Adaptation into Ambient Intelligent Environments
DASC '09: Proceedings of the 2009 Eighth IEEE International Conference on Dependable, Autonomic and Secure Computing, IEEE Computer Society, Washington, DC, USA, pp. 303-308, December 2009
Link to Document
DOI
Bibtex
G. Pruvost, A. Kameas, T. Heinroth, L. Seremeti and W. Minker
Combining agents and ontologies to support task-centred interoperability in Ambient Intelligent Environments
Proceedings of the 2009 Ninth International Conference on Intelligent Systems Design and Applications (ISDA), IEEE Computer Society, Washington, DC, USA, pp. 55-60, November 2009
Link to Document
DOI
Bibtex
T. Heinroth, A. Schmitt and G. Bertrand
Enhancing Speech Dialogue Technologies for Ambient Intelligent Environments
5th International Conference on Intelligent Environments (IE'09), IOS Press, Barcelona (Spain), Series: Ambient Intelligence and Smart Environments, Vol. 2, pp. 42-49, July 2009
Link to Document
DOI
Bibtex
A. Schmitt, T. Heinroth and G. Bertrand
Towards Emotion, Age- and Gender-Aware VoiceXML Applications
5th International Conference on Intelligent Environments (IE’09), IOS Press, Barcelona (Spain), Series: Ambient Intelligence and Smart Environments, Vol. 2, pp. 34-41, July 2009
Link to Document
DOI
Bibtex
T. Heinroth, A. Kameas, H. Hagras and Y. Bellik
Semi-tacit Adaptation of Intelligent Environments
5th IFIP Conference on Artificial Intelligence Applications & Innovations (AIAI 2009), Thessaloniki (Greece), April 2009
Link to Document
DOI
Bibtex
T. Heinroth, A. Kameas, C. Wagner and Y. Bellik
A Proposal for Realizing Adaptive Ambient Ecologies through an ontology-based Multi-Agent System
2009 IEEE International Symposium on Intelligent Agents, Nashville (USA), March 2009
Link to Document
DOI
Bibtex
G. Bertrand, T. Heinroth and A. Schmitt
CHAD - Constraint Handling Architecture for Dialoguemanagement
5th International Conference on Intelligent Environments (IE'09), IOS Press, Barcelona (Spain), Series: Ambient Intelligence and Smart Environments, Vol. 2, pp. 50-56, 2009
Link to Document
DOI
Bibtex
A. Kameas, C. Goumopoulos, H. Hagras, T. Heinroth, M. Weber and V. Callaghan
An architecture that supports task centered adaptation in Intelligent Environments
Springer, Boston (USA), In: Advanced Intelligent Environments, Series: Lecture Notes in Electrical Engineering, pp. 41-70, 2009
Link to Document
DOI
Bibtex
W. Minker, T. Heinroth, P. Strauss and D. Zaykovskiy
Interaction in intelligent environments
Elsevier, In: Human-Centric Interfaces for Ambient Intelligence, Chapter 18, 2009
Link to Document
Bibtex
A. Schmitt, T. Heinroth and J. Liscombe
On NoMatchs, NoInputs and BargeIns: Do Non-Acoustic Features Support Anger Detection?
Proceedings of the SIGDIAL 2009 Conference, Association for Computational Linguistics, London, UK, pp. 128--131, 2009
Link to Document
Bibtex
T. Heinroth and D. Bühler
ArriGator - Evaluation of a Speech-based Pedestrian Navigation System
4th IET International Conference on Intelligent Environments, Seattle (USA), July 2008
Link to Document
DOI
Bibtex
P. Strauss, S. Friedmann and T. Heinroth
Discourse Motivated Constraint Prioritisation For Task-Oriented Multi-Party Dialogue Systems
12th Workshop on the Semantics and Pragmatics of Dialogue (Londial), London (United Kingdom), 2008
Link to Document
Bibtex
W. Minker, T. Heinroth, H. Hagras, A. Kameas, Y. Bellik, J. Helvert, C. Goumopoulos, B. Könings and A. Meliones
D03 - Third Technical Report
Confidential Deliverable, The ATRACO Project (FP7/2007-2013 grant agreement no 216837), 2010
Bibtex
W. Minker, T. Heinroth, A. Kameas, H. Hagras, J. Helvert, Y. Bellik, C. Goumopoulos and A. Meliones
D04 - Third Management Report
Confidential Deliverable, The ATRACO Project (FP7/2007-2013 grant agreement no 216837), 2010
Bibtex
W. Minker, T. Heinroth, A. Kameas, H. Hagras, J. Helvert, Y. Bellik, C. Goumopoulos and A. Meliones
D05 - Project Final Report
Public Deliverable, The ATRACO Project (FP7/2007-2013 grant agreement no 216837), 2010
Link to Document
Bibtex
C. Goumopoulos, I. Calemis, K. Togias, A. Kameas, G. Pruvost, C. Wagner, A. Meliones, B. Wiedersheim, J. Bidot, B. Könings and T. Heinroth
D07 - Integrated component platform for prototype testing and updated specification and design report
Restricted Deliverable, The ATRACO Project (FP7/2007-2013 grant agreement n° 216837), 2010
Bibtex
H. Hagras, C. Wagner, A. Bilgin, C. Goumopoulos, A. Kameas, Y. Bellik, J. Martin, G. Pruvost, N. Tan, A. Meliones, D. Economou, N. Papadopoulos, W. Minker and T. Heinroth
D13 - Research results on adaptation & evolution
Public Deliverable, The ATRACO Project (FP7/2007-2013 grant agreement no 216837), 2010
Link to Document
Bibtex
Y. Bellik, G. Pruvost, J. Martin, N. Tan, W. Minker and T. Heinroth
D16 - User Interaction Adaptation Component
Confidential Deliverable, The ATRACO Project (FP7/2007-2013 grant agreement no 216837), 2010
Bibtex
T. Heinroth and W. Minker
D22 - Adaptive Dialogue Manager
Confidential Deliverable, The ATRACO Project (FP7/2007-2013 grant agreement no 216837), 2010
Bibtex
A. Meliones, I. Grammatikakis, T. Heinroth, A. Kameas, H. Hagras and Y. Bellik
D29 - Dissemination, Collaboration and Exploitation Report
Public Deliverable, The ATRACO Project (FP7/2007-2013 grant agreement n° 216837), 2010
Link to Document
Bibtex
A. Meliones, I. Liverezas, D. Economou, C. Goumopoulos, A. Kameas, T. Heinroth, J. Bidot, B. Könings, H. Hagras, Y. Bellik and G. Pruvost
D30 - Final plan for use and dissemination of foreground developed in the project
Public Deliverable, The ATRACO Project (FP7/2007-2013 grant agreement n° 216837), 2010
Link to Document
Bibtex
A. Meliones, I. Liverezas, I. Karras, C. Goumopoulos, T. Heinroth, J. Helvert, H. Hagras, Y. Bellik and G. Pruvost
D31+D32 - Summary of Collaboration and Standardisation Activities and Horizontal Issues
Public Deliverable, The ATRACO Project (FP7/2007-2013 grant agreement n° 216837), 2010
Link to Document
Bibtex
A. Meliones, I. Grammatikakis, T. Heinroth, A. Kameas, H. Hagras and Y. Bellik
D29 - Dissemination, Collaboration and Exploitation Report
Public Deliverable, The ATRACO Project (FP7/2007-2013 grant agreement n° 216837), 2009
Link to Document
Bibtex
W. Minker, T. Heinroth, H. Hagras, A. Kameas, Y. Bellik, J. Helvert, C. Goumopoulos, B. Könings, J. Bidot and A. Meliones
D03 - Second Technical Report
Confidential Deliverable, The ATRACO Project (FP7/2007-2013 grant agreement no 216837), 2009
Bibtex
W. Minker, T. Heinroth, A. Kameas, H. Hagras, J. Helvert, Y. Bellik, C. Goumopoulos and A. Meliones
D04 - Second Management Report
Confidential Deliverable, The ATRACO Project (FP7/2007-2013 grant agreement no 216837), 2009
Bibtex
H. Hagras, C. Wagner, C. Goumopoulos, A. Kameas, Y. Bellik, J. Martin, G. Pruvost, N. Tan, A. Meliones, D. Economou, N. Papadopoulos, W. Minker and T. Heinroth
D13 - Research results on adaptation & evolution
Public Deliverable, The ATRACO Project (FP7/2007-2013 grant agreement no 216837), 2009
Link to Document
Bibtex
Y. Bellik, G. Pruvost, J. Martin, N. Tan, W. Minker and T. Heinroth
D16 - User Interaction Adaptation Component
Confidential Deliverable, The ATRACO Project (FP7/2007-2013 grant agreement no 216837), 2009
Bibtex
Y. Bellik, G. Pruvost, J. Martin, N. Tan, W. Minker and T. Heinroth
D19 - User Interaction Specification and Tools
Public Deliverable, The ATRACO Project (FP7/2007-2013 grant agreement no 216837), 2009
Link to Document
Bibtex
C. Goumopoulos, I. Calemis, K. Togias, A. Kameas, Y. Bellik, H. Hagras, T. Heinroth, G. Pruvost, C. Wagner and J. Bidot
D06 - System Specification and Architectural Design
Public Deliverable, The ATRACO Project (FP7/2007-2013 grant agreement n° 216837), 2008
Link to Document
Bibtex
D. Pavel, M. Gardner, C. Wagner, H. Hagras, A. Kameas, L. Seremeti, A. Meliones, Y. Bellik, G. Pruvost and T. Heinroth
D26 - Basic concepts and components setup
Public Deliverable, The ATRACO Project (FP7/2007-2013 grant agreement no 216837), 2008
Link to Document
Bibtex
A. Meliones, I. Grammatikakis, T. Heinroth, A. Kameas, H. Hagras and Y. Bellik
D29 - Dissemination, Collaboration and Exploitation Report
Public Deliverable, The ATRACO Project (FP7/2007-2013 grant agreement no 216837), 2008
Link to Document
Bibtex
W. Minker and T. Heinroth
D01 - Detailed Activity Plan
Confidential Deliverable, The ATRACO Project (FP7/2007-2013 grant agreement no 216837), 2008
Bibtex
W. Minker and T. Heinroth
D02 - Website and Groupware Description
Restricted Deliverable, The ATRACO Project (FP7/2007-2013 grant agreement no 216837), 2008
Bibtex
W. Minker and T. Heinroth
D03 - First Technical Report
Confidential Deliverable, The ATRACO Project (FP7/2007-2013 grant agreement no 216837), 2008
Bibtex
W. Minker, T. Heinroth, A. Kameas, H. Hagras, M. Gardner, Y. Bellik, C. Goumopoulos and A. Meliones
D04 - First Management Report
Confidential Deliverable, The ATRACO Project (FP7/2007-2013 grant agreement no 216837), 2008
Bibtex
W. Minker, T. Heinroth, A. Kameas, J. Bidot, C. Goumopoulos, L. Seremeti, Y. Bellik, H. Hagras, M. Gardner and A. Meliones
D11 - Requirements Analysis
Public Deliverable, The ATRACO Project (FP7/2007-2013 grant agreement no 216837), 2008
Link to Document
Bibtex
W. Minker, T. Heinroth, B. Wiedersheim and J. Bidot
D12 - Basic Components
Public Deliverable, The ATRACO Project (FP7/2007-2013 grant agreement no 216837), 2008
Link to Document
Bibtex
H. Hagras, C. Wagner, C. Goumopoulos, A. Kameas, Y. Bellik, J. Martin, G. Pruvost, N. Tan, W. Minker, T. Heinroth and A. Meliones
D13 - Research Results on Adaptation & Evolution
Public Deliverable, The ATRACO Project (FP7/2007-2013 grant agreement no 216837), 2008
Link to Document
Bibtex
Y. Bellik, G. Pruvost, J. Martin, N. Tan, W. Minker and T. Heinroth
D19 - User Interaction Specification and Tools
Public Deliverable, The ATRACO Project (FP7/2007-2013 grant agreement no 216837), 2008
Link to Document
Bibtex
Demos
ArriGator
Further information about my research concerning the usage of a speech dialogue system for pedestrian navigation.
Co-organized Conferences and Workshops
Program Committee:
ICMI'2012 14th ACM International Conference on Multimodal Interaction, October 23-26, 2012, Santa Monica, CA (USA)
IWSDS'2012 Workshop on Spoken Dialogue Systems, November 28-30, 2012, Castle of Ermenonville (France)
1st Artificial Intelligence in Education Workshop: Innovations and Applications (AIeIA 2012), September 27-30, 2012, Halkidiki (Greece)
8th International Conference on Intelligent Environments, June 26-29, 2012, Guanajuato (México)
2nd International Workshop on Human-Centric Interfaces for Ambient Intelligence, July 25-26. 2011, Nottingham Trent University, United Kingdom
35th Annual International Computer Software and Applications Conference (COMPSAC 2011), July 18-22, 2011, Munich, Germany
6th International Conference on Intelligent Environments, July 20-21, 2010, Monash University (Sunway campus), Kuala Lumpur, Malaysia
1st International Workshop on Human-Centric Interfaces for Ambient Intelligence (HCIAmI'10), July 19, 2010, Monash University (Sunway campus), Kuala Lumpur, Malaysia
Invited Reviewer:
ACM Transactions on Autonomous and Adaptive Systems; Special Issue on Pervasive Adaptation - Visions & Challenges
Lectures
W. Minker, T. Heinroth and A. Schmitt
Dialogue Success Estimation and Adaptive Spoken Dialogue Management
Graduate Course within the ERASMUS/SOCRATES Mobility Programme, Department of Computer Science, University of Granada (Spain), May 2011
W. Minker, T. Heinroth and G. Bertrand
Adaptive Spoken Dialogue Management within Intelligent Environments
Graduate Course within the ERASMUS/SOCRATES Mobility Programme, Department of Computer Science, University of Granada (Spain), May 2010
Supervised Theses
Master Thesis
Statistical Approaches for Adaptive Spoken Dialogue Management
2012
Link to Document
Master Thesis
Adaptivität und Sprache
2010
Link to Document
Master Thesis
Implementierung eines Sprachdialogmanagers zur Adaptiven Nutzung in Intelligenten Umgebungen
2010
Link to Document
Bachelor Thesis
Design and Implementation of a Tool for the Management and Maintenance of Transcription Databases
2009
Link to Document
Bachelor Thesis
Improvement of Speech Recognition Performance Based on a Two Pass Approach
2009
Link to Document
Master Thesis
Konzepte für sprachbedientes Internet-Browsing im Fahrzeug
2009
Link to Document
Master Thesis
Untersuchung von systeminitiierten Sprachdialogen im KFZ
2008
Link to Document
Master Thesis
Sprache und Planung
2008
Link to Document
Alumni