Dialogue Systems - Bi-National Research Activities

Since 2009 the Dialogue Systems Group has been hosting more than 50 Bachelor/Master Theses and Internship students from Russian partner universities to carry out their research projects. Between 2009 and 2021 this activity has been supported by DAAD Euler program and carried out under the auspices of the German-Russian Year of University Cooperation and Science 2018-2020. Some of the students are co-supervised by PhD candidates following one of the cooperative PhD programs established between these partner universities.

ITMO University

ITMO University is a large state university in Saint Petersburg and one of Russia's National Research Universities. ITMO University has been selected among 15 Russian universities to participate in the Russian Academic Excellence Project 5-100 by the government of the Russian Federation to improve international competitiveness among the world's leading research and educational centers.

Research priorities of ITMO University are concentrated in information and photonic technologies.

Since 2017 Professor Minker is serving as a Co-Director of the International Research Laboratory Multimodal Biometric and Speech Systems at ITMO University.

The following Master Theses and Internship projects have been co-supervised by Ulm University and ITMO University:

Embedded Aigaion Query 2023

Dialogue Systems Project
Concept Development of a Collaborative Multi-User Study using AR Glasses
2023
Supervisor: Nicolas Wagner

Dialogue Systems Project
Detection of False Arguments in an Argumentative Dialogue System (2/2)
2023
Student: Konstantin Mosunov
Supervisor: Annalena Aicher

Dialogue Systems Project
Emergent leadership recognition and dominance evaluation using audio cues only (2/2)
2023
Student: Nikita Khmelev
Supervisor: Denis Dresvyanskiy

Dialogue Systems Project
Entwicklung einer Android-Anwendung für ein asynchrones Sprachdialogsystem
2023
Supervisor: Nicolas Wagner

Dialogue Systems Project
Improving natural-language text classification in challenging conditions (2/2)
2023
Student: Kirill Abrosimov
Supervisor: Nikita Mamaev

Dialogue Systems Project
Stress detection using attention mechanism based on audio deep learning features (2/2)
2023
Student: Maxim Ryazanov
Supervisor: Danila Mamontov

Dialogue Systems Project
Stress detection using attention mechanism based on video deep learning features (2/2)
2023
Student: Ekaterina Shangina
Supervisor: Danila Mamontov

Dialogue Systems Project
The Combination of Retrieval and Generative Approaches for the Contextualized Dialogue Modeling (2/2)
2023
Student: Pavel Posokhov
Supervisor: Sergei Masluchin

Dialogue Systems Project
Time-continuous dominance estimation using visual social cues (2/2)
2023
Student: Philipp Shemetov
Supervisor: Denis Dresvyanskiy

Embedded Aigaion Query 2022

Master Thesis
Dominance ranking during the group discussion (Euler Program)
2022
Student: Anton Mitrofanov
Supervisor: Denis Dresvyanskiy

Master Thesis
Time-continuous engagement recognition by sequences of social signals during human-robot interaction (Euler Program)
2022
Student: Alexsander Rybin
Supervisor: Denis Dresvyanskiy

Embedded Aigaion Query 2021

Master Thesis
Assessment of the mood of users by voice in argumentative dialogue systems (Euler Program)
2021
Student: Alisa Gazizullina
Supervisor: Annalena Aicher

Master Thesis
Deep neural networks audio-based emotion recognition in naturalistic conversations (Euler Program)
2021
Student: Denis Kotov
Supervisor: Danila Mamontov

Master Thesis
Expressive and emotional speech generation (Euler Program)
2021
Student: Aleksei Svischev
Supervisor: Denis Dresvyanskiy

Master Thesis
Investigation of video-based features on time-continuous emotion recognition (Euler Program)
2021
Student: Elena Ryumina
Supervisor: Denis Dresvyanskiy

Master Thesis
Speech transcriptions for emotion recognition in naturalistic conversations (Euler Program)
2021
Student: Anastasia Dvoynikova
Supervisor: Danila Mamontov

Embedded Aigaion Query 2020

Master Thesis
Automatic assessment of the quality of arguments based on vector representations of words and semantic relations (Euler Program)
2020
Student: Artem Chirkovskii
Supervisor: Annalena Aicher

Master Thesis
Contextual text-based emotion recognition as a part of time-continuous multimodal system (Euler Program)
2020
Student: Taisiia Vinogradova
Supervisor: Dmitrii Fedotov

Master Thesis
Exploring data augmentation for evaluating semantic similarity (Euler Program)
2020
Student: Nikita Mamaev
Supervisor: Annalena Aicher

Master Thesis
Multicultural text-based emotion recognition (Euler Program)
2020
Student: Inna Lizunova
Supervisor: Dmitrii Fedotov

Embedded Aigaion Query 2019

Master Thesis
Autoregressive Exogenous Models for Time-Continuous Emotion Recognition (Euler Program)
2019
Student: Anastasiia Avdeeva
Supervisor: Dmitrii Fedotov

Master Thesis
Contextual Addressee Selection and Response Prediction in Multi-Party Conversations for Spoken Dialogue Systems (Euler Program)
2019
Student: Svetlana Mirzaianova
Supervisor: Oleg Akhtiamov

Master Thesis
Deep Learning Based Feature Representation for Multimodal Emotion Recognition (Euler Program)
2019
Student: Rostislav Makarov
Supervisor: Dmitrii Fedotov

Master Thesis
On Complementing Emotion Recognition in Dyadic Interactions (Euler Program)
2019
Student: Margarita Zakuanova
Supervisor: Dmitrii Fedotov

Embedded Aigaion Query 2018

Master Thesis
Analysis of emotional context in social networks for guidance systems improvement (Euler Program)
2018
Student: Aigul Nugmanova
Supervisor: Dmitrii Fedotov

Master Thesis
Deep Learning for Text-Based Addressee Detection (Euler Program)
2018
Student: Evgenii Lisitskii
Supervisor: Oleg Akhtiamov

Master Thesis
Gaze Direction Monitoring for Video-Based Addressee Detection (Euler Program)
2018
Student: Vasilii Palkov
Supervisor: Oleg Akhtiamov

Embedded Aigaion Query 2017

Master Thesis
Bayesian optimisation of LSTM networks for emotion recognition (Euler Program)
2017
Student: Oxana Verkholyak
Supervisor: Dmitrii Fedotov

Master Thesis
Deep Neural Network Applications for Acoustic Off-Talk Detection within an Automatic Spoken Dialogue System (Euler Program)
2017
Student: Alexei Pugachev
Supervisor: Oleg Akhtiamov

Master Thesis
N-Gram-Based Approaches to Text Processing for Off-Talk Detection in Automatic Spoken Dialogue Systems (Euler Program)
2017
Student: Evgeniia Feldina
Supervisor: Dmitrii Fedotov

Master Thesis
Recurrent neural network models for time-continuous multi-label emotion recognition (Euler Program)
2017
Student: Dmitrii Ubskii
Supervisor: Dmitrii Fedotov

Reshetnev Siberian State University of Science and Technology

Reshetnev University was established in May 2016 by merging of Reshetnev Siberian State Aerospace University and Siberian State Technological University. As a Flagship University it became a center of competences in the field of technical engineering education, a driver of technological and social economic development of the Krasnoyarsk region.

The following Bachelor/Master Theses have been co-supervised by Ulm University and Reshetnev University:

Embedded Aigaion Query 2016

Master Thesis
Automatic Emotion Recognition Based on Visual Cues using OpenCV (Euler Program)
2016
Student: Anastasiia Polyakova
Supervisor: Maxim Sidorov

Master Thesis
Comparison of the efficiency of classification algorithms for the Interaction Quality modelling for human-human conversations (Euler Program)
2016
Link to Document
Student: Olesya Vaskovskaya
Supervisor: Anastasiia Spirina

Bachelor Thesis
Implementation and Testing of Feature Selection Methods for Off-Talk Detection Based on Text Classification
2016
Link to Document
Student: Danila Mamontov
Supervisor: Oleg Akhtiamov

Bachelor Thesis
Implementation and Testing of Feature Transformation Methods for Off-Talk Detection Based on Text Classification
2016
Link to Document
Student: Diana Skripkina
Supervisor: Oleg Akhtiamov

Bachelor Thesis
Implementation and Testing of the Rocchio Algorithm for Off-Talk Detection Based on Text Classification
2016
Link to Document
Student: Denis Dresvyanskiy
Supervisor: Oleg Akhtiamov

Bachelor Thesis
Interaction Quality modelling for human-human conversations: significance of the dialogue parameter level
2016
Link to Document
Student: Tatiana Karaseva
Supervisor: Anastasiia Spirina

Bachelor Thesis
Interaction Quality modelling for human-human conversations: significance of the window and the dialogue parameter levels
2016
Link to Document
Student: Iana Polonskaia
Supervisor: Anastasiia Spirina

Bachelor Thesis
Interaction Quality modelling for human-human conversations: significance of the window parameter level
2016
Link to Document
Student: Alina Skorokhod
Supervisor: Anastasiia Spirina

Master Thesis
Neuroevolution Approach to Multimodal Emotion Recognition for Russian Language (Euler Program)
2016
Student: Dmitrii Fedotov
Supervisor: Maxim Sidorov

Master Thesis
Optimization of weights for term clustering in text classification (Euler Program)
2016
Link to Document
Student: Alexandra Koromyslova
Supervisor: Roman Sergienko

Master Thesis
Optimization of weights for voting in term weighting collectives for text classification (Euler Programme)
2016
Link to Document
Student: Yulia Kamshilova
Supervisor: Roman Sergienko

Master Thesis
The most informative features selection for the Interaction Quality modelling for human-human conversations (Euler program)
2016
Link to Document
Student: Uliana Kruglova
Supervisor: Anastasiia Spirina

Embedded Aigaion Query 2015

Master Thesis
Advanced Feature Selection Techniques for the Problem of Speech-based Emotion Recognition (Euler Program)
2015
Link to Document
Student: Oleg Akhtyamov
Supervisor: Maxim Sidotov

Master Thesis
Application of the Intelligent Data Analysis to Identify Agreement or Disagreement in Human-Human Conversation (Euler Program)
2015
Student: Ilia Ivanov
Supervisor: Anastasiia Spirina

Master Thesis
Application of the Intelligent Data Analysis to Identify the Roles of Humans in Human-Human Conversation (Euler Program)
2015
Student: Ilia Kaustov
Supervisor: Anastasiia Spirina

Master Thesis
Contextual Image Classification as a Support System for Multimodal Dialogue Analysis (Euler Program)
2015
Link to Document
Student: Ekaterina Bezhitskaya
Supervisor: Maxim Sidorov

Master Thesis
Fuzzy classification methods application for hierarchical conversation topic categorization (Euler Program)
2015
Link to Document
Student: Aiaz Kheirkhabarov
Supervisor: Roman Sergienko

Embedded Aigaion Query 2014

Master Thesis
A Novel Approach for the Speaker Diarization Problem (Euler Program)
2014
Student: Kristina Brester
Supervisor: Maxim Sidotov

Master Thesis
Advanced Machine Learning Techniques for Automatic Speaker Identification (Euler Program)
2014
Student: Dmitriy Khritonenko
Supervisor: Maxim Sidotov

Master Thesis
Analysing and Improving Interaction Quality Recognition (Euler Program)
2014
Link to Document
Student: Svetlana Volkova
Supervisor: Stefan Ultes

Master Thesis
Improving Anger Recognition Using Formants (Euler Program)
2014
Link to Document
Student: Vladimir Stanovov
Supervisor: Stefan Ultes

Master Thesis
Informative Features Selection Using Non-Parametric Model in Natural Language Call Routing (Euler Program)
2014
Link to Document
Student: Olga Semenkina
Supervisor: Tatiana Gasanova

Master Thesis
Natural Language Call Routing using Neural Network (Euler Program)
2014
Link to Document
Student: Shakhnaz Akhmedova
Supervisor: Tatiana Gasanova

Embedded Aigaion Query 2013

Master Thesis
Adaption Techniques for Automatic Recognition of Anger (Euler Program)
2013
Link to Document
Student: Andrey Marin
Supervisor: Stefan Ultes

Master Thesis
Collective of algorithms (Euler Program)
2013
Link to Document
Student: Sergey Marin
Supervisor: Tatiana Gasanova

Master Thesis
Dialogue model in user-centered or system-centered manner (Euler Program)
2013
Student: Lidia Golub
Supervisor: Stefan Ultes

Master Thesis
Fast and reliable automatic concatenation of Russian sub-word units (Euler Program)
2013
Student: Anastasiia Spirina
Supervisor: Sergey Zablotskiy

Master Thesis
Multi-objective evolutionary algorithms for unsupervised machine learning (Euler-Programm)
2013
Student: Vladimir Zvonkov
Supervisor: Tatiana Gasanova

Embedded Aigaion Query 2012

Master Thesis
Estimation of Shortfall Risk (Euler Program)
2012
Student: Arkadiy Strelnikov
Supervisor: Gunter Löffler

Master Thesis
Evolutionary Algorithms for Syllable Based Russian Language Modeling (Euler Program)
2012
Link to Document
Student: Maxim Sidorov
Supervisor: Sergey Zablotskiy

Master Thesis
Unsupervised fuzzy classifier (Euler Program)
2012
Link to Document
Student: Yuriy Smeshko
Supervisor: Tatiana Gasanova

Embedded Aigaion Query 2010

Master Thesis
Russian Phonetic Model for Large-Vocabulary ASR
2010
Student: Andrey Shablov
Supervisor: Sergey Zablotskiy

Master Thesis
Syllable Based Language Model for Russian
2010
Link to Document
Student: Alexandr Shvets
Supervisor: Sergey Zablotskiy

Master Thesis
Syllable Model for Large-Vocabulary ASR
2010
Student: Maria Semenkina
Supervisor: Sergey Zablotskiy

Embedded Aigaion Query 2009

Master Thesis
Language Model Designing for Russian ASR System
2009
Link to Document
Student: Konstantin Voloshchuk
Supervisor: Sergey Zablotskiy

Master Thesis
Neural Network Approach for Russian Speech Acoustic Modeling
2009
Link to Document
Student: Nadezhda Kaurova
Supervisor: Sergey Zablotskiy