Dialogue Systems - Bi-National Research Activities

Since 2009 the Dialogue Systems Group has been hosting more than 50 Bachelor and Master Thesis students from Russian partner universities to carry out their final research projects. This activity is being supported by DAAD Euler program and carried out under the auspices of the German-Russian Year of University Cooperation and Science 2018-2020. Some of the students are co-supervised by PhD candidates following one of the cooperative PhD programs established between these partner universities.

ITMO University

ITMO University is a large state university in Saint Petersburg and one of Russia's National Research Universities. ITMO University has been selected among 15 Russian universities to participate in the Russian Academic Excellence Project 5-100 by the government of the Russian Federation to improve international competitiveness among the world's leading research and educational centers.

Research priorities of ITMO University are concentrated in information and photonic technologies.

Since 2017 Professor Minker is serving as a Co-Director of the International Research Laboratory Multimodal Biometric and Speech Systems at ITMO University.

The following final research projects have been co-supervised by Ulm University and ITMO University:

2020

Embedded Aigaion Query 2020

Master Thesis
Automatic assessment of the quality of arguments based on vector representations of words and semantic relations (Euler Program)
2020
Student: Artem Chirkovskii
Supervisor: Annalena Aicher

Master Thesis
Contextual text-based emotion recognition as a part of time-continuous multimodal system (Euler Program)
2020
Student: Taisiia Vinogradova
Supervisor: Dmitrii Fedotov

Master Thesis
Exploring data augmentation for evaluating semantic similarity (Euler Program)
2020
Student: Nikita Mamaev
Supervisor: Annalena Aicher

Master Thesis
Multicultural text-based emotion recognition (Euler Program)
2020
Student: Inna Lizunova
Supervisor: Dmitrii Fedotov

2019

Embedded Aigaion Query 2019

Master Thesis
Autoregressive Exogenous Models for Time-Continuous Emotion Recognition (Euler Program)
2019
Student: Anastasiia Avdeeva
Supervisor: Dmitrii Fedotov

Master Thesis
Contextual addressee selection and response prediction in multi-party conversations for spoken dialogue systems (Euler Program)
2019
Student: Svetlana Mirzaianova
Supervisor: Oleg Akhtiamov

Master Thesis
Cross-corpus data augmentation for acoustic addressee detection (Euler Program)
2019
Student: Yuri Agafonow
Supervisor: Oleg Akhtiamov

Master Thesis
Deep Learning Based Feature Representation for Multimodal Emotion Recognition (Euler Program)
2019
Student: Rostislav Makarov
Supervisor: Dmitrii Fedotov

Master Thesis
On Complementing Emotion Recognition in Dyadic Interactions (Euler Program)
2019
Student: Margarita Zakuanova
Supervisor: Dmitrii Fedotov

2018

Embedded Aigaion Query 2018

Master Thesis
Analysis of emotional context in social networks for guidance systems improvement (Euler Program)
2018
Student: Aigul Nugmanova
Supervisor: Dmitrii Fedotov

Master Thesis
Deep learning for text-based addressee detection (Euler Program)
2018
Student: Evgenii Lisitskii
Supervisor: Oleg Akhtiamov

Master Thesis
Gaze direction monitoring for addressee detection (Euler Program)
2018
Student: Vasilii Palkov
Supervisor: Oleg Akhtiamov

2017

Embedded Aigaion Query 2017

Master Thesis
A deep neural network application for acoustic off-talk detection within an automatic spoken dialogue system (Euler Program)
2017
Student: Alexei Pugachev
Supervisor: Oleg Akhtiamov

Master Thesis
Bayesian optimisation of LSTM networks for emotion recognition (Euler Program)
2017
Student: Oxana Verkholyak
Supervisor: Dmitrii Fedotov

Master Thesis
N-gram-based approaches to text processing for off-talk detection in automatic spoken dialogue systems (Euler Program)
2017
Student: Evgeniia Feldina
Supervisor: Dmitrii Fedotov

Master Thesis
Recurrent neural network models for time-continuous multi-label emotion recognition (Euler Program)
2017
Student: Dmitrii Ubskii
Supervisor: Dmitrii Fedotov

Reshetnev Siberian State University of Science and Technology

Reshetnev University was established in May 2016 by merging of Reshetnev Siberian State Aerospace University and Siberian State Technological University. As a Flagship University it became a center of competences in the field of technical engineering education, a driver of technological and social economic development of the Krasnoyarsk region.

The following final research projects have been co-supervised by Ulm University and Reshetnev University:

2016

Embedded Aigaion Query 2016

Master Thesis
Automatic Emotion Recognition Based on Visual Cues using OpenCV (Euler Program)
2016
Student: Anastasiia Polyakova
Supervisor: Maxim Sidorov

Master Thesis
Comparison of the efficiency of classification algorithms for the Interaction Quality modelling for human-human conversations (Euler Program)
2016
Link to Document
Student: Olesya Vaskovskaya
Supervisor: Anastasiia Spirina

Bachelor Thesis
Implementation and testing of a feature selection method for the off-talk detection based on text classification
2016
Link to Document
Student: Danila Mamontov
Supervisor: Oleg Akhtiamov

Bachelor Thesis
Implementation and testing of a feature transformation method for the off-talk detection based on text classification
2016
Link to Document
Student: Diana Skripkina
Supervisor: Oleg Akhtiamov

Bachelor Thesis
Implementation and testing of the Rocchio algorithm for the off-talk detection based on text classification
2016
Link to Document
Student: Denis Dresvyanskiy
Supervisor: Oleg Akhtiamov

Bachelor Thesis
Interaction Quality modelling for human-human conversations: significance of the dialogue parameter level
2016
Link to Document
Student: Tatiana Karaseva
Supervisor: Anastasiia Spirina

Bachelor Thesis
Interaction Quality modelling for human-human conversations: significance of the window and the dialogue parameter levels
2016
Link to Document
Student: Iana Polonskaia
Supervisor: Anastasiia Spirina

Bachelor Thesis
Interaction Quality modelling for human-human conversations: significance of the window parameter level
2016
Link to Document
Student: Alina Skorokhod
Supervisor: Anastasiia Spirina

Master Thesis
Neuroevolution Approach to Multimodal Emotion Recognition for Russian Language (Euler Program)
2016
Student: Dmitrii Fedotov
Supervisor: Maxim Sidorov

Master Thesis
Optimization of weights for term clustering in text classification (Euler Program)
2016
Link to Document
Student: Alexandra Koromyslova
Supervisor: Roman Sergienko

Master Thesis
Optimization of weights for voting in term weighting collectives for text classification (Euler Programme)
2016
Link to Document
Student: Yulia Kamshilova
Supervisor: Roman Sergienko

Master Thesis
The most informative features selection for the Interaction Quality modelling for human-human conversations (Euler program)
2016
Link to Document
Student: Uliana Kruglova
Supervisor: Anastasiia Spirina

2015

Embedded Aigaion Query 2015

Master Thesis
Advanced Feature Selection Techniques for the Problem of Speech-based Emotion Recognition (Euler Program)
2015
Link to Document
Student: Oleg Akhtyamov
Supervisor: Maxim Sidotov

Master Thesis
Application of the Intelligent Data Analysis to Identify Agreement or Disagreement in Human-Human Conversation (Euler Program)
2015
Student: Ilia Ivanov
Supervisor: Anastasiia Spirina

Master Thesis
Application of the Intelligent Data Analysis to Identify the Roles of Humans in Human-Human Conversation (Euler Program)
2015
Student: Ilia Kaustov
Supervisor: Anastasiia Spirina

Master Thesis
Contextual Image Classification as a Support System for Multimodal Dialogue Analysis (Euler Program)
2015
Link to Document
Student: Ekaterina Bezhitskaya
Supervisor: Maxim Sidorov

Master Thesis
Fuzzy classification methods application for hierarchical conversation topic categorization (Euler Program)
2015
Link to Document
Student: Aiaz Kheirkhabarov
Supervisor: Roman Sergienko

2014

Embedded Aigaion Query 2014

Master Thesis
A Novel Approach for the Speaker Diarization Problem (Euler Program)
2014
Student: Kristina Brester
Supervisor: Maxim Sidotov

Master Thesis
Advanced Machine Learning Techniques for Automatic Speaker Identification (Euler Program)
2014
Student: Dmitriy Khritonenko
Supervisor: Maxim Sidotov

Master Thesis
Analysing and Improving Interaction Quality Recognition (Euler Program)
2014
Link to Document
Student: Svetlana Volkova
Supervisor: Stefan Ultes

Master Thesis
Improving Anger Recognition Using Formants (Euler Program)
2014
Link to Document
Student: Vladimir Stanovov
Supervisor: Stefan Ultes

Master Thesis
Informative Features Selection Using Non-Parametric Model in Natural Language Call Routing (Euler Program)
2014
Link to Document
Student: Olga Semenkina
Supervisor: Tatiana Gasanova

Master Thesis
Natural Language Call Routing using Neural Network (Euler Program)
2014
Link to Document
Student: Shakhnaz Akhmedova
Supervisor: Tatiana Gasanova

2013

Embedded Aigaion Query 2013

Master Thesis
Adaption Techniques for Automatic Recognition of Anger (Euler Program)
2013
Link to Document
Student: Andrey Marin
Supervisor: Stefan Ultes

Master Thesis
Collective of algorithms (Euler Program)
2013
Link to Document
Student: Sergey Marin
Supervisor: Tatiana Gasanova

Master Thesis
Dialogue model in user-centered or system-centered manner (Euler Program)
2013
Student: Lidia Golub
Supervisor: Stefan Ultes

Master Thesis
Fast and reliable automatic concatenation of Russian sub-word units (Euler Program)
2013
Student: Anastasiia Spirina
Supervisor: Sergey Zablotskiy

Master Thesis
Multi-objective evolutionary algorithms for unsupervised machine learning (Euler-Programm)
2013
Student: Vladimir Zvonkov
Supervisor: Tatiana Gasanova

2012

Embedded Aigaion Query 2012

Master Thesis
Estimation of Shortfall Risk (Euler Program)
2012
Student: Arkadiy Strelnikov
Supervisor: Gunter Löffler

Master Thesis
Evolutionary Algorithms for Syllable Based Russian Language Modeling (Euler Program)
2012
Link to Document
Student: Maxim Sidorov
Supervisor: Sergey Zablotskiy

Master Thesis
Unsupervised fuzzy classifier (Euler Program)
2012
Link to Document
Student: Yuriy Smeshko
Supervisor: Tatiana Gasanova

2010

Embedded Aigaion Query 2010

Master Thesis
Russian Phonetic Model for Large-Vocabulary ASR
2010
Student: Andrey Shablov
Supervisor: Sergey Zablotskiy

Master Thesis
Syllable Based Language Model for Russian
2010
Link to Document
Student: Alexandr Shvets
Supervisor: Sergey Zablotskiy

Master Thesis
Syllable Model for Large-Vocabulary ASR
2010
Student: Maria Semenkina
Supervisor: Sergey Zablotskiy

2009

Embedded Aigaion Query 2009

Master Thesis
Language Model Designing for Russian ASR System
2009
Link to Document
Student: Konstantin Voloshchuk
Supervisor: Sergey Zablotskiy

Master Thesis
Neural Network Approach for Russian Speech Acoustic Modeling
2009
Link to Document
Student: Nadezhda Kaurova
Supervisor: Sergey Zablotskiy