Dr.-Ing. Sergey Zablotskiy

rgtabs: Main Menue

PhD Thesis

Topic

Hybrid Approaches for Language and Lexical Modeling in Speech Recognition

Status

completed

Description:

The goal of this thesis is the improvement of automatic speech recognition for highly inflective languages with a complex grammar, like Russian or German.

Large vocabulary continuous speech recognition (LVCSR) of such languages with rich morphology is considered to be a challenging task. Augmenting the full-word language model by fragments is a well-proven approach targeting this challenge and capable of recognizing missing words in the lexicon (so called open vocabulary recognition). Within the scope of this research Russian LVCSR System is built and various hybrid approaches for Lexical and Language Modeling are investigated.

Research Interests
  • Automatic Speech Recognition
  • Lexical and Language Modeling
  • Data Mining
  • Mathematical Modeling
  • Data-driven Optimization
Embedded Aigaion Query 2015

S. Zablotskiy and W. Minker
Sub-word language modeling for Russian LVCSR
Proceedings of the 17th International Conference, SPECOM, Athens, Greece, September 2015
Bibtex

2014

S. Zablotskiy and M. Sidorov
Russian Sub-Word Based Speech Recognition Using Pocketsphinx Engine
Proceedings of the 11th International Conference on Informatics in Control, Automation and Robotics (ICINCO), Vienna, Austria, Vol. 2, pp. 840-844, September 2014
Bibtex

2013

M. Sidorov, A. Schmitt, S. Zablotskiy and W. Minker
Survey of Automated Speaker Identification Methods
Proceedings of the Intelligent Environments Conference (IE), Athens, Greece, pp. 236-239, July 2013
Link to Document
Bibtex

M. Sidorov, S. Zablotskiy, W. Minker and E. Semenkin
Emotion recognition and speaker identification from speech
Bulletin of Siberian State Aerospace University named after academician M.F. Reshetnev, Vol. 4, Num. 50, pp. 139-144, 2013
Link to Document
Bibtex

A. Spirina, S. Zablotskiy and M. Sidorov
Two-steps system in searching similar words for fast and reliable automatic concatenation of Russian sub-word units
Bulletin of Siberian State Aerospace University named after academician M.F. Reshetnev, Vol. 4, Num. 50, pp. 144-148, 2013
Link to Document
Bibtex

2012

S. Zablotskiy, A. Shvets, M. Sidorov, E. Semenkin and W. Minker
Speech and Language Resources for LVCSR of Russian
International Conference on Language Resources and Evaluation (LREC), Istanbul, Turkey, pp. 3374-3377, May 2012
Link to Document
Bibtex

M. Sidorov, S. Zablotskiy, E. Semenkin and W. Minker
Evolutionary Design of Neural Networks for Forecasting of Financial Time Series
Bulletin of Siberian State Aerospace University named after academician M.F. Reshetnev, Vol. 4, Num. 44, pp. 106-110, 2012
Link to Document
Bibtex

K. Zablotskaya, S. Zablotskiy, F. Fernández-Martínez and W. Minker
Language Style Matching and Verbal Intelligence
Bulletin of Siberian State Aerospace University named after academician M.F. Reshetnev. In Press, 2012
Bibtex

2011

K. Zablotskaya, S. Zablotskiy, S. Walter and W. Minker
A Simple One-Way Analysis of Variance as a Way to Determine More Informative Features for Speech-Based User's Verbal Intelligence Estimation
14th International Conference on Speech and Computer (SPECOM2011), 2011
Bibtex

S. Zablotskiy, K. Zablotskaya and W. Minker
Automatic Pre-processing of the Russian Text Corpora for Language Modeling
14th International Conference on Speech and Computer (SPECOM2011), 2011
Bibtex

S. Zablotskiy, E. Semenkin and A. Shvets
Coevolutionary asymptotic genetic algorithm for syllable model based identification of sentences in automatic recognition of continuous speech (in Russian, abstract in English)
Bulletin of Siberian State Aerospace University named after academician M.F. Reshetnev, Vol. 3(36), pp. 20-25, 2011
Link to Document
Bibtex

K. Zablotskaya, U. Rahim, S. Zablotskiy, S. Walter and W. Minker
Conversation Peculiarities of People with Different Verbal Intelligence
IWSDS 2011: Workshop on Paralinguistic Information and its Integration in Spoken Dialogue Systems, 2011
Bibtex

S. Zablotskiy, T. Pitakrat, K. Zablotskaya and W. Minker
GMM Parameters Estimation by Means of EM and Genetic Algorithm
14th International Conference on Human-Computer Interaction, 2011
Bibtex

K. Zablotskaya, M. Abbas, S. Zablotskiy, S. Walter and W. Minker
Measuring Verbal Intelligence using Linguistic Analysis
The 7th International Conference on Intelligent Environments, 2011
Bibtex

S. Zablotskiy, T. Pitakrat, K. Zablotskaya and W. Minker
Optimal Operators of Hybrid Genetic Algorithm for GMM Parameter Estimation
Proceedings of the International Conference on Intelligent Environments (IE'11), Nottingham, UK, pp. 61-65, 2011
Bibtex

S. Zablotskiy, A. Shvets, E. Semenkin and W. Minker
Recognized Russian Syllables Concatenation by means of Co-Evolutionary Asymptotic Algorithm
14th International Conference on Speech and Computer (SPECOM2011), 2011
Bibtex

2010

K. Zablotskaya, S. Walter, S. Zablotskiy and W. Minker
Determination of Variables Significance Using Esimations of the First-Oder Partial Derivative
Scientific Journal of Siberian State Aerospace University named after academician M.F. Reshetnev, Vol. 5(31), pp. 30-33, December 2010
Link to Document
Bibtex

S. Zablotskiy, T. Müller and W. Minker
Estimation of Radio Signal Quality Degradation by Means of Neural Network and Non-Parametric Regression Model
Scientific Journal of Siberian State Aerospace University named after academician M.F. Reshetnev, Vol. 5(31), pp. 33-36, December 2010
Link to Document
Bibtex

K. Zablotskaya, M. Ahmed, S. Zablotskiy and W. Minker
Non-parametric Regression and Random Balance Method Modification for Determination of the Most Informative Features
The 6th International Conference on Intelligent Environments - IE'10, Kuala Lumpur, Malaysia, 2010
Bibtex

S. Zablotskiy, K. Zablotskaya and W. Minker
Some Approaches for Russian Speech Recognition
The 6th International Conference on Intelligent Environments - IE'10, Kuala Lumpur, Malaysia, 2010
Bibtex

2009

S. Zablotskiy, T. Müller and W. Minker
Perceptual Evaluation of Radio Signal Quality Degradation
5th International Conference on Intelligent Environments (IE'09), Barcelona (Spain), 2009
Link to Document
DOI
Bibtex

Embedded Aigaion Query 2013

W. Minker, F. Nothdurft, M. Sidorov and S. Zablotskiy
From Spoken Dialogue Systems to Trustworthy Companions
Presentations at Siberian Federal University and Siberian State Aerospace University, Krasnoyarsk (Russia), January 2013

2011

A. Schmitt, K. Zablotskaya, S. Zablotskiy and W. Minker
Research at Ulm University
Presentations at Siberian Federal University and Siberian State Aerospace University, Krasnoyarsk (Russia), December 2011

2010

S. Zablotskiy
Estimation of Radio Signal Quality Degradation by Means of Neural Network and Non-Parametric Regression Model
XII International Symposium on Nonparametric Methods in Cybernetics and System Analysis, Krasnoyarsk (Russia), September 2010

W. Minker, A. Schmitt, K. Zablotskaya and S. Zablotskiy
Technology Trends for Spoken Language Dialogue Systems
Presentations at Siberian Federal University and Siberian State Aerospace University, Krasnoyarsk (Russia), September 2010

Teaching Assistance
  • Dialogue Systems, WS 2008/2009
  • Dialogue Systems, WS 2009/2010
Lectures
Embedded Aigaion Query 2009

W. Minker, A. Schmitt and S. Zablotskiy
Spoken Language Dialogue Systems
Graduate Course within the ERASMUS/SOCRATES Mobility Programme, Department of Computer Science, University of Warsaw (Poland), May 2009

Open Topics
Embedded Aigaion Query
In Progress / Completed
Embedded Aigaion Query 2013

Master Thesis
Fast and reliable automatic concatenation of Russian sub-word units (Euler Program)
2013

2012

Master Thesis
Evolutionary Algorithms for Syllable Based Russian Language Modeling (Euler Program)
2012
Link to Document

2010

Master Thesis
Russian Phonetic Model for Large-Vocabulary ASR
2010

Master Thesis
Syllable Based Language Model for Russian
2010
Link to Document

Master Thesis
Syllable Model for Large-Vocabulary ASR
2010

2009

Bachelor Thesis
Evaluating and Improving OOV Models in Speech Recognition
2009
Link to Document

Master Thesis
Language Model Designing for Russian ASR System
2009
Link to Document

Master Thesis
Neural Network Approach for Russian Speech Acoustic Modeling
2009
Link to Document

Bachelor Thesis
Non-native Pronunciation Modeling through HMM Acoustic Model Structure
2009
Link to Document

Master Thesis
Parameters Estimation of Continuous Hidden Markov Acoustic Model by Means of Genetic Algorithm
2009
Link to Document

Alumni

Dr.-Ing. Sergey Zablotskiy

Sergey Zablotskiy
Dr.-Ing. Sergey Zablotskiy
Graduation Date: 17.12.2015
First Employment: Gigatronik Technologies, Germany

Former Homepage

ITDS (2011)