<?xml version="1.0" encoding="UTF-8"?><?xml-stylesheet type="text/xsl" href="static/style.xsl"?><OAI-PMH xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/ http://www.openarchives.org/OAI/2.0/OAI-PMH.xsd"><responseDate>2026-11-22T21:29:23Z</responseDate><request verb="GetRecord" identifier="oai:uwspace.uwaterloo.ca:10012/9061" metadataPrefix="dim">https://dspacemainprd01.lib.uwaterloo.ca/server/oai/request</request><GetRecord><record><header><identifier>oai:uwspace.uwaterloo.ca:10012/9061</identifier><datestamp>2024-07-31T07:02:11Z</datestamp><setSpec>com_10012_9900</setSpec><setSpec>com_10012_1</setSpec><setSpec>col_10012_9908</setSpec><setSpec>col_10012_6</setSpec></header><metadata><dim:dim xmlns:dim="http://www.dspace.org/xmlns/dspace/dim" xmlns:doc="http://www.lyncode.com/xoai" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.dspace.org/xmlns/dspace/dim http://www.dspace.org/schema/dim.xsd">
   <dim:field mdschema="dc" element="contributor" qualifier="author" authority="ac5653e9-b904-4844-b753-fa1c2857d7f9" confidence="600">Romdhani, Sihem</dim:field>
   <dim:field mdschema="dc" element="date" qualifier="accessioned">2015-01-14T13:55:21Z</dim:field>
   <dim:field mdschema="dc" element="date" qualifier="available">2015-01-14T13:55:21Z</dim:field>
   <dim:field mdschema="dc" element="date" qualifier="issued">2015-01-14</dim:field>
   <dim:field mdschema="dc" element="date" qualifier="submitted">2014</dim:field>
   <dim:field mdschema="dc" element="identifier" qualifier="uri">http://hdl.handle.net/10012/9061</dim:field>
   <dim:field mdschema="dc" element="description" qualifier="abstract" lang="en">Gaussian Mixture Model-Hidden Markov Models (GMM-HMMs) are the state-of-the-art for acoustic modeling in speech recognition. HMMs are used to model the sequential structure and the temporal variability in speech signals. However, GMMs are used to model the local spectral variability in the sound wave at each HMM state.  Attempts to use Artificial Neural Networks (ANNs) to substitute GMMs in HMM-based acoustic models  led to dismal results for many years. In fact,  ANNs could not significantly outperform GMMs due to their  shallow architectures. In addition, it was difficult to train networks with many hidden layers on large amount of data using the back-propagation learning algorithm.&#xd;
&#xd;
In recent years, with the establishment of deep learning technique, ANNs with many hidden layers have been reintroduced as an alternative to GMMs in  acoustic modeling, and have shown successful results.  The deep learning technique consists of a two-phase procedure. First, the ANN is generatively pre-trained using  an unsupervised learning algorithm. Then, it is discriminatively fine-tuned using the  back-propagation learning algorithm. The generative pre-training intends to initialize the weights of the network for better generalization performance  during the discriminative phase.  Combining Deep Neural Networks (DNNs) and HMMs within a single hybrid architecture for acoustic modeling have shown promising results in many speech recognition tasks.&#xd;
This thesis aims to empirically confirm the capability of DNNs to outperform GMMs in acoustic modeling.  It also provides a systematic procedure to implement DNN-HMM acoustic models for phoneme recognition, including the implementation of a GMM-HMM baseline system.&#xd;
&#xd;
This thesis starts by providing a thorough overview of the fundamentals and background of speech recognition. The thesis then discusses DNN architecture and learning technique. In addition, the problems of GMMs and the advantages of DNNs in acoustic modeling are discussed.  Finally, DNN-HMM hybrid  acoustic modes for phoneme recognition are implemented. The deployed DNN is  generatively pre-trained and fine-tuned to produce a posterior distribution over the states of  mono-phone HMMs.  The developed DNN-HMM phoneme recognition system  outperform the GMM-HMM baseline on the TIMIT core test set.  An in-depth investigation into the major factors behind the success of DNNs  is carried out.</dim:field>
   <dim:field mdschema="dc" element="language" qualifier="iso" lang="en">en</dim:field>
   <dim:field mdschema="dc" element="publisher" lang="en">University of Waterloo</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">Deep Neural Network</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">Acoustic Model</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">Automatic Speech Recognition</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">Phoneme Recognition</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">GMM-HMM</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">DNN</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">ASR</dim:field>
   <dim:field mdschema="dc" element="subject" qualifier="program" lang="en">Electrical and Computer Engineering</dim:field>
   <dim:field mdschema="dc" element="title" lang="en">Implementation of DNN-HMM Acoustic Models for Phoneme Recognition</dim:field>
   <dim:field mdschema="dc" element="type" lang="en">Master Thesis</dim:field>
   <dim:field mdschema="dc" element="pending">false</dim:field>
   <dim:field mdschema="uws-etd" element="degree" qualifier="department" lang="en">Electrical and Computer Engineering</dim:field>
   <dim:field mdschema="uws-etd" element="degree" lang="en">Master of Applied Science</dim:field>
   <dim:field mdschema="uws" element="typeOfResource" lang="en">Text</dim:field>
   <dim:field mdschema="uws" element="peerReviewStatus" lang="en">Unreviewed</dim:field>
   <dim:field mdschema="uws" element="scholarLevel" lang="en">Graduate</dim:field>
   <dim:field mdschema="others" element="access-status">open.access</dim:field>
</dim:dim>
</metadata></record></GetRecord></OAI-PMH>