<?xml version="1.0" encoding="UTF-8"?><?xml-stylesheet type="text/xsl" href="static/style.xsl"?><OAI-PMH xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/ http://www.openarchives.org/OAI/2.0/OAI-PMH.xsd"><responseDate>2026-11-22T23:33:33Z</responseDate><request verb="GetRecord" identifier="oai:uwspace.uwaterloo.ca:10012/15042" metadataPrefix="dim">https://dspacemainprd01.lib.uwaterloo.ca/server/oai/request</request><GetRecord><record><header><identifier>oai:uwspace.uwaterloo.ca:10012/15042</identifier><datestamp>2025-03-26T23:36:06Z</datestamp><setSpec>com_10012_9900</setSpec><setSpec>com_10012_1</setSpec><setSpec>col_10012_9908</setSpec><setSpec>col_10012_6</setSpec></header><metadata><dim:dim xmlns:dim="http://www.dspace.org/xmlns/dspace/dim" xmlns:doc="http://www.lyncode.com/xoai" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.dspace.org/xmlns/dspace/dim http://www.dspace.org/schema/dim.xsd">
   <dim:field mdschema="dc" element="contributor" qualifier="advisor">Tripunitara, Mahesh</dim:field>
   <dim:field mdschema="dc" element="contributor" qualifier="author" authority="c54f095a-4658-46b9-afef-df205fabf045" confidence="600">Song, Haobei</dim:field>
   <dim:field mdschema="dc" element="date" qualifier="accessioned">2019-09-12T17:41:34Z</dim:field>
   <dim:field mdschema="dc" element="date" qualifier="available">2019-09-12T17:41:34Z</dim:field>
   <dim:field mdschema="dc" element="date" qualifier="issued">2019-09-12</dim:field>
   <dim:field mdschema="dc" element="date" qualifier="submitted">2019-09-05</dim:field>
   <dim:field mdschema="dc" element="identifier" qualifier="uri">http://hdl.handle.net/10012/15042</dim:field>
   <dim:field mdschema="dc" element="description" qualifier="abstract" lang="en">The exploration/exploitation dilemma is a fundamental but often computationally intractable problem in reinforcement learning. The dilemma also impacts data efficiency which can be pivotal when the interactions between the agent and the environment are constrained. Traditional optimal control theory has some notion of objective criterion, such as regret, maximizing which results in optimal exploration and exploitation. This approach has been successful in multi-armed bandit problem but becomes impractical and mostly intractable to compute for multi-state problems. For complex problems with large state space when function approximation is applied, exploration/exploitation during each interaction is in practice generally decided in an ad hoc approach with heavy parameter tuning, such as ε-greedy. Inspired by different research communities, optimal learning strives to find the optimal balance between exploration and exploitation by applying principles from optimal control theory.&#xd;
The contribution of this thesis consists of two parts: 1. to establish a theoretical framework of optimal learning based on reinforcement learning in a stochastic (non-Markovian) decision process and through the lens of optimal learning unify the Bayesian (model-based) reinforcement learning and the partially observable reinforcement learning. 2. to improve existing reinforcement learning algorithms in the optimal learning view and the improved algorithms will be referred to as approximate optimal learning algorithms.&#xd;
Three classes of approximate optimal learning algorithms are proposed drawing from the following principles respectively:&#xd;
(1) Approximate Bayesian inference explicitly by training a recurrent neural network en- tangled with a feed forward neural network;&#xd;
(2) Approximate Bayesian inference implicitly by training and sampling from a pool of prediction neural networks as dynamics models;&#xd;
(3) Use memory based recurrent neural network to extract features from observations. Empirical evidence is provided to show the improvement of the proposed algorithms.</dim:field>
   <dim:field mdschema="dc" element="language" qualifier="iso" lang="en">en</dim:field>
   <dim:field mdschema="dc" element="publisher" lang="en">University of Waterloo</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">reinforcement learning</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">machine learning</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">exploration</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">exploitation</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">optimal learning</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">Bayesian reinforcement learning</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">model based reinforcement learning</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">neural network</dim:field>
   <dim:field mdschema="dc" element="title" lang="en">Optimal Learning Theory and Approximate Optimal Learning Algorithms</dim:field>
   <dim:field mdschema="dc" element="type" lang="en">Master Thesis</dim:field>
   <dim:field mdschema="dc" element="pending">false</dim:field>
   <dim:field mdschema="uws-etd" element="degree" qualifier="department" lang="en">Electrical and Computer Engineering</dim:field>
   <dim:field mdschema="uws-etd" element="degree" qualifier="discipline" lang="en">Electrical and Computer Engineering</dim:field>
   <dim:field mdschema="uws-etd" element="degree" qualifier="grantor" lang="en">University of Waterloo</dim:field>
   <dim:field mdschema="uws-etd" element="degree" lang="en">Master of Applied Science</dim:field>
   <dim:field mdschema="uws" element="contributor" qualifier="advisor">Tripunitara, Mahesh</dim:field>
   <dim:field mdschema="uws" element="contributor" qualifier="affiliation1" lang="en">Faculty of Engineering</dim:field>
   <dim:field mdschema="uws" element="published" qualifier="city" lang="en">Waterloo</dim:field>
   <dim:field mdschema="uws" element="published" qualifier="country" lang="en">Canada</dim:field>
   <dim:field mdschema="uws" element="published" qualifier="province" lang="en">Ontario</dim:field>
   <dim:field mdschema="uws" element="typeOfResource" lang="en">Text</dim:field>
   <dim:field mdschema="uws" element="peerReviewStatus" lang="en">Unreviewed</dim:field>
   <dim:field mdschema="uws" element="scholarLevel" lang="en">Graduate</dim:field>
   <dim:field mdschema="others" element="access-status">open.access</dim:field>
</dim:dim>
</metadata></record></GetRecord></OAI-PMH>