<?xml version="1.0" encoding="UTF-8"?><?xml-stylesheet type="text/xsl" href="static/style.xsl"?><OAI-PMH xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/ http://www.openarchives.org/OAI/2.0/OAI-PMH.xsd"><responseDate>2026-11-22T21:51:42Z</responseDate><request verb="GetRecord" identifier="oai:uwspace.uwaterloo.ca:10012/4213" metadataPrefix="dim">https://dspacemainprd01.lib.uwaterloo.ca/server/oai/request</request><GetRecord><record><header><identifier>oai:uwspace.uwaterloo.ca:10012/4213</identifier><datestamp>2017-03-21T17:13:40Z</datestamp><setSpec>com_10012_9900</setSpec><setSpec>com_10012_1</setSpec><setSpec>col_10012_9914</setSpec><setSpec>col_10012_6</setSpec></header><metadata><dim:dim xmlns:dim="http://www.dspace.org/xmlns/dspace/dim" xmlns:doc="http://www.lyncode.com/xoai" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.dspace.org/xmlns/dspace/dim http://www.dspace.org/schema/dim.xsd">
   <dim:field mdschema="dc" element="contributor" qualifier="author" authority="32a53b55-3559-4660-a834-1bd0250772b2" confidence="600">Mahootchi, Masoud</dim:field>
   <dim:field mdschema="dc" element="date" qualifier="accessioned">2009-01-21T21:11:13Z</dim:field>
   <dim:field mdschema="dc" element="date" qualifier="available">2009-01-21T21:11:13Z</dim:field>
   <dim:field mdschema="dc" element="date" qualifier="issued">2009-01-21T21:11:13Z</dim:field>
   <dim:field mdschema="dc" element="date" qualifier="submitted">2009</dim:field>
   <dim:field mdschema="dc" element="identifier" qualifier="uri">http://hdl.handle.net/10012/4213</dim:field>
   <dim:field mdschema="dc" element="description" qualifier="abstract" lang="en">In this thesis, modeling and optimization in the field of storage management under&#xd;
stochastic condition will be investigated using two different methodologies: Simulation&#xd;
Optimization Techniques (SOT), which are usually categorized in the area of Reinforcement&#xd;
Learning (RL), and Nonlinear Modeling Techniques (NMT).&#xd;
For the first set of methods, simulation plays a fundamental role in evaluating the control&#xd;
policy: learning techniques are used to deliver sub-optimal policies at the end of a&#xd;
learning process. These iterative methods use the interaction of agents with the stochastic&#xd;
environment through taking actions and observing different states. To converge to&#xd;
the steady-state condition where policies and value functions do not change significantly&#xd;
with the continuation of the learning process, all or most important states must be visited&#xd;
sufficiently. This might be prohibitively time-consuming for large-scale problems.&#xd;
To make these techniques more efficient both in terms of computation time and robust&#xd;
optimal policies, the idea of Opposition-Based Learning (OBL-Type I and Type II) is&#xd;
employed to modify/extend popular RL techniques including Q-Learning, Q(λ), sarsa,&#xd;
and sarsa(λ). Several new algorithms are developed using this idea. It is also illustrated&#xd;
that, function approximation techniques such as neural networks can contribute to the&#xd;
process of learning. The state-of-the-art implementations usually consider the maximization&#xd;
of expected value of accumulated reward. Extending these techniques to consider&#xd;
risk and solving some well-known control problems are important contributions of this&#xd;
thesis.&#xd;
Furthermore, the new nonlinear modeling for reservoir management using indicator functions&#xd;
and randomized policy introduced by Fletcher and Ponnambalam, is extended to&#xd;
stochastic releases in multi-reservoir systems. In this extension, two different approaches&#xd;
for defining the release policies are proposed. In addition, the main restriction of considering&#xd;
the normal distribution for inflow is relaxed by using a beta-equivalent general&#xd;
distribution. A five-reservoir case study from India is used to demonstrate the benefits&#xd;
of these new developments. Using a warehouse management problem as an example,&#xd;
application of the proposed method to other storage management problems is outlined.</dim:field>
   <dim:field mdschema="dc" element="language" qualifier="iso" lang="en">en</dim:field>
   <dim:field mdschema="dc" element="publisher" lang="en">University of Waterloo</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">reinforcement learning</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">nonlinear models</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">storage management</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">reservoir management</dim:field>
   <dim:field mdschema="dc" element="subject" qualifier="program" lang="en">System Design Engineering</dim:field>
   <dim:field mdschema="dc" element="title" lang="en">Storage System Management Using Reinforcement Learning Techniques and Nonlinear Models</dim:field>
   <dim:field mdschema="dc" element="type" lang="en">Doctoral Thesis</dim:field>
   <dim:field mdschema="dc" element="pending" lang="en">false</dim:field>
   <dim:field mdschema="uws-etd" element="degree" qualifier="department" lang="en">Systems Design Engineering</dim:field>
   <dim:field mdschema="uws-etd" element="degree" lang="en">Doctor of Philosophy</dim:field>
   <dim:field mdschema="uws" element="typeOfResource" lang="en">Text</dim:field>
   <dim:field mdschema="uws" element="peerReviewStatus" lang="en">Unreviewed</dim:field>
   <dim:field mdschema="uws" element="scholarLevel" lang="en">Graduate</dim:field>
   <dim:field mdschema="others" element="access-status">open.access</dim:field>
</dim:dim>
</metadata></record></GetRecord></OAI-PMH>