<?xml version="1.0" encoding="UTF-8"?><?xml-stylesheet type="text/xsl" href="static/style.xsl"?><OAI-PMH xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/ http://www.openarchives.org/OAI/2.0/OAI-PMH.xsd"><responseDate>2026-11-22T09:36:18Z</responseDate><request verb="GetRecord" identifier="oai:uwspace.uwaterloo.ca:10012/832" metadataPrefix="dim">https://dspacemainprd01.lib.uwaterloo.ca/server/oai/request</request><GetRecord><record><header><identifier>oai:uwspace.uwaterloo.ca:10012/832</identifier><datestamp>2017-03-21T19:23:58Z</datestamp><setSpec>com_10012_9900</setSpec><setSpec>com_10012_1</setSpec><setSpec>col_10012_9914</setSpec><setSpec>col_10012_6</setSpec></header><metadata><dim:dim xmlns:dim="http://www.dspace.org/xmlns/dspace/dim" xmlns:doc="http://www.lyncode.com/xoai" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.dspace.org/xmlns/dspace/dim http://www.dspace.org/schema/dim.xsd">
   <dim:field mdschema="dc" element="contributor" qualifier="author" lang="en" authority="de56b01d-7758-4767-af6f-94969ddf9584" confidence="600">Taylor, Graham</dim:field>
   <dim:field mdschema="dc" element="date" qualifier="accessioned">2006-08-22T13:49:53Z</dim:field>
   <dim:field mdschema="dc" element="date" qualifier="available">2006-08-22T13:49:53Z</dim:field>
   <dim:field mdschema="dc" element="date" qualifier="issued" lang="en">2004</dim:field>
   <dim:field mdschema="dc" element="date" qualifier="submitted" lang="en">2004</dim:field>
   <dim:field mdschema="dc" element="identifier" qualifier="uri">http://hdl.handle.net/10012/832</dim:field>
   <dim:field mdschema="dc" element="description" qualifier="abstract" lang="en">The significant amount of data contained in digital images present barriers to methods of learning from the information they hold.   Noise and the subjectivity of image evaluation further complicate such automated processes.   In this thesis, we examine a particular area in which these difficulties are experienced.   We attempt to control the parameters of a multi-step algorithm that processes visual information.   A framework for approaching the parameter selection problem using reinforcement learning agents is presented as the main contribution of this research.   We focus on the generation of state and action space, as well as task-dependent reward.   We first discuss the automatic determination of fuzzy membership functions as a specific case of the above problem.   Entropy of a fuzzy event is used as a reinforcement signal.   Membership functions representing brightness have been automatically generated for several images.   The results show that the reinforcement learning approach is superior to an existing simulated annealing-based approach.   The framework has also been evaluated by optimizing ten parameters of the text detection for semantic indexing algorithm proposed by Wolf et al.   Image features are defined and extracted to construct the state space.   Generalization to reduce the state space is performed with the fuzzy ARTMAP neural network, offering much faster learning than in the previous tabular implementation, despite a much larger state and action space.   Difficulties in using a continuous action space are overcome by employing the DIRECT method for global optimization without derivatives.   The chosen parameters are evaluated using metrics of recall and precision, and are shown to be superior to the parameters previously recommended.   We further discuss the interplay between intermediate and terminal reinforcement.</dim:field>
   <dim:field mdschema="dc" element="format" lang="en">application/pdf</dim:field>
   <dim:field mdschema="dc" element="format" qualifier="extent">1048508 bytes</dim:field>
   <dim:field mdschema="dc" element="format" qualifier="mimetype">application/pdf</dim:field>
   <dim:field mdschema="dc" element="language" qualifier="iso" lang="en">en</dim:field>
   <dim:field mdschema="dc" element="publisher" lang="en">University of Waterloo</dim:field>
   <dim:field mdschema="dc" element="rights" lang="en">Copyright: 2004, 
  Taylor, Graham. All rights reserved.</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">Systems Design</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">reinforcement learning</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">artificial neural networks</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">image processing</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">computer vision</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">text detection</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">artificial intelligence</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">machine learning</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">parameter control</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">optimization</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">Markov decision processes</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">fuzzy ARTMAP</dim:field>
   <dim:field mdschema="dc" element="title" lang="en">Reinforcement Learning for Parameter Control of Image-Based Applications</dim:field>
   <dim:field mdschema="dc" element="type" lang="en">Master Thesis</dim:field>
   <dim:field mdschema="dc" element="pending" lang="en">false</dim:field>
   <dim:field mdschema="uws-etd" element="degree" qualifier="department" lang="en">Systems Design Engineering</dim:field>
   <dim:field mdschema="uws-etd" element="degree" lang="en">Master of Applied Science</dim:field>
   <dim:field mdschema="uws" element="typeOfResource" lang="en">Text</dim:field>
   <dim:field mdschema="uws" element="peerReviewStatus" lang="en">Unreviewed</dim:field>
   <dim:field mdschema="uws" element="scholarLevel" lang="en">Graduate</dim:field>
   <dim:field mdschema="others" element="access-status">open.access</dim:field>
</dim:dim>
</metadata></record></GetRecord></OAI-PMH>