<?xml version="1.0" encoding="UTF-8"?><?xml-stylesheet type="text/xsl" href="static/style.xsl"?><OAI-PMH xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/ http://www.openarchives.org/OAI/2.0/OAI-PMH.xsd"><responseDate>2026-11-22T15:08:48Z</responseDate><request verb="GetRecord" identifier="oai:uwspace.uwaterloo.ca:10012/1040" metadataPrefix="dim">https://dspacemainprd01.lib.uwaterloo.ca/server/oai/request</request><GetRecord><record><header><identifier>oai:uwspace.uwaterloo.ca:10012/1040</identifier><datestamp>2017-03-21T19:28:09Z</datestamp><setSpec>com_10012_9924</setSpec><setSpec>com_10012_1</setSpec><setSpec>col_10012_9930</setSpec><setSpec>col_10012_6</setSpec></header><metadata><dim:dim xmlns:dim="http://www.dspace.org/xmlns/dspace/dim" xmlns:doc="http://www.lyncode.com/xoai" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.dspace.org/xmlns/dspace/dim http://www.dspace.org/schema/dim.xsd">
   <dim:field mdschema="dc" element="contributor" qualifier="author" lang="en" authority="97dca394-8cce-43ed-a576-ddaf8dfcbce1" confidence="600">Chung, Chiasen</dim:field>
   <dim:field mdschema="dc" element="date" qualifier="accessioned">2006-08-22T14:26:53Z</dim:field>
   <dim:field mdschema="dc" element="date" qualifier="available">2006-08-22T14:26:53Z</dim:field>
   <dim:field mdschema="dc" element="date" qualifier="issued" lang="en">2001</dim:field>
   <dim:field mdschema="dc" element="date" qualifier="submitted" lang="en">2001</dim:field>
   <dim:field mdschema="dc" element="identifier" qualifier="uri">http://hdl.handle.net/10012/1040</dim:field>
   <dim:field mdschema="dc" element="description" qualifier="abstract" lang="en">A &amp;lt;i&amp;gt;web crawler&amp;lt;/i&amp;gt; is a program that &amp;quot;walks&amp;quot; the Web to gather web resources.   In order to scale to the ever-increasing Web, multiple crawling agents may be deployed in a distributed fashion to retrieve web data co-operatively.   A common approach is to divide the Web into many partitions with an agent assigned to crawl within each one.   If an agent obtains a web resource that is not from its partition, the resource will be transferred to the rightful owner.       This thesis proposes a novel approach to distributed web data gathering by partitioning the Web into topics.   The proposed approach employs multiple focused crawlers to retrieve pages from various topics.   When a crawler retrieves a page of another topic, it transfers the page to the appropriate crawler.   This approach is known as &amp;lt;i&amp;gt;topic-oriented collaborative web crawling&amp;lt;/i&amp;gt;.       An implementation of the system was built and experimentally evaluated.   In order to identify the topic of a web page, a topic classifier was incorporated into the crawling system.   As the classifier categorizes only English pages, a language identifier was also introduced to distinguish English pages from non-English ones.   From the experimental results, we found that redundance retrieval was low and that a resource, retrieved by an agent, is six times more likely to be retained than a system that uses conventional hashing approach.   These numbers were viewed as strong indications that &amp;lt;i&amp;gt;topic-oriented collaborative web crawling system&amp;lt;/i&amp;gt; is a viable approach to web data gathering.</dim:field>
   <dim:field mdschema="dc" element="format" lang="en">application/pdf</dim:field>
   <dim:field mdschema="dc" element="format" qualifier="extent">733407 bytes</dim:field>
   <dim:field mdschema="dc" element="format" qualifier="mimetype">application/pdf</dim:field>
   <dim:field mdschema="dc" element="language" qualifier="iso" lang="en">en</dim:field>
   <dim:field mdschema="dc" element="publisher" lang="en">University of Waterloo</dim:field>
   <dim:field mdschema="dc" element="rights" lang="en">Copyright: 2001, 
  Chung, Chiasen. All rights reserved.</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">Computer Science</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">Web Crawling</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">Distributed System</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">Text Categorization</dim:field>
   <dim:field mdschema="dc" element="title" lang="en">Topic-Oriented Collaborative Web Crawling</dim:field>
   <dim:field mdschema="dc" element="type" lang="en">Master Thesis</dim:field>
   <dim:field mdschema="dc" element="pending" lang="en">false</dim:field>
   <dim:field mdschema="uws-etd" element="degree" qualifier="department" lang="en">School of Computer Science</dim:field>
   <dim:field mdschema="uws-etd" element="degree" lang="en">Master of Mathematics</dim:field>
   <dim:field mdschema="uws" element="typeOfResource" lang="en">Text</dim:field>
   <dim:field mdschema="uws" element="peerReviewStatus" lang="en">Unreviewed</dim:field>
   <dim:field mdschema="uws" element="scholarLevel" lang="en">Graduate</dim:field>
   <dim:field mdschema="others" element="access-status">open.access</dim:field>
</dim:dim>
</metadata></record></GetRecord></OAI-PMH>