<?xml version="1.0" encoding="UTF-8"?><?xml-stylesheet type="text/xsl" href="static/style.xsl"?><OAI-PMH xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/ http://www.openarchives.org/OAI/2.0/OAI-PMH.xsd"><responseDate>2026-11-22T14:40:42Z</responseDate><request verb="GetRecord" identifier="oai:uwspace.uwaterloo.ca:10012/4344" metadataPrefix="dim">https://dspacemainprd01.lib.uwaterloo.ca/server/oai/request</request><GetRecord><record><header><identifier>oai:uwspace.uwaterloo.ca:10012/4344</identifier><datestamp>2017-03-21T16:30:33Z</datestamp><setSpec>com_10012_9924</setSpec><setSpec>com_10012_1</setSpec><setSpec>col_10012_9930</setSpec><setSpec>col_10012_6</setSpec></header><metadata><dim:dim xmlns:dim="http://www.dspace.org/xmlns/dspace/dim" xmlns:doc="http://www.lyncode.com/xoai" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.dspace.org/xmlns/dspace/dim http://www.dspace.org/schema/dim.xsd">
   <dim:field mdschema="dc" element="contributor" qualifier="author" authority="837929c4-0d87-4b8c-b8dd-5f6c8d4981a9" confidence="600">Lynam, Thomas Richard</dim:field>
   <dim:field mdschema="dc" element="date" qualifier="accessioned">2009-04-27T18:24:57Z</dim:field>
   <dim:field mdschema="dc" element="date" qualifier="available">2009-04-27T18:24:57Z</dim:field>
   <dim:field mdschema="dc" element="date" qualifier="issued">2009-04-27T18:24:57Z</dim:field>
   <dim:field mdschema="dc" element="date" qualifier="submitted">2009</dim:field>
   <dim:field mdschema="dc" element="identifier" qualifier="uri">http://hdl.handle.net/10012/4344</dim:field>
   <dim:field mdschema="dc" element="description" qualifier="abstract" lang="en">This work supports the thesis that sound quantitative evaluation for&#xd;
spam filters leads to substantial improvement in the classification&#xd;
of email. To this end, new laboratory testing methods and datasets&#xd;
are introduced, and evidence is presented that their adoption at Text&#xd;
REtrieval Conference (TREC)and elsewhere has led to an improvement in state of the art&#xd;
spam filtering. While many of these improvements have been discovered&#xd;
by others, the best-performing method known at this time -- spam filter&#xd;
fusion -- was demonstrated by the author.&#xd;
&#xd;
This work describes four principal dimensions of spam filter evaluation&#xd;
methodology and spam filter improvement. An initial study investigates&#xd;
the application of twelve open-source filter configurations in a laboratory&#xd;
environment, using a stream of 50,000 messages captured from a single&#xd;
recipient over eight months. The study measures the impact of user&#xd;
feedback and on-line learning on filter performance using methodology&#xd;
and measures which were released to the research community as the&#xd;
TREC Spam Filter Evaluation Toolkit.&#xd;
&#xd;
The toolkit was used as the basis of the TREC Spam Track, which the&#xd;
author co-founded with Cormack. The Spam Track, in addition to evaluating&#xd;
a new application (email spam), addressed the issue of testing systems&#xd;
on both private and public data. While streams of private messages&#xd;
are most realistic, they are not easy to come by and cannot be shared&#xd;
with the research community as archival benchmarks. Using the toolkit,&#xd;
participant filters were evaluated on both, and the differences found&#xd;
not to substantially confound evaluation; as a result, public corpora&#xd;
were validated as research tools. Over the course of TREC and similar&#xd;
evaluation efforts, a dozen or more archival benchmarks --&#xd;
some private and some public -- have become available.&#xd;
&#xd;
&#xd;
The toolkit and methodology have spawned improvements in the state&#xd;
of the art every year since its deployment in 2005. In 2005, 2006,&#xd;
and 2007, the spam track yielded new best-performing systems based&#xd;
on sequential compression models, orthogonal sparse bigram features,&#xd;
logistic regression and support vector machines. Using the TREC participant&#xd;
filters, we develop and demonstrate methods for on-line filter fusion&#xd;
that outperform all other reported on-line personal spam filters.</dim:field>
   <dim:field mdschema="dc" element="language" qualifier="iso" lang="en">en</dim:field>
   <dim:field mdschema="dc" element="publisher" lang="en">University of Waterloo</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">evaluation methodology</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">spam filtering</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">spam corpora</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">spam fusion</dim:field>
   <dim:field mdschema="dc" element="subject" qualifier="program" lang="en">Computer Science</dim:field>
   <dim:field mdschema="dc" element="title" lang="en">Spam Filter Improvement Through Measurement</dim:field>
   <dim:field mdschema="dc" element="type" lang="en">Doctoral Thesis</dim:field>
   <dim:field mdschema="dc" element="pending" lang="en">false</dim:field>
   <dim:field mdschema="uws-etd" element="degree" qualifier="department" lang="en">School of Computer Science</dim:field>
   <dim:field mdschema="uws-etd" element="degree" lang="en">Doctor of Philosophy</dim:field>
   <dim:field mdschema="uws" element="typeOfResource" lang="en">Text</dim:field>
   <dim:field mdschema="uws" element="peerReviewStatus" lang="en">Unreviewed</dim:field>
   <dim:field mdschema="uws" element="scholarLevel" lang="en">Graduate</dim:field>
   <dim:field mdschema="others" element="access-status">open.access</dim:field>
</dim:dim>
</metadata></record></GetRecord></OAI-PMH>