<?xml version="1.0" encoding="UTF-8"?><?xml-stylesheet type="text/xsl" href="static/style.xsl"?><OAI-PMH xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/ http://www.openarchives.org/OAI/2.0/OAI-PMH.xsd"><responseDate>2026-11-22T19:37:02Z</responseDate><request verb="GetRecord" identifier="oai:uwspace.uwaterloo.ca:10012/18183" metadataPrefix="dim">https://dspacemainprd01.lib.uwaterloo.ca/server/oai/request</request><GetRecord><record><header><identifier>oai:uwspace.uwaterloo.ca:10012/18183</identifier><datestamp>2025-03-26T23:33:51Z</datestamp><setSpec>com_10012_9924</setSpec><setSpec>com_10012_1</setSpec><setSpec>col_10012_9930</setSpec><setSpec>col_10012_6</setSpec></header><metadata><dim:dim xmlns:dim="http://www.dspace.org/xmlns/dspace/dim" xmlns:doc="http://www.lyncode.com/xoai" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.dspace.org/xmlns/dspace/dim http://www.dspace.org/schema/dim.xsd">
   <dim:field mdschema="dc" element="contributor" qualifier="advisor">Lin, Jimmy</dim:field>
   <dim:field mdschema="dc" element="contributor" qualifier="author" authority="85067010-c33b-4f3e-a240-d34262f69cb7" confidence="600">Hu, Chengcheng</dim:field>
   <dim:field mdschema="dc" element="date" qualifier="accessioned">2022-04-26T22:30:48Z</dim:field>
   <dim:field mdschema="dc" element="date" qualifier="available">2022-04-26T22:30:48Z</dim:field>
   <dim:field mdschema="dc" element="date" qualifier="issued">2022-04-26</dim:field>
   <dim:field mdschema="dc" element="date" qualifier="submitted">2022-04-19</dim:field>
   <dim:field mdschema="dc" element="identifier" qualifier="uri">http://hdl.handle.net/10012/18183</dim:field>
   <dim:field mdschema="dc" element="description" qualifier="abstract" lang="en">The emergence of BERT in 2018 has brought a huge boon to retrieval effectiveness in many tasks across various domains and led the recent research landscape of IR  to transformer-related technologies. &#xd;
While researchers are fascinated by the power of BERT, along with related transformer models, substantial computational costs incurred by transformers become an unavoidable problem.&#xd;
Meanwhile, under the light of BERT, there are &amp;apos;&amp;apos;out-of-date&amp;apos;&amp;apos; but fairly effective techniques forgotten by people. &#xd;
For example, learning to rank was one of the most popular technologies a decade ago.&#xd;
&#xd;
In this work, we aim to answer two research questions: RQ1 is whether using learning to rank as a filtering stage in a  multi-stage reranking pipeline can improve the efficiency of reranking using transformers without sacrificing effectiveness. In addition, we are interested in if using transformer-based features in the traditional learning to rank framework can increase effectiveness as RQ2.&#xd;
&#xd;
To answer RQ1, we implement a multi-stage reranking pipeline which places learning to rank as a filter in the middle stage. &#xd;
This configuration allows the pipeline to only send the most promising candidates using cheap learning to rank module to expensive neural rerankers, hence a speedup in overall latency for transformer-based reranking can be obtained without a degradation in effectiveness.&#xd;
By applying the pipeline on MS MARCO passage and document ranking tasks, we can achieve up to 18 times increase in efficiency while maintaining the same level of effectiveness.&#xd;
Moreover, our method is orthogonal to other techniques that focus on neural models themselves to accelerate inference.&#xd;
Hence, our method can be combined with other accelerating works to further save computational costs and latency.&#xd;
&#xd;
&#xd;
For RQ2, since transformers generate relevance scores for different query-document pairs independently, it is possible to use transformer-based scores as learning to rank features, so that learning to rank can take advantage of transformers to increase retrieval effectiveness. &#xd;
Applied to the MS MARCO passage and document ranking tasks, we gain a maximal 52% increase in effectiveness by adding the BERT-based feature compared to the &amp;apos;&amp;apos;traditional&amp;apos;&amp;apos; learning to rank. &#xd;
Also, we obtain a result with a little bit higher effectiveness by adding transformer-based features with other traditional features in learning to rank, compared to the standard retrieve-and-rerank design with transformers.&#xd;
&#xd;
This work explores potential roles of learning to rank in the age of muppets.&#xd;
In a broader sense, this work illustrates that we should stand on the shoulder of giants, which is what we learned and discovered in history, to explore next unknowns.</dim:field>
   <dim:field mdschema="dc" element="language" qualifier="iso" lang="en">en</dim:field>
   <dim:field mdschema="dc" element="publisher" lang="en">University of Waterloo</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">learning to rank</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">information retrieval</dim:field>
   <dim:field mdschema="dc" element="title" lang="en">Learning to Rank in the Age of Muppets</dim:field>
   <dim:field mdschema="dc" element="type" lang="en">Master Thesis</dim:field>
   <dim:field mdschema="dc" element="pending">false</dim:field>
   <dim:field mdschema="uws-etd" element="degree" qualifier="department" lang="en">David R. Cheriton School of Computer Science</dim:field>
   <dim:field mdschema="uws-etd" element="degree" qualifier="discipline" lang="en">Computer Science</dim:field>
   <dim:field mdschema="uws-etd" element="degree" qualifier="grantor" lang="en">University of Waterloo</dim:field>
   <dim:field mdschema="uws-etd" element="degree" lang="en">Master of Mathematics</dim:field>
   <dim:field mdschema="uws-etd" element="embargo" qualifier="terms" lang="en">0</dim:field>
   <dim:field mdschema="uws" element="contributor" qualifier="advisor">Lin, Jimmy</dim:field>
   <dim:field mdschema="uws" element="contributor" qualifier="affiliation1" lang="en">Faculty of Mathematics</dim:field>
   <dim:field mdschema="uws" element="published" qualifier="city" lang="en">Waterloo</dim:field>
   <dim:field mdschema="uws" element="published" qualifier="country" lang="en">Canada</dim:field>
   <dim:field mdschema="uws" element="published" qualifier="province" lang="en">Ontario</dim:field>
   <dim:field mdschema="uws" element="typeOfResource" lang="en">Text</dim:field>
   <dim:field mdschema="uws" element="peerReviewStatus" lang="en">Unreviewed</dim:field>
   <dim:field mdschema="uws" element="scholarLevel" lang="en">Graduate</dim:field>
   <dim:field mdschema="others" element="access-status">open.access</dim:field>
</dim:dim>
</metadata></record></GetRecord></OAI-PMH>