<?xml version="1.0" encoding="UTF-8"?><?xml-stylesheet type="text/xsl" href="static/style.xsl"?><OAI-PMH xmlns="http://www.openarchives.org/OAI/2.0/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/ http://www.openarchives.org/OAI/2.0/OAI-PMH.xsd"><responseDate>2026-11-22T16:53:04Z</responseDate><request verb="GetRecord" identifier="oai:uwspace.uwaterloo.ca:10012/789" metadataPrefix="dim">https://dspacemainprd01.lib.uwaterloo.ca/server/oai/request</request><GetRecord><record><header><identifier>oai:uwspace.uwaterloo.ca:10012/789</identifier><datestamp>2017-03-21T21:36:24Z</datestamp><setSpec>com_10012_9900</setSpec><setSpec>com_10012_1</setSpec><setSpec>col_10012_9908</setSpec><setSpec>col_10012_6</setSpec></header><metadata><dim:dim xmlns:dim="http://www.dspace.org/xmlns/dspace/dim" xmlns:doc="http://www.lyncode.com/xoai" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.dspace.org/xmlns/dspace/dim http://www.dspace.org/schema/dim.xsd">
   <dim:field mdschema="dc" element="contributor" qualifier="author" lang="en" authority="4473b7f2-40c3-4b1b-b8b4-f350d2ff0197" confidence="600">Miners, William Ben</dim:field>
   <dim:field mdschema="dc" element="date" qualifier="accessioned">2006-08-22T13:50:50Z</dim:field>
   <dim:field mdschema="dc" element="date" qualifier="available">2006-08-22T13:50:50Z</dim:field>
   <dim:field mdschema="dc" element="date" qualifier="issued" lang="en">2006</dim:field>
   <dim:field mdschema="dc" element="date" qualifier="submitted" lang="en">2006</dim:field>
   <dim:field mdschema="dc" element="identifier" qualifier="uri">http://hdl.handle.net/10012/789</dim:field>
   <dim:field mdschema="dc" element="description" qualifier="abstract" lang="en">Intelligent devices are quickly becoming necessities to support our activities during both work and play.    We are already bound in a symbiotic relationship with these devices.    An unfortunate effect of the pervasiveness of intelligent devices is the substantial investment of our time and effort to communicate intent.    Even though our increasing reliance on these intelligent devices is inevitable, the limits of conventional methods for devices to perceive human expression hinders communication efficiency.    These constraints restrict the usefulness of intelligent devices to support our activities.    Our communication time and effort must be minimized to leverage the benefits of intelligent devices and seamlessly integrate them into society.    Minimizing the time and effort needed to communicate our intent will allow us to concentrate on tasks in which we excel, including creative thought and problem solving.    &amp;lt;br /&amp;gt;&amp;lt;br /&amp;gt;  An intuitive method to minimize human communication effort with intelligent devices is to take advantage of our existing interpersonal communication experience.    Recent advances in speech, hand gesture, and facial expression recognition provide alternate viable modes of communication that are more natural than conventional tactile interfaces.    Use of natural human communication eliminates the need to adapt and invest time and effort using less intuitive techniques required for traditional keyboard and mouse based interfaces.    &amp;lt;br /&amp;gt;&amp;lt;br /&amp;gt;  Although the state of the art in natural but isolated modes of communication achieves impressive results, significant hurdles must be conquered before communication with devices in our daily lives will feel natural and effortless.    Research has shown that combining information between multiple noise-prone modalities improves accuracy.    Leveraging this complementary and redundant content will improve communication robustness and relax current unimodal limitations.    &amp;lt;br /&amp;gt;&amp;lt;br /&amp;gt;  This research presents and evaluates a novel multimodal framework to help reduce the total human effort and time required to communicate with intelligent devices.    This reduction is realized by determining human intent using a knowledge-based architecture that combines and leverages conflicting information available across multiple natural communication modes and modalities.    The effectiveness of this approach is demonstrated using dynamic hand gestures and simple facial expressions characterizing basic emotions.    It is important to note that the framework is not restricted to these two forms of communication.   The framework presented in this research provides the flexibility necessary to include additional or alternate modalities and channels of information in future research, including improving the robustness of speech understanding.    &amp;lt;br /&amp;gt;&amp;lt;br /&amp;gt;  The primary contributions of this research include the leveraging of conflicts in a closed-loop multimodal framework, explicit use of uncertainty in knowledge representation and reasoning across multiple modalities, and a flexible approach for leveraging domain specific knowledge to help understand multimodal human expression.    Experiments using a manually defined knowledge base demonstrate an improved average accuracy of individual concepts and an improved average accuracy of overall intents when leveraging conflicts as compared to an open-loop approach.</dim:field>
   <dim:field mdschema="dc" element="format" lang="en">application/pdf</dim:field>
   <dim:field mdschema="dc" element="format" qualifier="extent">6507585 bytes</dim:field>
   <dim:field mdschema="dc" element="format" qualifier="mimetype">application/pdf</dim:field>
   <dim:field mdschema="dc" element="language" qualifier="iso" lang="en">en</dim:field>
   <dim:field mdschema="dc" element="publisher" lang="en">University of Waterloo</dim:field>
   <dim:field mdschema="dc" element="rights" lang="en">Copyright: 2006, 
  Miners, William Ben. All rights reserved.</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">Electrical &amp;amp; Computer Engineering</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">understanding natural expression</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">conflict</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">conceptual structure</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">multimodal interface</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">hand gesture</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">facial expression</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">HMI</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">pervasive</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">ubiquitous</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">perceptual user interface</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">gesture recognition</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">conceptual graph</dim:field>
   <dim:field mdschema="dc" element="subject" lang="en">fusion</dim:field>
   <dim:field mdschema="dc" element="title" lang="en">Toward Understanding Human Expression in Human-Robot Interaction</dim:field>
   <dim:field mdschema="dc" element="type" lang="en">Doctoral Thesis</dim:field>
   <dim:field mdschema="dc" element="pending" lang="en">false</dim:field>
   <dim:field mdschema="uws-etd" element="degree" qualifier="department" lang="en">Electrical and Computer Engineering</dim:field>
   <dim:field mdschema="uws-etd" element="degree" lang="en">Doctor of Philosophy</dim:field>
   <dim:field mdschema="uws" element="typeOfResource" lang="en">Text</dim:field>
   <dim:field mdschema="uws" element="peerReviewStatus" lang="en">Unreviewed</dim:field>
   <dim:field mdschema="uws" element="scholarLevel" lang="en">Graduate</dim:field>
   <dim:field mdschema="others" element="access-status">open.access</dim:field>
</dim:dim>
</metadata></record></GetRecord></OAI-PMH>