Synopses & Reviews
The ongoing migration of computing and information access from stationary environments to mobile computing devices for eventual use in mobile environments, such as Personal Digital Assistants (PDAs), tablet PCs, next generation mobile phones, and in-car driver assistance systems, poses critical challenges for natural human-computer interaction. Spoken dialogue is a key factor in ensuring natural and user-friendly interaction with such devices which are meant not only for computer specialists, but also for everyday users. Speech supports hands-free and eyes-free operation, and becomes a key alternative interaction mode in mobile environments, e.g. in cars where driver distraction by manually operated devices may be a significant problem. On the other hand, the use of mobile devices in public places, may make the possibility of using alternative modalities possibly in combination with speech, such as graphics output and gesture input, preferable due to e.g. privacy issues. Researchers' interest is progressively turning to the integration of speech with other modalities such as gesture input and graphics output, partly to accommodate more efficient interaction and partly to accommodate different user preferences. This book: combines overview chapters of key areas in spoken multimodal dialogue (systems and components, architectures, and evaluation) with chapters focussed on particular applications or problems in the field. focusses on the influence of the environment when building and evaluating an application. Audience: Computer scientists, engineers, and others who work in the area of spoken multimodal dialogue systems in academia and in the industry. Graduate students and Ph.D. students specialising in spoken multimodal dialogue systems in general, or focusing on issues in these systems in mobile environments in particular
Table of Contents
Contents and Contributors: PREFACE CONTRIBUTING AUTHORS INTRODUCTION Part I: Issues in Multimodal Spoken Dialogue Systems and Components ALEXANDER I . RUDNICKY / Multimodal Dialogue Systems SADAOKI FURUI / Speech Recognition Technology in Multimodal/Ubiquitous Computing Environments SATOSHI TAMURA, KOJI IWANO, SADAOKI FURUI / A Robust Multimodal Speech Recognition Method using Optical Flow Analysis KLAUS MACHEREY, HERMANN NEY / Feature Functions fro Tree-Based Dialogue Course Management DIRK BÜHLER, WOLFGANG MINKER / A Reasoning Component for Information-Seeking and Planning Dialogues JONAS BESKOW, JENS EDLUND, MAGNUS NORDSTRAND / A Model for Multimodal Dialogue System Output Applied to an Animated Talking Head Part II: System Architecture and Example Implementations ANDREAS KELLNER / Overview of System Architecture KOUICHI KATSURADA, HIROBUMI YAMADA, YUSAKU NAKAMURA, SATOSHI KOBAYASHI, TSUNEO NITTA / XISL: A Modality-Independent MMI Description Language GEORG NIKLFELD, MICHAEL PUCHER, ROBERT FINAN, WOLFGANG ECKHART / A Path to Multimodal Data Services for Telecommunications ROBERTO PIERACCINI, BOB CARPENTER, ERIC WOUDENBERG, SASHA CASKEY, STEPHEN SPRINGER, JONATHAN BLOOM, MICHAEL PHILIPS / Multimodal Spoken Dialogue with Wireless Devices DIRK BÜHLER, WOLFGANG MINKER / The SmartKom Mobile Car Prototype System for Flexible Human-Machine Communication DAN BOHUS, ALEXANDER I. RUDNICKY / LARRI: A Language-Based Maintenance and Repair Assistant Part III: Evaluation and Usability LAILA DYBKJAER, NIELS OLE BERNSEN, WOLFGANG MINKER / Overview of Evaluation and Usability STEVE WITHAKER, MARILYN WALKER / Evaluating Dialogue Strategies in Multimodal Dialogue Systems NIELS OLE BERNSEN, LAILA DYBKJAER / Enhancing the Usability of Multimodal Virtual Co-drivers WOLFGANG MINKER, UDO HAIBER, PAUL HEISTERKAMP, SVEN SCHEIBLE / Design, Implementation and Evaluation of the SENECA Spoken Language Dialogue System SABINE GELDOF, ROBERT DALE / Segmenting Route Descriptions for Mobile Devices JANIENKE STURM, BERT CRANEN, JACQUES TERKEN, ILSE BAKX / Effects of Prolonged Use on the Usability of a Mutimodal Form-Filling Interface ANTHONY JAMESON, KERSTIN KLÖCKNER / User Multitasking with Mobile Multimodal Systems SHARON OVIATT, COURTNEY DARVES, RACHEL COULSTON, MATT WESSON / Speech Convergence with Animated Personas INDEX