Simulation-Based Usability Evaluation of Spoken and Multimodal Dialogue Systems

Simulation-Based Usability Evaluation of Spoken and Multimodal Dialogue Systems
Author: Stefan Hillmann
Publisher: Springer
Total Pages: 262
Release: 2017-11-23
Genre: Technology & Engineering
ISBN: 3319625187

This book describes an extension of the user behaviour simulation (UBS) of an existing tool for automatic usability evaluation (AUE). This extension is based upon a user study with a smart home system. It uses technical-sociological methods for the execution of the study and the analysis of the collected data. A comparison of the resulting UBS with former UBSs, as well as the empirical data, shows that the new simulation approach outperforms the former simulation. The improvement affects the prediction of dialogue metrics that are related to dialogue efficiency and dialogue effectiveness. Furthermore, the book describes a parameter-based data model, as well as a related framework. Both are used to uniformly describe multimodal human-computer interactions and to provide such descriptions for usability evaluations. Finally, the book proposes a new two-stage method for the evaluation of UBSs. The method is based on the computation of a distance measures between two dialogue corpora and the pair-wise comparison of distances among several dialogue corpora.

Highlights of Practical Applications of Heterogeneous Multi-Agent Systems - The PAAMS Collection

Highlights of Practical Applications of Heterogeneous Multi-Agent Systems - The PAAMS Collection
Author: Juan M. Corchado
Publisher: Springer
Total Pages: 405
Release: 2014-05-14
Genre: Computers
ISBN: 3319077678

This book constitutes the refereed proceedings of the workshops which complemented the 12th International Conference on Practical Applications of Agents and Multi-Agent Systems, PAAMS 2014, held in Salamanca, Spain, in June 2014. This volume presents the papers that have been accepted for the following workshops: Workshop on Agent-based Approaches for the Transportation Modeling and Optimization (AATMO 2014); Workshop on Agent-based Modeling and Simulation of Complex Systems: Engineering and Applications (ABSEA 2014); Workshop on Agents and Multi-Agent Systems for Ambient-assisted Living and e-Health (A-HEALTH 2014); Workshop on Agent-based Solutions for Manufacturing and Supply Chain (AMSC 2014); Workshop on Intelligent Systems for Context-based Information Fusion (ISCIF 2014); Workshop on Multi-Agent based Applications for Smart Grids and Sustainable Energy Systems (MASGES 2014); Workshop on Active Security Through Multi-Agent Systems (WASMAS 2014); Workshop on Intelligent Human-Agent Societies (WIHAS 2014).

Data-Driven Methods for Adaptive Spoken Dialogue Systems

Data-Driven Methods for Adaptive Spoken Dialogue Systems
Author: Oliver Lemon
Publisher: Springer Science & Business Media
Total Pages: 184
Release: 2012-10-20
Genre: Computers
ISBN: 1461448034

Data driven methods have long been used in Automatic Speech Recognition (ASR) and Text-To-Speech (TTS) synthesis and have more recently been introduced for dialogue management, spoken language understanding, and Natural Language Generation. Machine learning is now present “end-to-end” in Spoken Dialogue Systems (SDS). However, these techniques require data collection and annotation campaigns, which can be time-consuming and expensive, as well as dataset expansion by simulation. In this book, we provide an overview of the current state of the field and of recent advances, with a specific focus on adaptivity.

Simulating Conversations for the Prediction of Speech Quality

Simulating Conversations for the Prediction of Speech Quality
Author: Thilo Michael
Publisher: Springer Nature
Total Pages: 157
Release: 2023-06-30
Genre: Technology & Engineering
ISBN: 3031318447

This book discusses the simulation of conversations through a novel approach of predicting speech quality based on the interactions of two simulated interlocutors. The author describes the setup of a simulation environment that is capable of simulating human dialogue on the speech level. The impact of delay and bursty packet loss on VoIP conversations is investigated and modeled for the use in the simulation. Based on parameters extracted from simulated conversations, the author proposes extensions to the E-model, a parametric model standardized by the International Telecommunications Union, in order to predict the quality of the simulated conversations. The author shows that predictions based on the simulated conversations outperform models that rely on the transmission parameters alone.

Proceedings of the Paralinguistic Information and its Integration in Spoken Dialogue Systems Workshop

Proceedings of the Paralinguistic Information and its Integration in Spoken Dialogue Systems Workshop
Author: Ramón López-Cózar Delgado
Publisher: Springer Science & Business Media
Total Pages: 388
Release: 2011-08-27
Genre: Technology & Engineering
ISBN: 1461413354

This volume includes proceedings articles presented at the Workshop on Paralinguistic Information and its Integration in Spoken Dialogue Systems held in Granada, Spain. The material focuses on the three broad areas of spoken dialogue systems for robotics, emotions and spoken dialogue systems, and Spoken dialogue systems for real-world applications The workshop proceedings are part of the 3rd Annual International Workshop on Spoken Dialogue Systems, which brings together researchers from all over the world working in the field of spoken dialogue systems. It provides an international forum for the presentation of research and applications, and for lively discussions among researchers as well as industrialists.

Spoken Multimodal Human-Computer Dialogue in Mobile Environments

Spoken Multimodal Human-Computer Dialogue in Mobile Environments
Author: Wolfgang Minker
Publisher: Springer Science & Business Media
Total Pages: 438
Release: 2005-02-18
Genre: Computers
ISBN: 9781402030741

This book is based on publications from the ISCA Tutorial and Research Workshop on Multi-Modal Dialogue in Mobile Environments held at Kloster Irsee, Germany, in 2002. The workshop covered various aspects of devel- ment and evaluation of spoken multimodal dialogue systems and components with particular emphasis on mobile environments, and discussed the state-- the-art within this area. On the development side the major aspects addressed include speech recognition, dialogue management, multimodal output gene- tion, system architectures, full applications, and user interface issues. On the evaluation side primarily usability evaluation was addressed. A number of high quality papers from the workshop were selected to form the basis of this book. The volume is divided into three major parts which group together the ov- all aspects covered by the workshop. The selected papers have all been - tended, reviewed and improved after the workshop to form the backbone of the book. In addition, we have supplemented each of the three parts by an invited contribution intended to serve as an overview chapter.

Multimodal Signal Processing

Multimodal Signal Processing
Author: Jean-Philippe Thiran
Publisher: Academic Press
Total Pages: 343
Release: 2009-11-11
Genre: Computers
ISBN: 0080888690

Multimodal signal processing is an important research and development field that processes signals and combines information from a variety of modalities – speech, vision, language, text – which significantly enhance the understanding, modelling, and performance of human-computer interaction devices or systems enhancing human-human communication. The overarching theme of this book is the application of signal processing and statistical machine learning techniques to problems arising in this multi-disciplinary field. It describes the capabilities and limitations of current technologies, and discusses the technical challenges that must be overcome to develop efficient and user-friendly multimodal interactive systems. With contributions from the leading experts in the field, the present book should serve as a reference in multimodal signal processing for signal processing researchers, graduate students, R&D engineers, and computer engineers who are interested in this emerging field. - Presents state-of-art methods for multimodal signal processing, analysis, and modeling - Contains numerous examples of systems with different modalities combined - Describes advanced applications in multimodal Human-Computer Interaction (HCI) as well as in computer-based analysis and modelling of multimodal human-human communication scenes.

Spoken, Multilingual and Multimodal Dialogue Systems

Spoken, Multilingual and Multimodal Dialogue Systems
Author: Ramon Lopez Cozar Delgado
Publisher: John Wiley & Sons
Total Pages: 272
Release: 2007-01-11
Genre: Technology & Engineering
ISBN: 047002156X

Dialogue systems are a very appealing technology with an extraordinary future. Spoken, Multilingual and Multimodal Dialogues Systems: Development and Assessment addresses the great demand for information about the development of advanced dialogue systems combining speech with other modalities under a multilingual framework. It aims to give a systematic overview of dialogue systems and recent advances in the practical application of spoken dialogue systems. Spoken Dialogue Systems are computer-based systems developed to provide information and carry out simple tasks using speech as the interaction mode. Examples include travel information and reservation, weather forecast information, directory information and product order. Multimodal Dialogue Systems aim to overcome the limitations of spoken dialogue systems which use speech as the only communication means, while Multilingual Systems allow interaction with users that speak different languages. Presents a clear snapshot of the structure of a standard dialogue system, by addressing its key components in the context of multilingual and multimodal interaction and the assessment of spoken, multilingual and multimodal systems In addition to the fundamentals of the technologies employed, the development and evaluation of these systems are described Highlights recent advances in the practical application of spoken dialogue systems This comprehensive overview is a must for graduate students and academics in the fields of speech recognition, speech synthesis, speech processing, language, and human–computer interaction technolgy. It will also prove to be a valuable resource to system developers working in these areas.

Speech Technology

Speech Technology
Author: Fang Chen
Publisher: Springer Science & Business Media
Total Pages: 349
Release: 2010-07-01
Genre: Technology & Engineering
ISBN: 0387738193

This book gives an overview of the research and application of speech technologies in different areas. One of the special characteristics of the book is that the authors take a broad view of the multiple research areas and take the multidisciplinary approach to the topics. One of the goals in this book is to emphasize the application. User experience, human factors and usability issues are the focus in this book.