Multimodal processing and interaction : audio, video, text

Multimodal Processing and Interaction: Audio, Video and Text presents high quality, state-of-the-art research ideas and results from theoretic, algorithmic and application viewpoints. This edited volume contains both state-of-the-art reviews and original contributions by leading experts in the scientific and technological field of multimedia. It grew out of a four-year collaboration among research groups participating in the European network of Excellence on Multimedia Understanding, Semantics, Computation and Learning (MUSCLE).

Multimodal Processing and Interaction: Audio, Video and Text covers a broad spectrum of novel perspectives, analytic tools, algorithms, design practices and applications in multimedia science and engineering with emphasis on multimodal integration and modality fusion. This volume also contains contributions in the area of interaction with multimedia, especially multimodal interfaces for accessing multimedia content.

Multimodal Processing and Interaction: Audio, Video and Text is designed for a professional audience composed of practitioners and researchers in industry and academia. This book is suitable for advanced-level students in computer science and engineering as well.

Petros Maragos and Patrick Gros and Athanassios Katsamanis and George PapandreouAlexandros Potamianos and Manolis PerakakisManolis Delakis and Guillaume Gravier and Patrick GrosGeorge Papandreou and Athanassios Katsamanis and Vassilis Pitsikalis and Petros MaragosRozenn Dahyot and Francois Pitie and Daire Lennon and Naomi Harte and Anil KokaramYigithan Dedeoglu and B. Ugur Toreyin and Ugur Gudukbay and A. Enis CetinEmmanouil Benetos and Spyridon Siatras and Constantine Kotropoulos and Nikos Nikolaidis and Ioannis PitasGeorgios Evangelopoulos and Konstantinos Rapantzikos and Petros Maragos and Yannis Avrithis and Alexandros PotamianosStephane Huet and Gwenole Lecorve and Guillaume Gravier and Pascale SebillotMarin Ferecatu and Nozha Boujemaa and Michel CrucianuRobert Neumayer and Andreas RauberEuripides G.M. PetrakisAlexandros Potamianos and Manolis PerakakisOyewole K. Oyekoya and Fred W. M. StentifordSanni Siltanen and Charles Woodward and Seppo Valli and Petri Honkamaa and Andreas Rauber

Part I Review of the State-of-the-Art
1 Cross-Modal Integration for Performance Improving in Multimedia: A Review	p. 3
2 Human-Computer Interfaces to Multimedia Content: a Review	p. 49
Part II Integrated Multimedia Analysis and Recognition
3 Stochastic Models for Multimodal Video Analysis	p. 91
4 Adaptive Multimodal Fusion by Uncertainty Compensation with Application to Audio-Visual Speech Recognition	p. 111
5 Action Recognition in Multimedia Streams	p. 127
6 Surveillance Using Both Video and Audio	p. 143
7 Movie Analysis with Emphasis to Dialogue and Action Scene Detection	p. 157
8 Audiovisual Attention Modeling and Salient Event Detection	p. 179
9 Toward the Integration of Natural Language Processing and Automatic Speech Recognition: Using Morpho-Syntax and Pragmatics for Transcription	p. 201
Part III Searching Multimedia Content
10 Interactive Image Retrieval Using a Hybrid Visual and Conceptual Content Representation	p. 221
11 Multimodal Analysis of Text and Audio Features for Music Information Retrieval	p. 241
12 Intelligent Search for Image Information on the Web through Text and Link Structure Analysis	p. 259
Part IV Interfaces to Multimedia Content
13 Design Principles for Multimodal Spoken Dialogue Systems	p. 279
14 Eye Tracking: A New Interface for Visual Exploration	p. 297
15 User Interaction for Mobile Devices	p. 311
References	p. 331
Index	p. 365

Available:*

On Order

Summary

Summary

Table of Contents