MULTI MODAL SIGNAL PROCESSING (H/C)

THIS TITLE PRESENTS STATE-OF-ART METHODS FOR MULTIMODAL SIGNAL PROCESSING, ANALYSIS, AND MODELING. IT CONTAINS NUMEROUS EXAMPLES OF SYSTEMS WITH DIFFERENT MODALITIES COMBINED. IT DESCRIBES ADVANCED APPLICATIONS IN MULTIMODAL HUMAN-COMPUTER INTERACTION (HCI) AS WELL AS IN COMPUTER-BASED ANALYSIS AND MODELLING OF MULTIMODAL HUMAN-HUMAN COMMUNICATION SCENES. MULTIMODAL SIGNAL PROCESSING IS AN IMPORTANT RESEARCH AND DEVELOPMENT FIELD THAT PROCESSES SIGNALS AND COMBINES INFORMATION FROM A VARIETY OF MODALITIES - SPEECH, VISION, LANGUAGE, TEXT - WHICH SIGNIFICANTLY ENHANCE THE UNDERSTANDING, MODELLING, AND PERFORMANCE OF HUMAN-COMPUTER INTERACTION DEVICES OR SYSTEMS ENHANCING HUMAN-HUMAN COMMUNICATION. THE OVERARCHING THEME OF THIS BOOK IS THE APPLICATION OF SIGNAL PROCESSING AND STATISTICAL MACHINE LEARNING TECHNIQUES TO PROBLEMS ARISING IN THIS MULTI-DISCIPLINARY FIELD. IT DESCRIBES THE CAPABILITIES AND LIMITATIONS OF CURRENT TECHNOLOGIES, AND DISCUSSES THE TECHNICAL CHALLENGES THAT MUST B