NONLINEAR AND MODEL-BASED IMAGE ANALYSIS

Processing of audio and visual speech for telecommunication systems

[+] Author Affiliations
Druti Shah

University of Cambridge, Computer Laboratory, New Museum Site, Pembroke Street, Cambridge?CB2?3QG, United Kingdom

Stephen Marshall

University of Strathclyde, Signal Processing Division, Department of Electronic and Electrical Engineering, Glasgow, United Kingdom

J. Electron. Imaging. 8(3), 263-269 (Jul 01, 1999). doi:10.1117/1.482675
History: Received Dec. 2, 1998; Revised May 21, 1999; Revised June 14, 1999; Accepted June 15, 1999
Text Size: A A A

Abstract

Most verbal communications use cues from both the visual and acoustic modalities to convey messages. During the production of speech, the visible information provided by the external articulatory organs can influence the understanding of the language, by interpreting the combined information into meaningful linguistic expressions. The task of integrating speech and image data to emulate the bimodal human interaction system can be depicted by developing automated systems. These systems have a wide range of applications such as videophone systems, where the interdependencies between image and speech signals can be exploited for data compression and in solving the task of lip synchronization which has been a major problem. Therefore the objective of this work is to investigate and quantify this relationship such that the knowledge gained will assist in longer term multimedia and videophone research. © 1999 SPIE and IS&T.

© 1999 SPIE and IS&T

Citation

Druti Shah and Stephen Marshall
"Processing of audio and visual speech for telecommunication systems", J. Electron. Imaging. 8(3), 263-269 (Jul 01, 1999). ; http://dx.doi.org/10.1117/1.482675


Figures

Tables

Access This Article
Sign in or Create a personal account to Buy this article ($20 for members, $25 for non-members).

Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging & repositioning the boxes below.

Related Book Chapters

Topic Collections

PubMed Articles
Advertisement
  • Don't have an account?
  • Subscribe to the SPIE Digital Library
  • Create a FREE account to sign up for Digital Library content alerts and gain access to institutional subscriptions remotely.
Access This Article
Sign in or Create a personal account to Buy this article ($20 for members, $25 for non-members).
Access This Proceeding
Sign in or Create a personal account to Buy this article ($15 for members, $18 for non-members).
Access This Chapter

Access to SPIE eBooks is limited to subscribing institutions and is not available as part of a personal subscription. Print or electronic versions of individual SPIE books may be purchased via SPIE.org.