SPEECH PROCESSING

BINIT MOHANTY binit.mohanty@gmail.com

Why Speech?
No visual contact required No special equipment required Can be done while doing other things Telephones AT&T Mobile Phones (1G and 2G)

Speech Processing
Speech Coding Speech Synthesis Speech Recognition Speaker Recognition/Verification Dyslexia and Auditory problems

Audio Engineering

Speech Coding
Compress a Speech File Why not use standard compression techniques? MP3 Format
Perceptual Coding Exploits sensory organ biases

Speech Synthesis
Construct Speech waveform from words Speaker Quality and Accent Prosody?

http://www.research.att.com/~ttsweb/tts/demo.php

Speech Recognition
Convert a sound waveform to words The most relevant and important task in the industry 90% in lab conditions, much lower in factory conditions Sphinx by CMU, ViaVoce by IBM & SDK by Microsoft

Speaker Recognition
Concerned with Biometrics Acceptable as a verification technique How would this be different from Speech recognition?
Speaker Quality Prosody Pitch, Accent etc.

Dyslexia & Auditory Problems

Study Voice and Ear defects Detect and correct Speech Disfluencies CMU Development of better Ear substitutes Cochlear Implants

Audio Engineering
Adding effects to sound Clarity of reproduction A Big industry with players like Dolby, Bose, Phillips etc Voice Morphing!
SOURCE TARGET CONV 1 CONV 2

Courtesy: Hui Ye & Steve Young, Cambridge

Automatic Speech Recognition

Most Important Task Hardest Task
Co-articulation: Two speakers speaking at the same time Speaker Variation Spontaneity Language Modeling Noise Robustness

ASR: Problems

James Glass, MIT

ASR: Method

James Glass, MIT

ASR: Application

James Glass, MIT

Automatic Speech Recognition

James Glass, MIT

Automatic Speech Recognition

James Glass, MIT

Speech Production