(3 FaSP) Fundamental principles of multimedia signal processing; application to digital audio and video processing; human computer interface considerations; immersive audio and video system design considerations. (Duplicates credit in EE 320.) Corequisite: ITP 411x.

 

Textbook:

None

 

Coordinator:

Chris Kyriakakis, Associate Professor of Electrical Engineering

 

Topics:

1. Signal processing fundamentals for digital media.
2. Convolution, Fourier Transforms, and filters for integrated media systems.
3. Digital Audio: D/A and A/D conversion, Aliasing, Dither, Pulse Code Modulation.
4. Spatial Audio: Psychoacoustics fundamentals, head-related transfer functions, multichannel audio, DSP for immersive audio.
5. Digital Video: Display technology, basics of human vision, digital video basics, DVD, HDTV.

 

Course Objectives:

To introduce the student to the fundamental mathematical and engineering principles behind digital media processing and the requirements of integrated media systems. To impress upon students the importance of including the human user’s requirements in designing such systems.

 

Course Outcomes:

The student will be able to:
1. Understand the basics of signals and systems.
2. Characterize linear systems using the impulse response method.
3. Apply the above to digital audio and video systems.
4. Understand digital media representations and limitations due to aliasing and quantization noise.
5. Use Fourier Transforms to manipulate and transform audio and video signals.
6. Understand the basics of the human hearing and vision mechanisms and their impact on the design of audio and video systems.

 

Laboratory Projects:

Although this is not a lab course, several lectures are held in the state-of-the-art ISMC Immersive Audio Laboratory facility. The students participate in demonstrations of multichannel audio rendering, HDTV acquisition and rendering, ear impulse response measurements, and display quality optimization methods.