Signal Processing in Speech and Hearing

not applicable

The theoretical exposure with interaction of the students will allow to enhance the practical component in the resolution of exercises.

UC provides for a strong practical component of program development in Python involving the acquisition and treatment of audio signals.

The main goals is to provide the student with basic knowledge of signal and system theory, as well as an understanding of the audiological applications of signal theory.
The completion of this curricular unit will allow students to:
Describe the properties of signals in the domain of time and frequencies and explain the relationship between these descriptions;
Know and apply the fundamentals of digital signal processing to sound analysis, including speech sounds;
Understand auditory perception as a signal processing system and relate this knowledge to the functioning of hearing aids;
Acquire basic programming skills in Python that allow the student to perform audio signal processing operations, in particular speech sounds.
Know and apply the international phonetic alphabet
Acoustically and articulately classify the sounds of Portuguese European;
Relate the articulatory characteristics of sounds with their acoustic characteristics, using the analysis of spectrograms/sonograms.

Mathematics: Matrix concept. Operations with arrays and some properties Complex numbers – introduction to complex numbers; algebraic form; trigonometric form; graphic representation;
Convolution. Fourier transforms. Signal and System Processing
Fundamentals Digital Signals vs. Analog; Fundamental Concepts of Signal Processing.
Description of a non-harmonic signal; Modulation; Noise; Properties of linear and nonlinear systems; Signal processing with python: introduction to software, main software functions, characterization of different sound file formats, compression vs. compression formats, signal acquisition and production, basic operations with audio files, FFT and DFT functions, creation of frequency spectra and spectrograms, MFCCs and Honey spectrogram, filter application.
Phonetics
International phonetic alphabet
Articulatory phonetics: articulatory classification of the sounds of Portuguese European Acoustic phonetics: representation of the sounds of PE; sonogram analysis.

NAO

 Bibliografia principal

1. ROSEN e HOWELL, Signals and Systems for Speech and Hearing, Editora: Academic Press, Ano de Edição: 2001
2. DELGADO-MARTINS, Mª. Raquel, Ouvir Falar, Introdução à Fonética do Português, colecção Universitária, série Linguística, Editora: Editorial Caminho, Lisboa, Ano de Edição: 1988
3. ALLEN B. DOWNEY, Think DSP: Digital Signal Processing in Python, Editora: O’Reilly Media; Ano de Edição: 2016

Bibliografia secundária:

4. McLOUGHLIN, Speech and audio processing : a Matlab-based approach, Editora: New York, NY : Cambridge University Press, Ano de Edição: 2016