Signal Processing in Speech and Hearing

-1 T/P(1h/s) class, exposure of programmatic contents and application of physical and mathematical concepts.
-2 Classes T/P (2h/s), presentation of a representative set of algorithms applied in audio signal processing operations
and their interpretation;
– PL class (1h/s), accompanied programming activities, involving the application in new contexts of the algorithms presented in the T/P component.
The continuous evaluation scheme is optional:
1) Algorithms/programming exercises (A) to be solved with each class (PL matrix).
2) 2 written evaluation tests (PE1 + PE2) (matrix TP).
The final score is given by the average of the ratings obtained at all evaluation moments:
Final Score = (A + PE1 + PE2)/3, in which PE represents the average of the classification obtained in the various papers (A), and PE1 and PE2 represents the evaluation obtained in the written evaluation tests.
The means of the components of the T/P matrix and PL mean evaluation must be equal to or greater than 9 values.

The main goals is to provide the student with basic knowledge of signal and system theory, as well as an understanding of the audiological applications of signal theory.
The completion of this curricular unit will allow students to:
Describe the properties of signals in the domain of time and frequencies and explain the relationship between these descriptions;
Know and apply the fundamentals of digital signal processing to sound analysis, including speech sounds;
Understand auditory perception as a signal processing system and relate this knowledge to the functioning of hearing aids;
Acquire basic programming skills in Python that allow the student to perform audio signal processing operations, in particular speech sounds.
Know and apply the international phonetic alphabet
Acoustically and articulately classify the sounds of Portuguese European;
Relate the articulatory characteristics of sounds with their acoustic characteristics, using the analysis of spectrograms/sonograms.

Mathematics: Matrix concept. Operations with arrays and some properties Complex numbers – introduction to complex numbers; algebraic form; trigonometric form; graphic representation;
Convolution. Fourier transforms. Signal and System Processing
Fundamentals Digital Signals vs. Analog; Fundamental Concepts of Signal Processing.
Description of a non-harmonic signal; Modulation; Noise; Properties of linear and nonlinear systems; Signal processing with python: introduction to software, main software functions, characterization of different sound file formats, compression vs. compression formats, signal acquisition and production, basic operations with audio files, FFT and DFT functions, creation of frequency spectra and spectrograms, MFCCs and Honey spectrogram, filter application.
Phonetics
International phonetic alphabet
Articulatory phonetics: articulatory classification of the sounds of Portuguese European Acoustic phonetics: representation of the sounds of PE; sonogram analysis.

NAO