Multimedia/Multimodal Signal Analysis and Enhancement Laboratory

The MuSAE Lab boasts:

• A soundproof data collection room with multimedia displays of various sizes
• A data collection control room
• Several multicore analysis PCs and servers (with GPU) for powerful parallel computing analyses

The following systems are available for neurophysiological signal acquisition:

Electroencephalography (EEG)

• 64-Channel ActiveTwo (Biosemi)
• EMOTIV EEG headset

EMOTIV EPOC+ headset

• Interaxon Muse headbands (x4)
• Enobio 8-channel wireless headset

Near-infrared Spectroscopy (NIRS)

• 384-channel NIRScout
• 64-channel portable NIRSport

Physiological signals

• Zephyr Bioharness 3
• Shimmer platinum kit
• MbientLab Metawear CPRO wireless sensors

Empatica E4 wristband

• QSensor GSR affective monitor
• Myo EMG gesture control armband (Thalmic Labs)

Hexoskin garment

• iHealth wireless blood pressure monitor
• ActiveTwo-compatible skin temperature, blood volume pulse, respiration, and skin conductance sensors, as well as a 3D accelerometer

Eye tracking

• Head-mounted EyeLink 1000
• SMI ETG eye tracking glasses with EMOTIV EEG integration
• Tobii EyeX Development Kit

Hearing assessment

• Interacoustics AD629e audiometer

Other

• Microsoft Kinect Developer Kit
• Oculus Rift Development Kit (DK1 and DK2)
• NVIDIA Tesla K40C GPU cluster
• Lego MINDSTORMS EV3
• Orbotix Sphero 2.0
• Autonomous Deep Learning Robot

Software

• EMSE Suite (with BCI extensions)
• Labview
• Presentation
• ITU-T POLQA

The MuSAE Lab is available to INRS Énergie Matériaux Télécommunications Research Centre faculty, students, and staff for their research projects.

Lab resources and expertise can also be used for external collaborations or research and development contracts.

Contact us for more information.

Applications are developed in the following key areas:

Anthropomorphic technology

• Distributed quality-aware multimedia communications
• Neural correlates of natural and synthesized speech quality perception
• Neurophysiological models for “quality-of-experience” prediction
• Psychoacoustic modelling for the objective assessment of reverberant and dereverberated speech quality
• Environment-robust speaker identification
• Multimodal affective state modelling

Health monitoring and diagnoses

• Quality measurement and enhancement of biomedical signals (e.g., ECG, EEG, EMG)
• EEG-based diagnosis of Alzheimer’s disease
• Spectrotemporal signal analysis for cardiopulmonary signals
• Assistive technology for voiceless communications
• Objective quantification of handwriting difficulties in school-age children
• Remote monitoring of dysarthric speech intelligibility

Human/machine interaction

• Intelligent signal processing for body area networks
• Hybrid brain-computer interfaces
• Peripheral autonomic signals for binary control of body/machine interfaces
• BCI and eye-gaze-based serious gaming
• Adaptive multimodal HCIs
• Environment-robust voice-based human/machine interaction

The MuSAE Lab was created in December 2012 with funding from the Canada Foundation for Innovation (CFI) and Ministère de l’Éducation, du Loisir et du Sport.

Through partnerships with the Center for Research on Brain, Language and Music (CRBLM) and the Center for Interdisciplinary Research in Music Media and Technology (CIRMMT), MuSAE Lab teams have access to state-of-the-art recording facilities.

Research at the MuSAE Lab is supported by various provincial and federal research agencies, the INRS Énergie Matériaux Télécommunications Research Centre, manufacturers, and industry partners.