Human-Centered Artificial Intelligence

Hello, I’m Jingyao.

I am a Research Fellow and Postdoctoral Associate at the Massachusetts Institute of Technology (January 2025–present) and a recipient of the MIT–Novo Nordisk Artificial Intelligence Postdoctoral Fellowship (2025–2027). I am mentored by Prof. Rosalind Picard and work closely with Prof. Paul Pu Liang at the MIT Media Lab.

I received my B.E. (Hons) in Telecommunications Engineering and Ph.D. in Electrical Engineering from the University of New South Wales, Sydney, Australia, in 2020 and 2024, respectively. My Ph.D. was supervised by Associate Professor Vidhyasaharan Sethu, Professor Eliathamby Ambikairajah, and Dr. Ting Dang. My research advances signal processing, machine learning, and artificial intelligence, with a particular focus on speech and multisensory intelligence for human-centered engineering.

I am the lead author of the Best Paper Award at ACII 2023, and my work was recognized as a Top 3% Paper at IEEE ICASSP 2023. I was also named a Rising Star—Women in Engineering (2023). I serve as the Publications Chair for INTERSPEECH 2026.

Research

Research interests

My research advances signal processing, machine learning, and artificial intelligence through three interconnected directions:

01

Smartly Handling Ambiguity and Uncertainty in Human-Centered AI

Investigating how uncertainty, ambiguity, and subjectivity affect AI-driven decision-making in mental health, speech technology, and affective computing to improve interpretability and trustworthiness.

02

Temporal-Aware Modelling for Emotion and Mental Health

Developing machine learning models to track temporal changes in emotional states and mental health conditions, enabling personalized monitoring and early forecasting of emotion fluctuations, depression severity, and well-being trajectories.

03

Speech and Multisensory Intelligence for Human Behaviour Modelling

Designing holistic frameworks that integrate speech with other modalities—video, text, and physiological signals—to enable more reliable and context-aware inference of human affect and behaviours that generalizes across real-world conditions.

Path

Where I’ve been

From Sydney to Cambridge, working across speech, emotion, and responsible artificial intelligence.

MIT Media Lab

Postdoctoral Associate · Affective Computing

MIT–Novo Nordisk AI Postdoctoral Fellow · Host: Prof. Rosalind W. Picard

University of New South Wales

B.Eng. (Hons) in Telecommunications Engineering

First Class Honours · Dean’s Honours

Updates

Latest news

[talk]

Invited talk at the Ming Hsieh Department of Electrical and Computer Engineering, University of Southern California.

[talk]

Invited talk at the Agentic AI Summit 2026, UC Berkeley.

[talk]

Guest lecture for MIT MAS.S63: Affective Computing and Multimodal Interaction.

[talk]

Invited talks at the University of Melbourne and UNSW on ambiguity, subjectivity, and temporal dynamics.

[talk]

Invited talk at Novo Nordisk in Copenhagen on responsible affective AI.

[talk]

Invited presentation at the IEEE International Conference on AI and Data Analytics.

Recognition

Selected awards

AHA Micro-Grant

Temporal-Aware Time Series Analysis for Human Mental Behavior Modelling at the MIT Media Lab

MIT–Novo Nordisk Artificial Intelligence Postdoctoral Fellowship

One of 10 fellows in the cohort

Schmidt Science Fellows Program Nomination

One of two nominees selected by UNSW

University International Postgraduate Award

UNSW Ph.D. scholarship

Best Paper Award · ACII

Top paper at the flagship affective computing conference

Rising Stars · Women in Engineering

24 awardees at the Asian Deans’ Forum

Top 3% Paper · ICASSP

Flagship signal processing conference recognition

Winner · EET Three-Minute Thesis

UNSW

Runner-up · Engineering Three-Minute Thesis

UNSW

Current work

Selected projects

Journal Articles

Main figure from How Many Raters Do We Need? Analyses of Uncertainty in Estimating Ambiguity-Aware Emotion Labels

IEEE Transactions on Affective Computing · 2025

How Many Raters Do We Need? Analyses of Uncertainty in Estimating Ambiguity-Aware Emotion Labels

Quantifying how the number of annotators affects uncertainty when estimating ambiguity-aware emotion labels.
Affective ComputingMachine Learning

Jingyao Wu, Ting Dang, Vidhyasaharan Sethu, Eliathamby Ambikairajah

View paper ↗
Main figure from A Novel Markovian Framework for Integrating Absolute and Relative Ordinal Emotion Information

IEEE Transactions on Affective Computing · 2022

A Novel Markovian Framework for Integrating Absolute and Relative Ordinal Emotion Information

A Dynamic Ordinal Markov Model that integrates absolute and relative ordinal information for speech emotion prediction.
Affective ComputingSpeech ProcessingMachine Learning

Jingyao Wu, Ting Dang, Vidhyasaharan Sethu, Eliathamby Ambikairajah

View paper ↗
Main figure from Multimodal Affect Models: An Investigation of Relative Salience of Audio and Visual Cues for Emotion Prediction

Frontiers in Computer Science · 2021

Multimodal Affect Models: An Investigation of Relative Salience of Audio and Visual Cues for Emotion Prediction

Investigating the relative salience of audio and visual cues for predicting emotion state and emotion change.
Affective ComputingSpeech ProcessingMachine Learning

Jingyao Wu, Ting Dang, Vidhyasaharan Sethu, Eliathamby Ambikairajah

View paper ↗

Conference Papers & Preprints

Main figure from SHALA-LLM: Smartly Handling Ambiguous Labels in Aligning LLMs

arXiv · 2026

SHALA-LLM: Smartly Handling Ambiguous Labels in Aligning LLMs

A reinforcement-learning framework that aligns LLMs with annotator distributions while prioritizing highly ambiguous samples.
Affective ComputingSpeech ProcessingMachine Learning

Jingyao Wu, Ashley Wang, Keane Ong, Paul Pu Liang, Rosalind Picard

View paper ↗
Main figure from Decoding Ambiguous Emotions with Test-Time Scaling in Audio-Language Models

arXiv · 2026

Decoding Ambiguous Emotions with Test-Time Scaling in Audio-Language Models

A benchmark of audio-language models and test-time scaling strategies for recognizing ambiguous emotions in speech.
Affective ComputingSpeech ProcessingMachine Learning

Hong Jia*, Weibin Li*, Jingyao Wu*, Xiaofeng Yu, Yan Gao, Jintao Cheng, Xiaoyu Tang, Feng Xia, Ting Dang

View paper ↗
Main figure from Human Behavior Atlas: Benchmarking Unified Psychological and Social Behavior Understanding

ICLR 2026

Human Behavior Atlas: Benchmarking Unified Psychological and Social Behavior Understanding

A unified multimodal benchmark spanning affective, cognitive, pathological, and social behavior understanding.
Affective ComputingMachine Learning

Keane Ong, Wei Dai, Carol Li, Dewei Feng, Hengzhi Li, Jingyao Wu, Jiaee Cheong, Rui Mao, Gianmarco Mengaldo, Erik Cambria, Paul Pu Liang

View paper ↗
Main figure from AMBER2: Dual Ambiguity-Aware Emotion Recognition Applied to Speech and Text

ICASSP 2026

AMBER2: Dual Ambiguity-Aware Emotion Recognition Applied to Speech and Text

Dual ambiguity-aware emotion recognition across speech and text for more human-aligned affective AI.
Affective ComputingSpeech ProcessingMachine Learning

Jingyao Wu, Grace Lin, Yinuo Song, Rosalind W. Picard

View paper ↗
Main figure from When One Modality Sabotages the Others: A Diagnostic Lens on Multimodal Reasoning

NeurIPS 2025 Workshop

When One Modality Sabotages the Others: A Diagnostic Lens on Multimodal Reasoning

A model-agnostic diagnostic framework for identifying when one modality misleads multimodal reasoning.
Affective ComputingMachine Learning

Chenyu Zhang, Minsol Kim, Shohreh Ghorbani, Jingyao Wu, Rosalind Picard, Patricia Maes, Paul Pu Liang

View paper ↗
Main figure from Emotions as Ambiguity-Aware Ordinal Representations

ACII 2025

Emotions as Ambiguity-Aware Ordinal Representations

Representing both individual and group-level ambiguity through ordinal emotion labels for continuous emotion recognition.
Affective ComputingMachine Learning

Jingyao Wu, Matthew Barthet, David Melhart, Georgios N. Yannakakis

View paper ↗
Main figure from A Study of Speech Embedding Similarities Between Australian Aboriginal and High-Resource Languages

INTERSPEECH 2025

A Study of Speech Embedding Similarities Between Australian Aboriginal and High-Resource Languages

Studying speech-embedding similarities between Australian Aboriginal languages and 107 high-resource languages.
Speech ProcessingMachine Learning

Eliathamby Ambikairajah, Jingyao Wu, Ting Dang, Vidhyasaharan Sethu

View paper ↗
Main figure from Dual-Constrained Dynamical Neural ODEs for Ambiguity-Aware Continuous Emotion Prediction

INTERSPEECH 2024

Dual-Constrained Dynamical Neural ODEs for Ambiguity-Aware Continuous Emotion Prediction

An ambiguity-aware CD-NODE framework for modeling the temporal dynamics of continuous emotion distributions.
Affective ComputingSpeech ProcessingMachine Learning

Jingyao Wu, Ting Dang, Vidhyasaharan Sethu, Eliathamby Ambikairajah

View paper ↗
Main figure from Can Modelling Inter-Rater Ambiguity Lead to Noise-Robust Continuous Emotion Predictions?

INTERSPEECH 2024

Can Modelling Inter-Rater Ambiguity Lead to Noise-Robust Continuous Emotion Predictions?

Using inter-rater ambiguity to improve the noise robustness of continuous emotion recognition.
Affective ComputingSpeech ProcessingMachine Learning

Ya-Tse Wu, Jingyao Wu, Vidhyasaharan Sethu, Chi-Chun Lee

View paper ↗
Main figure from Belief Mismatch Coefficient: A Novel Interpretable Measure of Prediction Accuracy for Ambiguous Emotion States

ACII 2023

🏆 Best Paper Award — ACII 2023

Belief Mismatch Coefficient: A Novel Interpretable Measure of Prediction Accuracy for Ambiguous Emotion States

An interpretable measure for comparing predicted and inferred emotion distributions under ambiguity.
Affective ComputingMachine Learning

Jingyao Wu, Ting Dang, Vidhyasaharan Sethu, Eliathamby Ambikairajah

View paper ↗
Main figure from Constrained Dynamical Neural ODE for Time Series Modelling: A Case Study on Continuous Emotion Prediction

ICASSP 2023

⭐ Top 3% Paper Recognition — ICASSP 2023

Constrained Dynamical Neural ODE for Time Series Modelling: A Case Study on Continuous Emotion Prediction

A constrained Neural ODE framework for learning valid continuous emotion trajectories from speech.
Affective ComputingSpeech ProcessingMachine Learning

Ting Dang, Antoni Dimitriadis, Jingyao Wu, Vidhyasaharan Sethu, Eliathamby Ambikairajah

View paper ↗
Main figure from From Interval to Ordinal: A HMM-Based Approach for Emotion Label Conversion

INTERSPEECH 2023

From Interval to Ordinal: A HMM-Based Approach for Emotion Label Conversion

An HMM-based approach that converts continuous interval emotion ratings into temporally consistent ordinal labels.
Affective ComputingSpeech ProcessingMachine Learning

Jingyao Wu, Ting Dang, Vidhyasaharan Sethu, Eliathamby Ambikairajah

View paper ↗
Main figure from A Novel Sequential Monte Carlo Framework for Predicting Ambiguous Emotion States

ICASSP 2022

A Novel Sequential Monte Carlo Framework for Predicting Ambiguous Emotion States

A sequential Monte Carlo framework for predicting time-varying ambiguous emotion states as distributions.
Affective ComputingSpeech ProcessingMachine Learning

Jingyao Wu, Ting Dang, Vidhyasaharan Sethu, Eliathamby Ambikairajah

View paper ↗

Community

Professional service

Committee service

Reviewer

Journals: IEEE Transactions on Affective Computing; IEEE Transactions on Audio, Speech and Language Processing; Computer Speech & Language.

Conferences: EMNLP, ICASSP, INTERSPEECH, ACII, and ACIS.

Beyond research

Beyond the lab

Dance

I am a street dancer specializing in hip-hop, with extensive experience in crew performance, freestyle, and choreography across multiple styles.

Instruments

I have played piano continuously since age four (China Conservatory of Music Piano Grade 9 / 中国音乐学院钢琴九级) and drum kit since age six.