
arXiv · 2026
SHALA-LLM: Smartly Handling Ambiguous Labels in Aligning LLMs
A reinforcement-learning framework that aligns LLMs with annotator distributions while prioritizing highly ambiguous samples.
Affective ComputingSpeech ProcessingMachine Learning
Jingyao Wu, Ashley Wang, Keane Ong, Paul Pu Liang, Rosalind Picard
View paper ↗
arXiv · 2026
Decoding Ambiguous Emotions with Test-Time Scaling in Audio-Language Models
A benchmark of audio-language models and test-time scaling strategies for recognizing ambiguous emotions in speech.
Affective ComputingSpeech ProcessingMachine Learning
Hong Jia*, Weibin Li*, Jingyao Wu*, Xiaofeng Yu, Yan Gao, Jintao Cheng, Xiaoyu Tang, Feng Xia, Ting Dang
View paper ↗
ICLR 2026
Human Behavior Atlas: Benchmarking Unified Psychological and Social Behavior Understanding
A unified multimodal benchmark spanning affective, cognitive, pathological, and social behavior understanding.
Affective ComputingMachine Learning
Keane Ong, Wei Dai, Carol Li, Dewei Feng, Hengzhi Li, Jingyao Wu, Jiaee Cheong, Rui Mao, Gianmarco Mengaldo, Erik Cambria, Paul Pu Liang
View paper ↗
ICASSP 2026
AMBER2: Dual Ambiguity-Aware Emotion Recognition Applied to Speech and Text
Dual ambiguity-aware emotion recognition across speech and text for more human-aligned affective AI.
Affective ComputingSpeech ProcessingMachine Learning
Jingyao Wu, Grace Lin, Yinuo Song, Rosalind W. Picard
View paper ↗
NeurIPS 2025 Workshop
When One Modality Sabotages the Others: A Diagnostic Lens on Multimodal Reasoning
A model-agnostic diagnostic framework for identifying when one modality misleads multimodal reasoning.
Affective ComputingMachine Learning
Chenyu Zhang, Minsol Kim, Shohreh Ghorbani, Jingyao Wu, Rosalind Picard, Patricia Maes, Paul Pu Liang
View paper ↗
ACII 2025
Emotions as Ambiguity-Aware Ordinal Representations
Representing both individual and group-level ambiguity through ordinal emotion labels for continuous emotion recognition.
Affective ComputingMachine Learning
Jingyao Wu, Matthew Barthet, David Melhart, Georgios N. Yannakakis
View paper ↗
INTERSPEECH 2025
A Study of Speech Embedding Similarities Between Australian Aboriginal and High-Resource Languages
Studying speech-embedding similarities between Australian Aboriginal languages and 107 high-resource languages.
Speech ProcessingMachine Learning
Eliathamby Ambikairajah, Jingyao Wu, Ting Dang, Vidhyasaharan Sethu
View paper ↗
INTERSPEECH 2024
Dual-Constrained Dynamical Neural ODEs for Ambiguity-Aware Continuous Emotion Prediction
An ambiguity-aware CD-NODE framework for modeling the temporal dynamics of continuous emotion distributions.
Affective ComputingSpeech ProcessingMachine Learning
Jingyao Wu, Ting Dang, Vidhyasaharan Sethu, Eliathamby Ambikairajah
View paper ↗
INTERSPEECH 2024
Can Modelling Inter-Rater Ambiguity Lead to Noise-Robust Continuous Emotion Predictions?
Using inter-rater ambiguity to improve the noise robustness of continuous emotion recognition.
Affective ComputingSpeech ProcessingMachine Learning
Ya-Tse Wu, Jingyao Wu, Vidhyasaharan Sethu, Chi-Chun Lee
View paper ↗
ACII 2023
🏆 Best Paper Award — ACII 2023
Belief Mismatch Coefficient: A Novel Interpretable Measure of Prediction Accuracy for Ambiguous Emotion States
An interpretable measure for comparing predicted and inferred emotion distributions under ambiguity.
Affective ComputingMachine Learning
Jingyao Wu, Ting Dang, Vidhyasaharan Sethu, Eliathamby Ambikairajah
View paper ↗
ICASSP 2023
⭐ Top 3% Paper Recognition — ICASSP 2023
Constrained Dynamical Neural ODE for Time Series Modelling: A Case Study on Continuous Emotion Prediction
A constrained Neural ODE framework for learning valid continuous emotion trajectories from speech.
Affective ComputingSpeech ProcessingMachine Learning
Ting Dang, Antoni Dimitriadis, Jingyao Wu, Vidhyasaharan Sethu, Eliathamby Ambikairajah
View paper ↗
INTERSPEECH 2023
From Interval to Ordinal: A HMM-Based Approach for Emotion Label Conversion
An HMM-based approach that converts continuous interval emotion ratings into temporally consistent ordinal labels.
Affective ComputingSpeech ProcessingMachine Learning
Jingyao Wu, Ting Dang, Vidhyasaharan Sethu, Eliathamby Ambikairajah
View paper ↗
ICASSP 2022
A Novel Sequential Monte Carlo Framework for Predicting Ambiguous Emotion States
A sequential Monte Carlo framework for predicting time-varying ambiguous emotion states as distributions.
Affective ComputingSpeech ProcessingMachine Learning
Jingyao Wu, Ting Dang, Vidhyasaharan Sethu, Eliathamby Ambikairajah
View paper ↗