Advancing the impact of machine learning in natural sciences by explaining black-box systems with reverse correlation

titleAdvancing the impact of machine learning in natural sciences by explaining black-box systems with reverse correlation
start_date2025/07/09
schedule10h30
onlineno
location_infoamphi Jean-Jacques Gagnepain
summaryMachine learning (ML) systems are widely used in natural sciences to make complex predictions but often work as black boxes for their users, offering them little insights into the underlying representations driving their predictions. While these systems typically indicate the presence of relevant information in the data, they rarely reveal what this information is, concealing the biological mechanisms being studied. This limitation hampers interpretability and reduces the potential for even more meaningful scientific insights. Reverse correlation, originally developed in neuroscience to decode perceptual and cognitive processes, offers a solution to this challenge. By randomly perturbing system inputs and analyzing their responses, this method uncovers the behaviors of ML systems, identifying the features most critical to their functioning and shedding light on their hidden representations. I will first introduce the method, explaining how input perturbations and output analyses can help uncover system behavior. Next, I will present a proof of concept demonstrating its use in developing a voice biomarker for characterizing sleep deprivation. Finally, I will explore broader applications spanning musical timbre characterization, ecoacoustic marker development, and unveiling cerebral representations in auditory neuroscience, highlighting the potential of reverse correlation to advance the impact of machine learning across diverse fields of natural sciences.
responsiblesAucouturier, Villain