Timezone: »
Bioacoustic data science aims at modeling animal sounds for neuroethology and biodiversity assessment. It has received increasing attention due to its diverse potential benefits. It is steadily required by regulatory agencies for timely monitoring of environmental impacts from human activities. Given the complexity of the collected data along with the numerous species and environmental contexts, bioacoustics requires robust information processing.
The features and biological significance of animal sounds, are constrained by the physics of sound production and propagation, and evolved through the processes of natural selection. This yields to new paradigms such as curriculum song learning, predator-prey acoustic loop, etc. NIPS4B solidifies an innovative computational framework by focusing on the principles of information processing, if possible in an inheretly hierarchical manner or with physiological parallels: Deep Belief Networks (DBN), Sparse Auto Encoders (SAE), Convolutional Networks (ConNet), Scattering transforms etc. It encourages interdisciplinary, scientific exchanges and foster collaborations, bringing together experts from machine learning and computational auditory scene analysis, within animal sound and communication systems.
One challenge concerns bird classification (on Kaggle): identify 87 species of Provence (recordings Biotope SA). It is the biggest bird song challenge according to our knowledge, more complex than ICML4B (sabiod.org/ICML4B2013proceedings.pdf). A second challenge concerns the representation of a remarkable humpback whale song (Darewin - La Reunion), in order to help its analysis. Other special session concerns (neural)modelisation of the biosonar of bats or dolphins.
References:
Glotin H, Dugan P, LeCun Y, Clark C, Halkias X, (2013) Proc. of the first workshop on Machine Learning for Bioacoustics, sabiod.org/ICML4B2013proceedings.pdf, ICML4B
Glotin H, (2013) Etho-Acoustics: Categorisation & Localisation into Soundscapes, Ed. Intech open book
Pace F, Benard F, Glotin H, Adam O, White P, (2010) Subunit definition for humpback whale call classification, J. Applied Acoustics, 11(71)
Glotin H, Caudal F, Giraudet P, (2008) Whales cocktail party: a real-time tracking of multiple whales, V.36(1), ISSN 0711-6659, sabiod.org/oncet, J. Canadian Acoustics
Benard F, Glotin H, (2010) Automatic indexing and content analysis of whale recordings & XML representation, EURASIP Adv. Signal Proc. for Maritime Applications
Farabet C, Couprie C, Najman L, LeCun Y, (2013) Learning Hierarchical Features for Scene Labeling, IEEE PAMI
LeCun, Y, Learning Invariant Feature Hierarchies, (2012) Workshop on Biological & Computer Vision Interfaces, LNCS, V7583, ECCV
Anden J, Mallat S, (2011) Scattering transform applied to audio signals & musical classification: Multiscale Scattering for Audio Classification, ISMIR
Lipkind D, Marcus GF...Tchernichovski O, (2013) Stepwise acquisition of vocal combinatorial capacity in songbirds & human infants, 10.1038/nature12173, Nature
Tchernichovski O, Wallman J, (2008) Neurons of imitation, 451(17), Nature
Lallemand I, Schwarz D, Artieres T, (2012) A Multiresolution Kernel Distance for SVM Classification of Environmental Sounds, SMC
Soullard Y, Artieres T, (2011) Hybrid HMM and HCRF model for sequence classification, ESANN
Halkias X, Ellis D, (2008) A Comparison of Pitch Extraction Methodologies for Dolphin Vocalizations, V36(1), J. Canadian Acoustics
Halkias X, Ellis D, (2006) Call Detection & Extraction Using Bayesian Inference, Special issue on Marine Mammal Detection, V67(11), J. Applied Acoustics
Halkias X, Paris S, Glotin H, (2013) Classification of mysticete sounds using machine learning techniques, 134, 3496, 10.1121/1.4821203, JASA
Author Information
Hervé GLOTIN (Univ Sud-Toulon & Inst. univ de France)
Yann LeCun (Facebook AI Research and New York University)
Yann LeCun is VP & Chief AI Scientist at Meta and Silver Professor at NYU affiliated with the Courant Institute of Mathematical Sciences & the Center for Data Science. He was the founding Director of FAIR (Meta's AI Research group) and of the NYU Center for Data Science. He received an Engineering Diploma from ESIEE (Paris) and a PhD from Sorbonne Université. After a postdoc in Toronto he joined AT&T Bell Labs in 1988, and AT&T Labs in 1996 as Head of Image Processing Research. He joined NYU as a professor in 2003 and Facebook in 2013. His interests include AI machine learning, computer perception, robotics and computational neuroscience. He is the recipient of the 2018 ACM Turing Award (with Geoffrey Hinton and Yoshua Bengio) for "conceptual and engineering breakthroughs that have made deep neural networks a critical component of computing", a member of the National Academy of Sciences, the National Academy of Engineering and a Chevalier de la Légion d’Honneur.
Thierry Artières (LIF / AMU)
Stephane Mallat (Ecole Polytechnique Paris)
Stéphane Mallat received the Ph.D. degree in electrical engineering from the University of Pennsylvania, in 1988. He was then Professor at the Courant Institute of Mathematical Sciences. In 1995, he became Professor in Applied Mathematics at Ecole Polytechnique, Paris. From 2001 to 2007 he was co-founder and CEO of a semiconductor start-up company. In 2012 he joined the Computer Science Department of Ecole Normale Supérieure, in Paris. Stéphane Mallat’s research interests include signal processing, computer vision, harmonic analysis and learning. He wrote a “Wavelet tour of signal processing: the sparse way”. In 1997, he received the Outstanding Achievement Award from the SPIE Society and was a plenary lecturer at the International Congress of Mathematicians in 1998. He also received the 2004 European IST Grand prize, the 2004 INIST-CNRS prize for most cited French researcher in engineering and computer science, and the 2007 EADS grand prize of the French Academy of Sciences.
Ofer Tchernichovski (Hunter College, CUNY)
Xanadu Halkias (University of the South Toulon)
More from the Same Authors
-
2021 : Deep generative models create new and diverse protein structures »
Zeming Lin · Tom Sercu · yann lecun · Alex Rives -
2022 Poster: The Effects of Regularization and Data Augmentation are Class Dependent »
Randall Balestriero · Leon Bottou · Yann LeCun -
2022 Poster: VICRegL: Self-Supervised Learning of Local Visual Features »
Adrien Bardes · Jean Ponce · Yann LeCun -
2022 Poster: Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone »
Zi-Yi Dou · Aishwarya Kamath · Zhe Gan · Pengchuan Zhang · Jianfeng Wang · Linjie Li · Zicheng Liu · Ce Liu · Yann LeCun · Nanyun Peng · Jianfeng Gao · Lijuan Wang -
2022 Poster: Pre-Train Your Loss: Easy Bayesian Transfer Learning with Informative Priors »
Ravid Shwartz-Ziv · Micah Goldblum · Hossein Souri · Sanyam Kapoor · Chen Zhu · Yann LeCun · Andrew Wilson -
2022 Poster: A Data-Augmentation Is Worth A Thousand Samples: Analytical Moments And Sampling-Free Training »
Randall Balestriero · Ishan Misra · Yann LeCun -
2022 Poster: projUNN: efficient method for training deep networks with unitary matrices »
Bobak Kiani · Randall Balestriero · Yann LeCun · Seth Lloyd -
2022 Poster: Contrastive and Non-Contrastive Self-Supervised Learning Recover Global and Local Spectral Embedding Methods »
Randall Balestriero · Yann LeCun -
2021 : Deep generative models create new and diverse protein structures »
Zeming Lin · Tom Sercu · yann lecun · Alex Rives -
2020 : Panel Discussion & Closing »
Yejin Choi · Alexei Efros · Chelsea Finn · Kristen Grauman · Quoc V Le · Yann LeCun · Ruslan Salakhutdinov · Eric Xing -
2020 : QA: Yann LeCun »
Yann LeCun -
2020 : Invited Talk: Yann LeCun »
Yann LeCun -
2020 Poster: Gibbs Sampling with People »
Peter Harrison · Raja Marjieh · Federico G Adolfi · Pol van Rijn · Manuel Anglada-Tort · Ofer Tchernichovski · Pauline Larrouy-Maestri · Nori Jacoby -
2020 Oral: Gibbs Sampling with People »
Peter Harrison · Raja Marjieh · Federico G Adolfi · Pol van Rijn · Manuel Anglada-Tort · Ofer Tchernichovski · Pauline Larrouy-Maestri · Nori Jacoby -
2020 Poster: Implicit Rank-Minimizing Autoencoder »
Li Jing · Jure Zbontar · yann lecun -
2019 : TBD »
Yann LeCun -
2018 Poster: GLoMo: Unsupervised Learning of Transferable Relational Graphs »
Zhilin Yang · Jake Zhao · Bhuwan Dhingra · Kaiming He · William Cohen · Russ Salakhutdinov · Yann LeCun -
2017 : Panel Session »
Neil Lawrence · Finale Doshi-Velez · Zoubin Ghahramani · Yann LeCun · Max Welling · Yee Whye Teh · Ole Winther -
2017 Tutorial: Geometric Deep Learning on Graphs and Manifolds »
Michael Bronstein · Joan Bruna · arthur szlam · Xavier Bresson · Yann LeCun -
2016 : Discussion panel »
Ian Goodfellow · Soumith Chintala · Arthur Gretton · Sebastian Nowozin · Aaron Courville · Yann LeCun · Emily Denton -
2016 : Energy-Based Adversarial Training and Video Prediction »
Yann LeCun -
2016 Symposium: Deep Learning Symposium »
Yoshua Bengio · Yann LeCun · Navdeep Jaitly · Roger Grosse -
2016 Poster: Disentangling factors of variation in deep representation using adversarial training »
Michael Mathieu · Junbo Jake Zhao · Junbo (Jake) Zhao · Aditya Ramesh · Pablo Sprechmann · Yann LeCun -
2016 Invited Talk: Predictive Learning »
Yann LeCun -
2015 : Large-Scale Optimization for Deep Learning »
Yann LeCun -
2015 Poster: Learning to Linearize Under Uncertainty »
Ross Goroshin · Michael Mathieu · Yann LeCun -
2015 Poster: Character-level Convolutional Networks for Text Classification »
Xiang Zhang · Junbo (Jake) Zhao · Yann LeCun -
2015 Poster: Deep learning with Elastic Averaging SGD »
Sixin Zhang · Anna Choromanska · Yann LeCun -
2015 Spotlight: Deep learning with Elastic Averaging SGD »
Sixin Zhang · Anna Choromanska · Yann LeCun -
2015 Tutorial: Deep Learning »
Geoffrey E Hinton · Yoshua Bengio · Yann LeCun -
2014 Poster: Exploiting Linear Structure Within Convolutional Networks for Efficient Evaluation »
Emily Denton · Wojciech Zaremba · Joan Bruna · Yann LeCun · Rob Fergus -
2014 Poster: Joint Training of a Convolutional Network and a Graphical Model for Human Pose Estimation »
Jonathan J Tompson · Arjun Jain · Yann LeCun · Christoph Bregler -
2014 Poster: Unsupervised Deep Haar Scattering on Graphs »
Xu Chen · Xiuyuan Cheng · Stephane Mallat -
2013 Poster: Robust Bloom Filters for Large MultiLabel Classification Tasks »
Moustapha M Cisse · Nicolas Usunier · Thierry Artières · Patrick Gallinari -
2012 Invited Talk: Classification with Deep Invariant Scattering Networks »
Stephane Mallat -
2011 Workshop: Deep Learning and Unsupervised Feature Learning »
Yoshua Bengio · Adam Coates · Yann LeCun · Nicolas Le Roux · Andrew Y Ng -
2011 Poster: Structured sparse coding via lateral inhibition »
arthur d szlam · Karol Gregor · Yann LeCun -
2010 Workshop: Deep Learning and Unsupervised Feature Learning »
Honglak Lee · Marc'Aurelio Ranzato · Yoshua Bengio · Geoffrey E Hinton · Yann LeCun · Andrew Y Ng -
2010 Demonstration: NeuFlow: a dataflow processor for convolutional nets and other real-time algorithms »
Yann LeCun -
2010 Spotlight: Learning Convolutional Feature Hierarchies for Visual Recognition »
koray kavukcuoglu · Pierre Sermanet · Y-Lan Boureau · Karol Gregor · Michael Mathieu · Yann LeCun -
2010 Poster: Learning Convolutional Feature Hierarchies for Visual Recognition »
koray kavukcuoglu · Pierre Sermanet · Y-Lan Boureau · Karol Gregor · Michael Mathieu · Yann LeCun -
2010 Poster: Regularized estimation of image statistics by Score Matching »
Diederik Kingma · Yann LeCun -
2007 Poster: Sparse Feature Learning for Deep Belief Networks »
Marc'Aurelio Ranzato · Y-Lan Boureau · Yann LeCun -
2006 Poster: Efficient Learning of Sparse Representations with an Energy-Based Model »
Marc'Aurelio Ranzato · Christopher Poultney · Sumit Chopra · Yann LeCun -
2006 Spotlight: Efficient Learning of Sparse Representations with an Energy-Based Model »
Marc'Aurelio Ranzato · Christopher Poultney · Sumit Chopra · Yann LeCun -
2006 Tutorial: Energy-Based Models: Structured Learning Beyond Likelihoods »
Yann LeCun