Bio

I am a research scientist at DeepMind. I obtained a Ph.D. from the Sierra and Willow groups. I was supervised by Simon Lacoste-Julien, Ivan Laptev and Josef Sivic. Before that, I graduated from Ecole polytechnique and Telecom ParisTech in 2015 and got a Masters Degree in Mathematics, Machine Learning and Computer Vision (MVA). My work focuses on structured learning from video and natural language. More details can be found in my resume.

Publications

A Flexible Model for Training Action Localization with Varying Levels of Supervision
Guilhem Chéron*, Jean-Baptiste Alayrac*, Ivan Laptev and Cordelia Schmid.
Accepted to NeurIPS 2018. *equal contribution.
SeaRnn: Training RNNs with Global-Local Losses
Rémi Leblond*, Jean-Baptiste Alayrac*, Anton Osokin and Simon Lacoste-Julien.
Accepted to ICLR 2018. *equal contribution.
Joint Discovery of Object States and Manipulation Actions
Jean-Baptiste Alayrac, Josef Sivic, Ivan Laptev and Simon Lacoste-Julien.
In Proc. ICCV 2017.
Learning from narrated instruction videos
Jean-Baptiste Alayrac, Piotr Bojanowski, Nishant Agrawal, Ivan Laptev, Josef Sivic and Simon Lacoste-Julien.
In TPAMI 2017 (Journal version of Unsupervised learning from narrated instruction videos)
Learning from Video and Text via Large-Scale Discriminative Clustering
Antoine Miech, Jean-Baptiste Alayrac, Piotr Bojanowski, Ivan Laptev and Josef Sivic.
In Proc. ICCV 2017 (Spotlight).
Minding the Gaps for Block Frank-Wolfe Optimization of Structured SVMs
Jean-Baptiste Alayrac*, Anton Osokin*, Isabella Lukasewitz, Puneet K. Dokania and Simon Lacoste-Julien.
In Proc. ICML 2016. *equal contribution.
Unsupervised learning from narrated instruction videos
Jean-Baptiste Alayrac, Piotr Bojanowski, Nishant Agrawal, Ivan Laptev, Josef Sivic and Simon Lacoste-Julien.
In Proc. CVPR 2016 (Oral).

PhD Thesis

Structured Learning from Videos and Language
Jean-Baptiste Alayrac

Teaching

Statistical machine learning - Master M1 - Ecole normale supérieure, TA, 2015-2016.
1M001 : Analyse et algèbre pour les sciences, Universite Pierre et Marie Curie, TA, 2014-2016.
1M004 : Calcul matriciel, Universite Pierre et Marie Curie, TA, 2014-2016.
2M223 : Algèbre bilinéaire et géométrie, Universite Pierre et Marie Curie, TA, 2014-2015.

Other projects

Simple sketch recognizer used in an exhibition at Palais de la Découverte.