
I am currently a researcher at the Institute of Foundation Models (IFM), working on the pretraining of large language models, including optimal scaling laws, efficient parallelization, architecture design and optimization. I am particularly interested in contributions at the intersection of infrastructure, architecture and optimization, where co-designing all three can jointly improve hardware utilization and FLOP efficiency.
Before that, I did my PhD at Mila, Quebec AI Institute under the supervision of Ioannis Mitliagkas, with a focus on first-order optimization for deep learning (both theoretical and empirical). The core of my PhD research has been a deep dive into the assumptions used by theoretical frameworks studying optimization, to produce insights more practically relevant in the era of LLMs.
During my PhD, I had the priviledge to intern at ServiceNow Research with Joao Monteiro and Torsten Scholak, and at Apple MLR with Eugène Ndiaye. Before my PhD, I was a visiting scholar for a year at UC Berkeley’s EECS department under the supervision of Alexandre Bayen. I completed my Masters in applied mathematics at École Normale Supérieure de Paris-Saclay.