I am a Research Scientist at Huawei’s Research Center in Paris, where I work with Milad Sefidgaran on (Unsupervised) Reinforcement Learning and Generalization. I obtained my PhD in Information Technology at Politecnico di Milano advised by Prof. Marcello Restelli at the RL^3 Group.

You can check out my (hopefully up-to-date) CV here, but for the freshest updates, my Scholar or BlueSky profiles might be more reliable. And if you’re curious about anything, feel free to drop me an email, I’m always happy to chat!

My research is in Reinforcement Learning (RL), and I am especially interested in getting around some of the usual pain points, as training everything from scratch. Real-world applications don’t always play by those rules, unfortunately.

Lately, I have been focusing on what we’d better do before the agent is released in the wild, a field called unsupervised RL: things like pre-training models (policies, policy spaces, representations etc.) that make RL agents more general, more adaptable, and with a more diverse set of skills.

To that end, I have also dived into topics like partial observability, multi-agency, and decision-making under general utility functions. Throughout my PhD, I have also worked with Siemens’s Cyber Physical Systems Team in Wien to bring scalable multi-agent RL into industrial production scheduling, and with Inephany’s great team on how to leverage RL for hyperparameter optimization for large models.

News et al.

(2026)

• New pre-print out! In K-Myriad: Jump-starting Reinforcement Learning with Unsupervised Parallel Agents we expand over our ICML paper to push forward the boundaries of massive parallel policy pre-training for behavioral diversity and jump-start RL!
• Our work on unsupervised policy compression From Parameters to Behaviors: Unsupervised Compression of the Policy Space was accepted at ICLR 2026!
• Our spin-off Probing Dec-POMDP Reasoning in Cooperative MARL got accepted at AAMAS 2026! In this work, we challenge common benchmarks for multi-agent deicison-making, providing evidence that success on these benchmarks often comes from shortcuts!

(2025)

• I joined Huawei’s Research Center in Paris to continue working on Reinforcement Learning and other interesting stuff!
• I successfully defended my PhD Thesis!
• New pre-print out! In From Parameters to Behaviors: Unsupervised Compression of the Policy Space we investigated how to compress behaviors without supervision in a scalable fashion and show how to do policy optimization in the (latent) behavior space!
• After a couple of iterations, our work on unsupervised pre-training in MARL Towards Principled Unsupervised Multi-Agent Reinforcement Learning was accepted at NeurIPS 2025! See you in San Diego/Mexico City/Copenhagen!
• I gave a talk at Eugene Vinitsky’s amazing Emerge Lab about new frontiers in unsupervised pre-training for Reinforcement Learning. You can find a simplified slide deck here.
• Our position paper on Remembering the Markov Property in Cooperative MARL got accepted at the Finding the Frame workshop @ RLC 2025! The awesome Kale-ab will be in Edmonton to present it, stop by! Also, it won the best poster award at Deep Learning Indaba!
• I started a research collaboration with Inephany on the use of RL for large (language) models hyperparameter tuning. Excited to see what this will lead to!
• Good news for the explorers: the work with my amazing collaborators on Enhancing Diversity in Parallel Agents: A Maximum State Entropy Exploration Story was accepted at ICML 2025, and Towards Unsupervised Multi-Agent Reinforcement Learning via Task-Agnostic Exploration at the EXAIT workshop @ ICML 2025. See you in Vancouver!
• I am presenting our recent work Towards Principled Multi-Agent Task Agnostic Exploration at the UK Multi-Agent Systems Symposium. See you in London!
• Our work on Scalable Multi-Agent Offline Reinforcement Learning and the Role of Information was accepted at RLDM 2025! Down to chat about scalable solutions for Offline MARL in Dublin!

(2024)

• I am visiting David Abel and Stefano V. Albrecht at the Autonomous Agents Research Group in Edinburgh, U.K. for something like 6 months!
• I am giving a talk to the RL Virtual Reading Group about advancing our understanding of learning purely explorative policies in POMDPs. You can find the recording on You Tube.
• Grateful to be part of the Best Reviewer Award team at ICML2024.
• I am attending the Machine Learning Summer School in Onna, Japan.
• Our paper The Limits of Pure Exploration in POMDPs: When the Observation Entropy is Enough was accepted at the brand-new RLC 2024 conference! I’ll do a research tour between Vienna and Amherst to talk about unsupervised RL in POMDPs!
• Our paper How to explore with belief: state entropy maximization in POMDPs was accepted at ICML 2024.

(2023)

• I am attending the Reinforcement Learning Summer School in Barcelona, Spain.
• The first paper of my Ph.D. Distributional Policy Evaluation: a Maximum Entropy approach to Representation Learning was accepted at NeurIPS 2023! See you in New Orleans!

(2022)

• I am taking part to the organization of the 15th European Workshop on Reinforcement Learning in Milan, Italy.