About me


I’m passionate about Reinforcement Learning (RL) education and its applications in the video game industry.

After a Bachelor's Degree in Law and Political Sciences in 2016, I decided to self-study mathematics, deep learning and deep reinforcement learning. I'm graduated from Deep Learning Foundations and Artificial Intelligence Nanodegree by Udacity.

In 2018, I founded the Deep Reinforcement Learning Course, a free open source series of articles and videos from beginner to expert where we learn the main algorithms and how to implement them with Tensorflow and PyTorch. The course is a success with + 35,000 claps and about 5,000 readers per week.

I believe that innovation comes from sharing knowledge with open education. That's why my course is free and why my projects are open-source.

From March 2019, I worked at Dataiku in Paris as a Research Scientist in Reinforcement Learning to build real-world applications using RL (dynamic pricing, yield management...). I decided to leave the company in September 2020 to focus on working in the video game industry.

My goal is to have an impact on RL by building free educational content and creating agents for video game projects.

My Resume Contact Me

Some recent projects

Battle Tanks!

Battle Tanks! [2021]

Battle Tanks! is a game based on Tanks! by Unity, where you need to destroy your smart AI opponent. The AI is made using Deep Reinforcement Learning and Unity ML-Agents.

Deep Reinforcement Learning Course

Deep Reinforcement Learning Course v2.0🕹️ [2018 - 2021]

[NEW VERSION IN PROGRESS] A free course about Deep Reinforcement Learning, where we'll learn the main algorithms, and how to implement them with Tensorflow and PyTorch.

Start Learning
The Mayan Adventure

The Mayan Adventure [2020]

The Mayan Adventure is an open-source reinforcement learning environment for Unity ML-Agents. In this environment, you train your agent (Indie) to find the golden statue in this dangerous environment full of traps.

Check the project
CatDCGAN

CatDCGAN 🐱‍💻 [2018]

An open source AI that generates pictures of cats 🐱‍💻.

Look at the cats 😸

My recent talks

Rework 19

RE-WORK Deep Learning Summit 2019: Curiosity Driven Learning

Curiosity Driven Learning is one of the most exciting and promising strategy in deep reinforcement learning: we create agents that are able to produce rewards and learn from them. In this workshop, you’ll learn what is curiosity, how it works, and understand the process of how an agent generates this intrinsic reward using a trained agent in a video game environment. By the end of this workshop, you'll be able to understand how curiosity driven learning agents work and the main elements needed to implement them.

Learn More
Rework simonini thomas

RE-WORK Deep Learning Summit 2019: Interview

Watch The Interview