Talks

Conferences & Workshops


Value-Based Reinforcement Learning

July 17, 2024

Talk, Cambridge ELLIS Unit Summer School on Probabilistic Machine Learning, Cambridge, UK

A 1.5 hour tutorial on value-based reinforcement learning.

Invited Talks


Deep Reinforcement Learning with Memory

January 01, 2025

Talk, Emotional AI Forum at the University of Macau, Macau SAR, China

Agents trained with deep reinforcement learning can benefit from long-term memory, improving reasoning capabilities just as it does in humans. In this talk, I will give an overview of my research on combining long-term memory with deep reinforcement learning, and some recent and surprising findings suggesting the emergence of fear in our memory-endowed agents.

Reinforcement Learning under Partial Observability

April 18, 2024

Talk, University of Macau, Macau SAR, China

Reinforcement learning agents have mastered complex games like Go, Atari, or DotA 2, outperforming the best humans on Earth. Yet, these impressive feats are constrained to games or simulations. What prevents us from training superintelligent robots using reinforcement learning? In this talk, we will explore one major roadblock: limited and imperfect sensor data. We will investigate deep memory models as a solution to this challenge. Our journey will cover a number of deep learning architectures, such as recurrent neural networks, graph neural networks, and linear transformers.

Guest Lectures


Deep Decision Making

January 01, 2025

Guest Lecture, University of Macau STGC 8003, Macau SAR, China

Guest lecture on deep decision making.