Page Not Found
Page not found. Your pixels are in another canvas.
Sitemap
A list of all the posts and pages found on the site. For you robots out there is an XML version available for digesting as well.
Pages
Steven's Homepage
About me
Page not in menu
This is a page not in th emain menu
Posts
publications
Task Performing Agent Systems and Methods
Published in US Patent US12085947B2, UK Patent GB2598758B, Japan Patent JP7225292B2, 2024
Tags: reinforcement learning, robotics
Patent covering embodied visual navigation agents trained with reinforcement learning
talks
An Introduction to Reinforcement Learning
Published:
An hour-long talk deriving the basics of value-based and policy-based reinforcement learning.
Reinforcement Learning with Memory
Published:
Guest lecture on reinforcement learning with memory.
Reinforcement Learning under Partial Observability
Published:
Reinforcement learning agents have mastered complex games like Go, Atari, or DotA 2, outperforming the best humans on Earth. Yet, these impressive feats are constrained to games or simulations. What prevents us from training superintelligent robots using reinforcement learning? In this talk, we will explore one major roadblock: limited and imperfect sensor data. We will investigate deep memory models as a solution to this challenge. Our journey will cover a number of deep learning architectures, such as recurrent neural networks, graph neural networks, and linear transformers.
Value-Based Reinforcement Learning
Published:
A 1.5 hour tutorial on value-based reinforcement learning.
Deep Reinforcement Learning with Memory
Published:
Agents trained with deep reinforcement learning can benefit from long-term memory, improving reasoning capabilities just as it does in humans. In this talk, I will give an overview of my research on combining long-term memory with deep reinforcement learning, and some recent and surprising findings suggesting the emergence of fear in our memory-endowed agents.
Deep Decision Making
Published:
Guest lecture on deep decision making.
Understanding and Benchmarking Memory in RL
Published:
Invited talk on diagnosing and benchmarking memory in reinforcement learning.
Panel: Memory in Reinforcement Learning
Published:
Panel discussion on memory in reinforcement learning.
teaching
Mobile Robot Systems
University course, University of Cambridge, Department of Computer Science and Technology, 2021
Teaching students the first bits of robotics, with final projects utilizing ROS and turtlebots.
Introduction to Robotics
University course, University of Cambridge, Department of Computer Science and Technology, 2022
Teaching students the first bits of robotics, with final projects utilizing ROS and turtlebots.
Programming in C/C++
University course, University of Cambridge, Department of Computer Science and Technology, 2023
Teaching assistant for an undergraduate programming course.
Deep Reinforcement Learning
University course, University of Cambridge, Department of Computer Science and Technology, 2024
This is part of the R255 series for Part III and MPhil students. Slides are available here:
Introduction to Deep Learning
University course, University of Macau, Department of Computer and Information Science, 2024
A master’s level course on deep learning.
Special Topics in AI — Decision Making and Reinforcement Learning
University course, University of Macau, Department of Computer and Information Science, 2025
A master’s level course on decision making and reinforcement learning.
Introduction to Deep Learning
University course, University of Macau, Department of Computer and Information Science, 2025
A master’s level course on deep learning.
Special Topics in AI — Decision Making and Reinforcement Learning
University course, University of Macau, Department of Computer and Information Science, 2026
A master’s level course on decision making and reinforcement learning.