Sitemap

A list of all the posts and pages found on the site. For you robots out there is an XML version available for digesting as well.

Pages

Posts

portfolio

publications

talks

Reinforcement Learning under Partial Observability

Published:

Reinforcement learning agents have mastered complex games like Go, Atari, or DotA 2, outperforming the best humans on Earth. Yet, these impressive feats are constrained to games or simulations. What prevents us from training superintelligent robots using reinforcement learning? In this talk, we will explore one major roadblock: limited and imperfect sensor data. We will investigate deep memory models as a solution to this challenge. Our journey will cover a number of deep learning architectures, such as recurrent neural networks, graph neural networks, and linear transformers.

teaching

Teaching Assistant: Mobile Robot Systems

University course, University of Cambridge, Department of Computer Science and Technology, 2021

Teaching students the first bits of robotics, with final projects utilizing ROS and turtlebots.

Teaching Assistant: Introduction to Robotics

University course, University of Cambridge, Department of Computer Science and Technology, 2022

Teaching students the first bits of robotics, with final projects utilizing ROS and turtlebots.

Adjunct Lecturer: Deep Reinforcement Learning

University course, University of Cambridge, Department of Computer Science and Technology, 2024

This is part of the R255 series for Part III and MPhil students. Slides are available here: