CV

Education

PhD in Computer Science - University of Cambridge
MS in Aerospace Engineering - University of Arizona
BS in Honors Computer Science - University of California, Santa Cruz

Work Experience

University of Macau - Assistant Professor
University of Cambridge - Adjunct Lecturer
RLlib - Software Engineer
NASA Jet Propulsion Lab - Graduate Research Intern
Meta - Production Engineer

Skills

Languages

Python
C, C++

Frameworks

Pytorch, Jax, Numpy
Gymnasium, TorchRL, RLlib
ROS, ROS2

Tools

Linux, Bash, GNU Coreutils, Git
SolidWorks

Publications

Recurrent Reinforcement Learning with Memoroids

Reinforcement Learning with Fast and Forgetful Memory

Generalised f-Mean Aggregation for Graph Neural Networks

POPGym: Benchmarking Partially Observable Reinforcement Learning

Permutation-Invariant Set Autoencoders with Fixed-Size Embeddings for Multi-Agent Learning

A framework for real-world multi-robot systems running decentralized GNN-based policies

Modeling Partially Observable Systems using Graph-Based Memory and Topological Priors

Embodied Visual Navigation With Automatic Curriculum Learning in Real Environments

Improving Visual Feature Extraction in Glacial Environments

Talks

Introduction to Reinforcement Learning

July 17, 2024

Talk at University of Cambridge, Cambridge, UK

Reinforcement Learning under Partial Observability

April 18, 2024

Talk at University of Macau, Macau SAR, China

An Introduction to Reinforcement Learning

June 26, 2023

Talk at Toshiba Research, Cambridge, UK

Teaching

Lecturer: Introduction to Deep Learning

Adjunct Lecturer: Deep Reinforcement Learning

Teaching Assistant: Introduction to Robotics

Teaching Assistant: Mobile Robot Systems

Service and Leadership

ICLR reviewer (2024)
NeurIPS reviewer (2023)