Tile Coder - tile coding visualizer icon

tile-coder-ts

A tile coder that runs on your browser. A classic representation used for linear function approximation in reinforcement learning.

August 2026 · Kevin Roice

On the Conservation of Mutual Information

Machine Learning, like many disciplines, uses random vairables (RVs) to model the outcomes of events. Loosely speaking, these are variables that can take on any value in some set, each with some probability.1 As you could imagine, such a general definition allows RVs to describe the outcomes of a wide range of events. These could be the pixel values from taking a photograph, the words that follow a paragraph, the temperature readings from a doctor’s thermometer, or even the observations and actions from an agent interacting with its environment. ...

May 2026 · Kevin Roice
DeployedisContinual

Position: Deployed Reinforcement Learning should be Continual

ICML 2026 Paper Poster Presentation

Many deployments are continual RL problems approximated as non-continual. We term these ‘measurable deployments’.

May 2026 · Parnian Behdin*, Kevin Roice*, Golnaz Mesbahi