git404hub

what is disco-rl-pytorch fr?

lucidrains/disco-rl-pytorch — explained in plain English

Analysis updated 2026-05-18

16PythonAudience · researcherComplexity · 4/5Setup · moderate

tl;dr

A work-in-progress PyTorch implementation of DiscoRL, a method from a 2025 Nature paper by David Silver for automatically discovering which reinforcement learning algorithms perform best rather than relying on human-designed ones.

vibe map

mindmap
  root((repo))
    What It Does
      DiscoRL algorithm
      Auto RL discovery
      Reference implementation
    Research Basis
      Nature 2025 paper
      David Silver DeepMind
      Test-time training link
    Tech Stack
      Python
      PyTorch
    Status
      Work in progress
      Minimal documentation
    Audience
      RL researchers
      AI paper readers

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

what do people make with this?

VIBE 1

Study the DiscoRL algorithm from the 2025 Nature paper by reading a clean PyTorch reference implementation.

VIBE 2

Experiment with automated reinforcement learning algorithm discovery by running DiscoRL on your own environments.

what's the stack?

PythonPyTorch

how it stacks up fr

lucidrains/disco-rl-pytorch920linjerry-stack/capital-studioadya84/ha-world-cup-2026
Stars161616
LanguagePythonPythonPython
Setup difficultymoderateeasyeasy
Complexity4/53/52/5
Audienceresearcherresearchergeneral

Figures from each repo's GitHub metadata at analysis time.

how do i run it?

Difficulty · moderate time til it works · 1h+

Work in progress with minimal documentation, requires reading the DiscoRL paper to understand the algorithm before using the code.

in plain english

This repository is a PyTorch implementation of DiscoRL, short for Discovering state-of-the-art reinforcement learning algorithms. The research it is based on was published in Nature in 2025 and represents the last work David Silver completed at DeepMind. Reinforcement learning is a field of AI where a system learns by trial and error, receiving rewards for good actions and penalties for bad ones, DiscoRL is a method for automatically discovering which learning algorithms perform best rather than relying on human-designed ones. The repository is marked as a work in progress, and the README is minimal: it contains a diagram, a brief description, and citation references for the underlying research paper and a related paper on test-time training. There is no setup guide, usage documentation, or code walkthrough provided at this stage. The project comes from lucidrains, a prolific open-source contributor known for implementing recent AI research papers in PyTorch as learning and reference resources.

prompts (copy fr)

prompt 1
I am reading the DiscoRL Nature 2025 paper by David Silver. Walk me through how the disco-rl-pytorch implementation maps to the core algorithm described in the paper.
prompt 2
I want to run disco-rl-pytorch on a custom Gym environment. What interface does my environment need to implement to plug in?
prompt 3
The repository is marked as a work in progress. Which parts of the DiscoRL algorithm are already implemented and which are still missing or stubbed out?

Frequently asked questions

what is disco-rl-pytorch fr?

A work-in-progress PyTorch implementation of DiscoRL, a method from a 2025 Nature paper by David Silver for automatically discovering which reinforcement learning algorithms perform best rather than relying on human-designed ones.

What language is disco-rl-pytorch written in?

Mainly Python. The stack also includes Python, PyTorch.

How hard is disco-rl-pytorch to set up?

Setup difficulty is rated moderate, with roughly 1h+ to a first successful run.

Who is disco-rl-pytorch for?

Mainly researcher.

peek the repo → explain another one

This repo across BitVibe Labs

double-check against the repo, no cap.