git404hub

what is recuriosity fr?

recuriosity/recuriosity — explained in plain English

Analysis updated 2026-05-18

23PythonAudience · researcherComplexity · 5/5Setup · hard

tl;dr

Research code that trains an AI agent to explore 3D indoor spaces using only a camera, rewarding it for building a better 3D reconstruction of what it sees.

vibe map

mindmap
  root((recuriosity))
    What it does
      Trains exploration agents
      Rewards better 3D reconstruction
      Uses Gaussian Splatting
    Tech stack
      Python
      Habitat simulator
      DINO visual encoder
      PPO reinforcement learning
    Use cases
      Reproduce exploration research
      Fine tune for object retrieval
      Fine tune for image goal navigation
    Audience
      Robotics researchers
      AI researchers

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

what do people make with this?

VIBE 1

Reproduce the paper's 3D exploration training results

VIBE 2

Fine-tune the pretrained checkpoint for an apple-picking retrieval task

VIBE 3

Fine-tune the pretrained checkpoint for image-goal navigation

VIBE 4

Compare against alternative reward designs using the included ablation variants

what's the stack?

PythonHabitatDINOPPOGaussian Splatting

how it stacks up fr

recuriosity/recuriosityaaravkashyap12/advise-project-approachabu-rayhan-alif/django-saas-kit
Stars232323
LanguagePythonPythonPython
Setup difficultyhardeasymoderate
Complexity5/52/53/5
Audienceresearcherdeveloperdeveloper

Figures from each repo's GitHub metadata at analysis time.

how do i run it?

Difficulty · hard time til it works · 1day+

Training the main model needs 8 high-end GPUs and three to six days.

Unknown from the description, check the repository for license terms.

in plain english

This repository contains the official code for a research paper titled "Remember to be Curious: Episodic Context and Persistent Worlds for 3D Exploration," from researchers at the University of Toronto, UC Berkeley, Wayve, and affiliated institutions. The project trains an AI agent to navigate and explore 3D indoor environments using only what it can see through a simulated RGB camera, without any map or position sensor. The core idea is that the agent learns to explore by building up a 3D reconstruction of the scene it is moving through, and uses the quality of that reconstruction as a reward signal. When the agent visits new areas or views that fill in gaps in its mental model of the room, it gets a higher reward. The reconstruction system is called Gaussian Splatting, a technique that represents 3D scenes as collections of small translucent blobs rather than explicit geometry. As the agent moves, this reconstruction is updated in real time and used to score how useful the current view is. The agent itself uses a visual encoder called DINO to process camera frames, and a transformer-based policy with a sliding attention window so it can remember recent context without growing unbounded memory use. The training algorithm is PPO, a standard reinforcement learning approach that balances exploration and exploitation. All of this is built on top of the Habitat simulation platform, which provides realistic indoor 3D environments from the HM3D and Gibson scene datasets. Once trained on exploration, the same checkpoint can be fine-tuned for other tasks. The repository includes fine-tuned versions for apple picking (navigate to and collect small objects) and image-goal navigation (find a location that matches a target photograph). Pretrained checkpoints are available on HuggingFace for all three tasks. Training the main exploration model requires 8 high-end GPUs and takes about three to six days depending on configuration. The code is organized into modules for the policy architecture, environment wrappers, evaluation scripts, and training scripts, with ablation variants provided so researchers can reproduce comparisons against alternative designs such as RNN backbones or curiosity-based reward baselines.

prompts (copy fr)

prompt 1
Explain how Gaussian Splatting is used as a reward signal in this project
prompt 2
Walk me through setting up the Habitat simulator to run this training code
prompt 3
Show me how to load one of the pretrained HuggingFace checkpoints for evaluation
prompt 4
Help me understand the sliding attention window used in the policy network

Frequently asked questions

what is recuriosity fr?

Research code that trains an AI agent to explore 3D indoor spaces using only a camera, rewarding it for building a better 3D reconstruction of what it sees.

What language is recuriosity written in?

Mainly Python. The stack also includes Python, Habitat, DINO.

What license does recuriosity use?

Unknown from the description, check the repository for license terms.

How hard is recuriosity to set up?

Setup difficulty is rated hard, with roughly 1day+ to a first successful run.

Who is recuriosity for?

Mainly researcher.

peek the repo → explain another one

This repo across BitVibe Labs

double-check against the repo, no cap.