git404hub

what is dexverse fr?

ycyao216/dexverse — explained in plain English

Analysis updated 2026-05-18

69PythonAudience · researcherComplexity · 5/5Setup · hard

tl;dr

A research benchmark for testing robot hands on dexterous manipulation tasks, built on NVIDIA Isaac Sim.

vibe map

mindmap
  root((DexVerse))
    What it does
      Dexterous manipulation benchmark
      Multi robot hand support
      Multi task suite
    Tech stack
      Python
      Isaac Sim Lab
      PyTorch CUDA
    Use cases
      Benchmark robot hands
      Record VR demos
      Simulate manipulation tasks
      Debug joints
    Audience
      Robotics researchers
      ML researchers
    Setup
      Install Isaac Sim
      Install Isaac Lab
      Download HF assets
    Status
      Task suite released
      Teleop tooling released
      Baseline code pending
      More robots pending

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

what do people make with this?

VIBE 1

Benchmark different robot hands on the same set of standardized manipulation tasks.

VIBE 2

Record human demonstrations through VR teleoperation for training robot policies.

VIBE 3

Test a manipulation task suite in simulation before deploying to real hardware.

VIBE 4

Debug robot joint configurations with the included slider based UI.

what's the stack?

PythonIsaac SimIsaac LabPyTorchCUDAHugging Face

how it stacks up fr

ycyao216/dexverse8bit64k/cronalyticsalibaba-damo-academy/rynnworld-4d
Stars696969
LanguagePythonPythonPython
Setup difficultyhardeasy
Complexity5/52/5
Audienceresearcherops devopsresearcher

Figures from each repo's GitHub metadata at analysis time.

how do i run it?

Difficulty · hard time til it works · 1day+

Requires a GPU, NVIDIA Isaac Sim, a specific Isaac Lab version, and manual dependency fixes.

in plain english

DexVerse is a research benchmark for teaching robots to perform dexterous, hands on manipulation tasks on a tabletop, such as picking up and handling objects with articulated robot hands. It is built as an extension on top of NVIDIA Isaac Sim and Isaac Lab, which are simulation frameworks used in robotics research. The project comes from a group of university researchers at UNC Chapel Hill, the University of Hong Kong, and UC Berkeley, and its goal is to let different robot hands and different manipulation tasks be tested against the same set of standardized environments. The repository is organized as an installable Python package under source/dexverse, which holds the actual task definitions, robot hand configurations, teleoperation device support, and shared utilities, plus a separate scripts folder with runnable entry points such as listing available tasks, running dummy test agents, recording human demonstrations through VR teleoperation, and a debug interface for manually moving robot joints. Large files like robot hand models, object meshes, and demonstration recordings are not stored in the repository itself. Instead they are downloaded separately from a gated Hugging Face dataset after the user logs in and accepts the dataset terms. Getting this running is a significant undertaking. It requires installing NVIDIA Isaac Sim and a specific version of Isaac Lab into a conda environment, along with matched versions of PyTorch built for CUDA, and several manual dependency fixes for known conflicts between these tools. Only after Isaac Lab is fully installed can the DexVerse package itself be installed as an extension. A GPU capable of running Isaac Sim is assumed throughout. As of this README, the project has shipped its initial task suite, robot and object assets, and its teleoperation and data collection tooling with documentation. Baseline environment demonstrations and baseline training code, a full demonstration dataset for the Shadow Hand, and support for additional robot hand types beyond the currently released Shadow Hand are all listed as still in progress. This project is aimed at robotics and machine learning researchers working on manipulation, not general software developers.

prompts (copy fr)

prompt 1
Walk me through installing Isaac Sim, Isaac Lab, and DexVerse step by step for my system.
prompt 2
Explain what each folder under source/dexverse is responsible for.
prompt 3
Help me write a new task definition following the existing task configs in this repo.
prompt 4
Show me how the teleoperation and demo recording scripts work together.
prompt 5
Explain the dependency conflicts mentioned in the installation guide and how the fixes address them.

Frequently asked questions

what is dexverse fr?

A research benchmark for testing robot hands on dexterous manipulation tasks, built on NVIDIA Isaac Sim.

What language is dexverse written in?

Mainly Python. The stack also includes Python, Isaac Sim, Isaac Lab.

How hard is dexverse to set up?

Setup difficulty is rated hard, with roughly 1day+ to a first successful run.

Who is dexverse for?

Mainly researcher.

peek the repo → explain another one

This repo across BitVibe Labs

double-check against the repo, no cap.