git404hub

what is distributed fr?

sinhrks/distributed — explained in plain English

Analysis updated 2026-07-18 · repo last pushed 2017-01-21

PythonAudience · dataComplexity · 4/5DormantSetup · hard

tl;dr

A Python library for spreading code across a cluster of machines so large datasets and heavy computations finish in minutes instead of hours.

vibe map

mindmap
  root((repo))
    What it does
      Splits work across machines
      Runs tasks in parallel
      Combines results
    Tech stack
      Python
      Cluster coordination
    Use cases
      Analyze huge datasets
      Run simulations
      Train ML models
    Audience
      Data scientists
      Researchers
      ML engineers
    Coordination
      Task scheduling
      Data movement

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

what do people make with this?

VIBE 1

Analyze millions of customer records faster by spreading the work across a cluster

VIBE 2

Run thousands of experiment variations simultaneously to find the best approach

VIBE 3

Train a machine learning model on a dataset too large for a single machine

VIBE 4

Process a large dataset in minutes instead of hours by parallelizing across multiple servers

what's the stack?

Python

how it stacks up fr

sinhrks/distributed0xallam/my-recipe0xhassaan/nn-from-scratch
Stars——0
LanguagePythonPythonPython
Last pushed2017-01-212022-11-22—
MaintenanceDormantDormant—
Setup difficultyhardmoderatemoderate
Complexity4/52/54/5
Audiencedatageneraldeveloper

Figures from each repo's GitHub metadata at analysis time.

how do i run it?

Difficulty · hard time til it works · 1h+

Requires setting up and coordinating multiple machines as a cluster before you can run distributed jobs.

prompts (copy fr)

prompt 1
Show me how to take an existing Python data-processing script and run it across multiple machines with this library.
prompt 2
Explain how this library decides which machine runs which task and moves data between them.
prompt 3
Help me set up a small cluster to test this library before scaling up to a production dataset.
prompt 4
Walk me through writing a distributed computation with this library for training a machine learning model.

Frequently asked questions

what is distributed fr?

A Python library for spreading code across a cluster of machines so large datasets and heavy computations finish in minutes instead of hours.

What language is distributed written in?

Mainly Python. The stack also includes Python.

Is distributed actively maintained?

Dormant — no commits in 2+ years (last push 2017-01-21).

How hard is distributed to set up?

Setup difficulty is rated hard, with roughly 1h+ to a first successful run.

Who is distributed for?

Mainly data.

peek the repo → explain another one

This repo across BitVibe Labs

double-check against the repo, no cap.

similar repos, if this ain't it