git404hub

what is auto-sft fr?

theprint/auto-sft — explained in plain English

Analysis updated 2026-05-18

8PythonAudience · developerComplexity · 4/5Setup · hard

tl;dr

Auto-SFT automates hyperparameter search for LoRA fine-tuning, then runs one full training pass with the winning settings and can export the result to Hugging Face.

vibe map

mindmap
  root((Auto-SFT))
    What it does
      Hyperparameter search
      Full fine-tune
      GGUF export
    Tech stack
      Python
      PyTorch
      Unsloth
      Docker
    Use cases
      Tune your model
      Compare outputs
      Share on Hugging Face
    Audience
      ML researchers
      Developers
    Setup
      Docker
      CUDA GPU required

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

what do people make with this?

VIBE 1

Fine-tune an open-source language model on your own dataset without manually guessing hyperparameters.

VIBE 2

Compare base model output against a fine-tuned version before committing to a full training run.

VIBE 3

Export a fine-tuned model to GGUF format and upload it to Hugging Face automatically.

what's the stack?

PythonPyTorchUnslothDockerCUDA

how it stacks up fr

theprint/auto-sft100/awesome-machine-learningadam-s/car-diagnosis
Stars888
LanguagePythonPythonPython
Last pushed2024-08-07
MaintenanceStale
Setup difficultyhardeasymoderate
Complexity4/51/53/5
Audiencedeveloperdeveloperresearcher

Figures from each repo's GitHub metadata at analysis time.

how do i run it?

Difficulty · hard time til it works · 1h+

Requires an NVIDIA GPU with CUDA, there is no CPU fallback for fine-tuning.

in plain english

Auto-SFT is a Python tool that automates part of the process of fine-tuning AI language models. Fine-tuning means taking an existing base model and training it further on your own data so it performs better at a specific task. The project is inspired by an idea from AI researcher Andrej Karpathy. The tool works in three steps. First, you give it a base model and a training dataset. It then runs many short, cheap trial fine-tuning runs, each using different settings such as learning rate and LoRA rank, a technique that lets you fine-tune a model efficiently without retraining every parameter. It scores each trial either by asking another AI to judge the outputs, or by running standard benchmark tests. Once it finds the settings that perform best, it runs one full length fine-tune using those settings. From there it can export the finished model in a compressed format called GGUF and optionally upload it to Hugging Face, a popular hub for sharing AI models. Auto-SFT includes a web interface where you can start and stop training runs, watch progress and loss curves in real time, compare outputs from the base model against the tuned one, and manage settings, all without touching the command line if you prefer. Setup can be done through Docker, which packages everything needed to run the tool, or through a native Python install using pip. The project uses a library called unsloth to speed up training, though a standard PEFT training path is also supported. A working NVIDIA GPU with CUDA is required for the actual fine-tuning step, and there is no option to run it on a regular computer processor. This project has 8 stars and is written in Python. It suits people who already have a dataset and a base model in mind and want to skip manually guessing at training settings.

prompts (copy fr)

prompt 1
Help me set up Auto-SFT with Docker to fine-tune Qwen2.5-0.5B on my training data.
prompt 2
Explain the difference between the LLM-as-judge and lm-eval evaluation modes in Auto-SFT.
prompt 3
Walk me through configuring a hybrid search strategy in Auto-SFT with an exploit threshold.
prompt 4
Show me how to export my fine-tuned Auto-SFT model to GGUF and push it to Hugging Face.

Frequently asked questions

what is auto-sft fr?

Auto-SFT automates hyperparameter search for LoRA fine-tuning, then runs one full training pass with the winning settings and can export the result to Hugging Face.

What language is auto-sft written in?

Mainly Python. The stack also includes Python, PyTorch, Unsloth.

How hard is auto-sft to set up?

Setup difficulty is rated hard, with roughly 1h+ to a first successful run.

Who is auto-sft for?

Mainly developer.

peek the repo → explain another one

This repo across BitVibe Labs

double-check against the repo, no cap.