git404hub

what is fim-midtraining fr?

tiger-ai-lab/fim-midtraining — explained in plain English

Analysis updated 2026-05-18

16PythonAudience · researcherComplexity · 5/5LicenseSetup · hard

tl;dr

Research code and pretrained models that add a training step teaching coding AI models to recover hidden functions, improving coding-agent benchmark results.

vibe map

mindmap
  root((repo))
    What it does
      Hides functions in code
      Trains recovery skill
      Improves agent benchmarks
    Tech stack
      Python
      vLLM
      Hugging Face
    Use cases
      Reproduce paper results
      Serve released models
    Audience
      ML researchers
      Coding agent engineers

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

what do people make with this?

VIBE 1

Reproduce or extend the paper's mid-training step for coding-focused language models.

VIBE 2

Serve one of the six released model checkpoints to evaluate on coding agent benchmarks.

VIBE 3

Study the released 400,000-sample dataset and data construction pipeline for masking functions in code.

what's the stack?

PythonvLLMHugging Face

how it stacks up fr

tiger-ai-lab/fim-midtraining920linjerry-stack/capital-studioadya84/ha-world-cup-2026
Stars161616
LanguagePythonPythonPython
Setup difficultyhardeasyeasy
Complexity5/53/52/5
Audienceresearcherresearchergeneral

Figures from each repo's GitHub metadata at analysis time.

how do i run it?

Difficulty · hard time til it works · 1h+

Requires serving large language models with vLLM and familiarity with model training and benchmark evaluation pipelines.

Apache 2.0 license: use freely for any purpose, including commercial use, as long as you keep the copyright and license notices.

in plain english

FIM-Midtraining is the research code and released models behind a paper about improving AI coding agents, the kind of AI system that writes code, runs it, observes the result, and continues. The core idea is that a function call in ordinary code has a similar shape to one step of a coding agent's loop: something is passed in, something is computed elsewhere, and the result gets used afterward. The project trains a language model to get better at that pattern by hiding functions in existing code and having the model practice recovering them, choosing which functions to hide based on how complex and how guessable they are, rather than picking them at random. This extra training step happens between a model's original pretraining and the later stage where it is taught to act as an agent. The project's main finding is that adding this step improves results on coding agent benchmarks like SWE-Bench, and that the improvement survives even after the later agent training stage, across several different base models and several different agent training methods. The repository includes six released model checkpoints on Hugging Face built on top of Qwen2.5-Coder and Qwen3 models, a 400,000 sample training dataset built from permissively licensed Python repositories, the data construction pipeline, training configuration files, and evaluation guides. A quickstart example shows how to serve the strongest released model using vLLM, a tool for running large language models efficiently. This project is aimed at machine learning researchers and engineers working on training or evaluating coding focused language models, not at general software developers. It assumes familiarity with model training pipelines and benchmark evaluation. The project is released under the Apache 2.0 license.

prompts (copy fr)

prompt 1
Explain how the function-hiding mid-training step relates to a coding agent's act, observe, continue loop.
prompt 2
Help me set up vLLM to serve the FIM-8B model checkpoint locally.
prompt 3
Walk me through how functions are selected for masking based on complexity and inferability scores.
prompt 4
Summarize how this project's SWE-Bench results compare across the different base models and post-training methods.

Frequently asked questions

what is fim-midtraining fr?

Research code and pretrained models that add a training step teaching coding AI models to recover hidden functions, improving coding-agent benchmark results.

What language is fim-midtraining written in?

Mainly Python. The stack also includes Python, vLLM, Hugging Face.

What license does fim-midtraining use?

Apache 2.0 license: use freely for any purpose, including commercial use, as long as you keep the copyright and license notices.

How hard is fim-midtraining to set up?

Setup difficulty is rated hard, with roughly 1h+ to a first successful run.

Who is fim-midtraining for?

Mainly researcher.

peek the repo → explain another one

This repo across BitVibe Labs

double-check against the repo, no cap.