git404hub

what is stopwords fr?

goto456/stopwords — explained in plain English

Analysis updated 2026-06-26

5,518Audience · dataComplexity · 1/5Setup · easy

tl;dr

A collection of four Chinese stopword text files from different research institutions, ready to drop into any Chinese text processing pipeline to filter out common low-meaning words before analysis or search.

vibe map

mindmap
  root((stopwords))
    What it is
      Chinese word lists
      Plain text files
      No code included
    Word lists
      General Chinese list
      Harbin Institute list
      Baidu stopwords
      Sichuan University list
    Use cases
      Text classifiers
      Search indexing
      NLP pipelines
    Audience
      Data engineers
      NLP researchers
      ML practitioners

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

what do people make with this?

VIBE 1

Filter common Chinese words out of text before running sentiment analysis or topic classification.

VIBE 2

Load one or more word lists into a search index to improve Chinese full-text search relevance.

VIBE 3

Use the Harbin or Baidu stopword list as a baseline for training a Chinese NLP or language model.

VIBE 4

Combine multiple lists to build a comprehensive Chinese stopword set for a data cleaning pipeline.

how it stacks up fr

goto456/stopwordsayn2op/discordodushixiang/next-terminal
Stars5,5185,5195,519
LanguageGoTypeScript
Setup difficultyeasymoderatehard
Complexity1/52/54/5
Audiencedatadeveloperops devops

Figures from each repo's GitHub metadata at analysis time.

how do i run it?

Difficulty · easy time til it works · 5min
No explicit license is stated in the repository.

in plain english

This repository is a collection of Chinese stopword lists in plain text format. Stopwords are common words that text-processing systems typically filter out before analyzing or searching content. In English, words like "the", "and", and "is" are typical stopwords. In Chinese, the equivalent are short, high-frequency words that carry little meaning on their own. The repository contains four separate word lists, each from a different source. One is a general Chinese stopword list. A second comes from the Harbin Institute of Technology, a well-known source for Chinese natural language processing research. A third is Baidu's stopword list. The fourth is from the machine intelligence lab at Sichuan University. Each list is a separate text file, so you can pick the one that fits your project or use them in combination. The README is minimal and consists mainly of a table mapping each list name to its filename. There is no code in this repository, no installation instructions, and no usage examples. You would typically use these files by loading them into a text processing pipeline, a search index, or a machine learning data-cleaning step that needs to strip common words from Chinese text before further analysis. This kind of resource is useful for anyone building search tools, text classifiers, or language models that process Chinese content.

prompts (copy fr)

prompt 1
I'm building a Chinese text classifier in Python. Show me how to load the Harbin Institute stopword list from this repo and use it to filter tokens before training.
prompt 2
Help me compare the four stopword lists in this repo and decide which one to use for a Baidu search-related project versus an academic NLP task.
prompt 3
I want to index Chinese product reviews in Elasticsearch. Show me how to configure a custom stopword filter using one of these text files.
prompt 4
Write a Python script that loads all four stopword list files from this repo, deduplicates them, and saves a combined master list.
prompt 5
Explain what stopwords are to a non-technical PM and why filtering them matters before running AI analysis on Chinese customer feedback.

Frequently asked questions

what is stopwords fr?

A collection of four Chinese stopword text files from different research institutions, ready to drop into any Chinese text processing pipeline to filter out common low-meaning words before analysis or search.

What license does stopwords use?

No explicit license is stated in the repository.

How hard is stopwords to set up?

Setup difficulty is rated easy, with roughly 5min to a first successful run.

Who is stopwords for?

Mainly data.

peek the repo → explain another one

This repo across BitVibe Labs

double-check against the repo, no cap.