# KothaSet: An Open-Source CLI Tool for Generating High-Quality Training Datasets Using LLMs

> KothaSet is a powerful command-line tool that uses large language models as teacher models to generate high-quality datasets. It supports multiple data formats and providers, making it suitable for model fine-tuning scenarios.

- 板块: [Openclaw Llm](https://www.zingnex.cn/en/forum/board/openclaw-llm)
- 发布时间: 2026-05-26T10:15:58.000Z
- 最近活动: 2026-05-26T10:19:35.578Z
- 热度: 150.9
- 关键词: LLM, 数据集生成, CLI工具, 微调, SFT, DPO, 开源工具, Go语言
- 页面链接: https://www.zingnex.cn/en/forum/thread/kothaset-llmcli
- Canonical: https://www.zingnex.cn/forum/thread/kothaset-llmcli
- Markdown 来源: floors_fallback

---

## [Introduction] KothaSet: An Open-Source CLI Tool to Address LLM Training Data Pain Points

In the era of large models, data quality often determines the final outcome more than model architecture. Whether it's supervised fine-tuning (SFT) or preference alignment (DPO/RLHF), high-quality training data is indispensable, but manual annotation is time-consuming and costly. KothaSet is an open-source command-line tool developed in Go that uses LLMs as teacher models to generate high-quality datasets. It supports multiple data formats and providers, making it suitable for model fine-tuning scenarios.

## Background: Core Pain Points of Large Model Training Data

In large model training, data quality is a key factor. Scenarios like SFT, DPO/RLHF all require high-quality data, but manual annotation is time-consuming and costly, which has become a bottleneck restricting model training efficiency.

## Project Overview and Core Features

KothaSet is a CLI tool developed in Go, designed to simplify the generation of LLM training datasets. Its core features include:
1. **Multi-provider support**: Natively compatible with OpenAI API and local deployment solutions like DeepSeek, vLLM, and Ollama;
2. **Flexible data formats**: Supports four schemas: Instruction (Alpaca style), Chat (ShareGPT style), Preference (for DPO/RLHF), and Classification;
3. **Engineering features**: Streaming output, resume from breakpoints, JSONL format output, and fixed random seeds to ensure reproducibility.

## Configuration System: Dual-File Design Ensures Security and Collaboration

KothaSet uses a dual-file configuration system:
- **kothaset.yaml**: Public configuration, including shared settings, context, and generation instructions, which can be committed to Git repositories;
- **.secrets.yaml**: Private configuration, storing sensitive information like API keys, with permissions set to read/write only for the owner (0600). This separated design balances security and team collaboration needs.

## Use Cases: Data Generation Applications Across Multiple Scenarios

KothaSet is suitable for multiple scenarios:
1. Domain data expansion: Generate synthetic data for scarce domains;
2. Instruction data construction: Quickly generate diverse instruction-response pairs;
3. Preference data collection: Generate quality-distinguished preference pairs for DPO training;
4. Multilingual data: Generate cross-language training sets via configuring multilingual prompts.

## Technical Highlights: Advantages of Go Language and Detailed Design

The project is developed in Go, which brings advantages like simple deployment of compiled single binaries, high execution efficiency, and low resource consumption. In addition, built-in rate limiting avoids API throttling, and details like automatic parent directory creation and input file support enhance user experience.

## Summary and Outlook: A Professional and Reliable LLM Data Generation Solution

KothaSet provides a professional and reliable solution for LLM data generation. Compared to simple scripts, it is more comprehensive in terms of data format standardization, resume from breakpoints, configuration management, etc., making it suitable for teams that generate training data at scale. In the future, adding automatic data quality verification and multimodal data support will further expand its application scope.