# open-llm

**Repository Path**: cai-wangfa/open-llm

## Basic Information

- **Project Name**: open-llm
- **Description**: 大模型学习
- **Primary Language**: Unknown
- **License**: Not specified
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2026-07-04
- **Last Updated**: 2026-07-13

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

## 下载数据集

```bash
cd dataset

wget https://www.modelscope.cn/datasets/gongjy/minimind_dataset/resolve/master/pretrain_t2t_mini.jsonl

wget https://www.modelscope.cn/datasets/gongjy/minimind_dataset/resolve/master/sft_t2t_mini.jsonl
```

## 预训练

```bash
uv run python -m  trainer.train_pretrain
```

#### 继续预训练

```bash
uv run python -m  trainer.train_pretrain --resume_from out_pretrain/checkpoint-步数
```

## SFT微调训练

```bash
uv run python -m trainer.train_sft
```

#### 继续预训练

```bash
uv run python -m trainer.train_sft --resume_from out_sft/checkpoint-步数
```

## 推理

```bash
uv run python -m inference.inference_chat --model_path out_sft/checkpoint-步数
```