# Baichuan2-Explained

**Repository Path**: ljtlrh_admin/Baichuan2-Explained

## Basic Information

- **Project Name**: Baichuan2-Explained
- **Description**: No description available
- **Primary Language**: Python
- **License**: Apache-2.0
- **Default Branch**: main
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 1
- **Created**: 2023-11-20
- **Last Updated**: 2023-11-20

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

# Baichuan2-Explained
Baichuan2代码的逐行解析版本，适合小白




* [fine-tune/](./fine-tune)
  * [fine-tune.py/](./fine-tune/fine-tune.py)
    * class ModelArguments : const model_name_or_path
    * class DataArguments : const data_path
    * class TrainingArguments ： const cache_dir、const optim、const model_max_length、 const use_lora、
    * class SupervisedDataset
  * func train 
* [web_demo.py/](./web_demo.py)
  * [ads_generation.md（分布式运行范例）](./examples/ads_generation.md)
* [./Baichuan2-13B-Chat/modelling_baichuan.py](./Baichuan2-13B-Chat/modelling_baichuan.py)
  * const logger
  * func _get_interleave
  * func _get_interleave_power_of_2
  * func _fill_with_neg_inf
  * func _buffered_future_mask
  * func _gen_alibi_mask
  * class RMSNorm
    * func __init__
    * func forward
  * class MLP
    * func __init__
    * func __init__
    * func _shape
    * func forward
  * class BaichuanLayer
    * func __init__
    * func forward
  * class BaichuanPreTrainedModel

* [README.md](./README.md)



# CSDN彩色博客版：
* [./Baichuan2-13B-Chat/modelling_baichuan.py](https://blog.csdn.net/sinat_37574187/article/details/133090157?csdn_share_tail=%7B%22type%22%3A%22blog%22%2C%22rType%22%3A%22article%22%2C%22rId%22%3A%22133090157%22%2C%22source%22%3A%22sinat_37574187%22%7D)
  * [Baichuan2源码解析之：Baichuan2-13B-Chat/modelling_baichuan.py](https://blog.csdn.net/sinat_37574187/article/details/133090157?csdn_share_tail=%7B%22type%22%3A%22blog%22%2C%22rType%22%3A%22article%22%2C%22rId%22%3A%22133090157%22%2C%22source%22%3A%22sinat_37574187%22%7D)
* [src/](./ChatGLM-Efficient-Tuning-Explained/src)
  * [CSDN彩色源码解析fine-tune/fine-tune.py (一)](https://blog.csdn.net/sinat_37574187/article/details/132783096?csdn_share_tail=%7B%22type%22%3A%22blog%22%2C%22rType%22%3A%22article%22%2C%22rId%22%3A%22132783096%22%2C%22source%22%3A%22sinat_37574187%22%7D)
    * [common.py](./ChatGLM-Efficient-Tuning-Explained/src/utils/common.py)
    * [peft_trainer.py](./ChatGLM-Efficient-Tuning-Explained/src/utils/peft_trainer.py)
  * [CSDN彩色源码解析web_demo.py](https://blog.csdn.net/sinat_37574187/article/details/132779405?csdn_share_tail=%7B%22type%22%3A%22blog%22%2C%22rType%22%3A%22article%22%2C%22rId%22%3A%22132779405%22%2C%22source%22%3A%22sinat_37574187%22%7D)
* [README.md](./ChatGLM-Efficient-Tuning-Explained/README.md)

ChatGLM Efficient Tuning源码解析train_sft.py   https://zengxiaojian.blog.csdn.net/article/details/131458667


## 引用 - 源项目

```bibtex
@Misc{Baichuan2,
  title = {Baichuan2},
  author = {Baichuan2},
  howpublished = {\url{https://github.com/baichuan-inc/Baichuan2}},
  year = {2023}
}
```