60 lines
1.2 KiB
Markdown
60 lines
1.2 KiB
Markdown
---
|
||
license: CC BY NC 4.0
|
||
#用户自定义标签
|
||
tags:
|
||
- finetune
|
||
- alpaca
|
||
- gpt4
|
||
|
||
text:
|
||
TextGeneration:
|
||
样本规模:
|
||
- 10k-100k
|
||
language:
|
||
- zh
|
||
语言:
|
||
- 中文
|
||
---
|
||
|
||
|
||
## 数据集描述
|
||
该数据集为GPT-4生成的中文数据集，用于LLM的指令精调和强化学习等。
|
||
|
||
|
||
|
||
### 数据集加载方式
|
||
```python
|
||
from modelscope.msdatasets import MsDataset
|
||
ds = MsDataset.load("alpaca-gpt4-data-zh", namespace="AI-ModelScope", split="train")
|
||
print(next(iter(ds)))
|
||
```
|
||
|
||
### 数据分片
|
||
数据已经预设了train分片。
|
||
|
||
|
||
|
||
## 数据集版权信息
|
||
数据集已经开源，license为CC BY NC 4.0（仅用于非商业化用途），如有违反相关条款，随时联系modelscope删除。
|
||
|
||
|
||
## 引用方式
|
||
```
|
||
@article{peng2023gpt4llm,
|
||
title={Instruction Tuning with GPT-4},
|
||
author={Baolin Peng, Chunyuan Li, Pengcheng He, Michel Galley, Jianfeng Gao},
|
||
journal={arXiv preprint arXiv:2304.03277},
|
||
year={2023}
|
||
}
|
||
```
|
||
|
||
## 参考链接
|
||
```
|
||
https://huggingface.co/datasets/c-s-ale/alpaca-gpt4-data-zh
|
||
https://github.com/Instruction-Tuning-with-GPT-4/GPT-4-LLM
|
||
```
|
||
|
||
### Clone with HTTP
|
||
```bash
|
||
git clone https://www.modelscope.cn/datasets/AI-ModelScope/alpaca-gpt4-data-zh.git
|
||
``` |