Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

finetune需要的语料量+output上限 #280

Open
jyan1999 opened this issue Mar 26, 2023 · 2 comments
Open

finetune需要的语料量+output上限 #280

jyan1999 opened this issue Mar 26, 2023 · 2 comments

Comments

@jyan1999
Copy link

jyan1999 commented Mar 26, 2023 •
edited

请问一下，我想用这个生成短篇小说，目标大概是至少1000到2000字，但如果可以的话越多越好。请问这个模型能够输出这么多token么？如果想达到比较好的效果需要多少语料？非常感谢！
@greatmfc
Copy link

输出的字符长度可以自己改。如果要有比较好的生成效果的话个人实测模型参数量要300M以上，语料大小要在200MB以上

@lishangru
Copy link

lishangru commented Apr 27, 2023 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@lishangru @jyan1999 @greatmfc