Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

可以在superclue上测试自己的模型吗? #18

Open
guozhiyao opened this issue May 19, 2023 · 2 comments
Open

可以在superclue上测试自己的模型吗? #18

guozhiyao opened this issue May 19, 2023 · 2 comments

Comments

@guozhiyao
Copy link

能否在https://www.cluebenchmarks.com/index.html上测试自己的模型?
image
z这里的“立即评测”是评测什么测试集呢?

@brightmart
Copy link
Member

Hi 立即评测, 是提交自己的模型在特定的任务上的预测。
这里有示例:https://github.com/CLUEbenchmark/CLUE

@linghongli
Copy link

@brightmart hi brightmark,我们下载了ChatGLM开源模型,并进行了调优。请问如果我希望能对每一次的调优进行测试,验证模型新版本的能力表现,请问如何使用culebenchmark能实现这个目标呢?有相关使用方法介绍说明吗?谢谢。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants