New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

BGE-M3预训练问题 #783

Open

LLLiHaotian opened this issue May 14, 2024 · 1 comment

LLLiHaotian commented May 14, 2024

如果要基于自己的中英文文本数据，对BGE-M3模型进行RetroMAE的二次训练，是直接对xlm-roberta进行二次训练吗

Collaborator

staoxiao commented May 15, 2024

We release the retromae version of bge-m3: https://huggingface.co/BAAI/bge-m3-retromae, and you can use it to do pretrain.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment