We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
模拟qwen-vl的第一阶段训练,采用了相同的训练参数,也对vit采用了learning rate decay,训练过程中loss先慢慢下降,但后面升高了,升高之后发现模型训崩了,排除了训练数据问题,不知道是哪里的问题,放开vit训练久了之后就崩了?
No response
- OS: - Python: - Transformers: - PyTorch: - CUDA (`python -c 'import torch; print(torch.version.cuda)'`):
The text was updated successfully, but these errors were encountered:
大佬有查到原因吗?
Sorry, something went wrong.
No branches or pull requests
是否已有关于该错误的issue或讨论? | Is there an existing issue / discussion for this?
该问题是否在FAQ中有解答? | Is there an existing answer for this in FAQ?
当前行为 | Current Behavior
模拟qwen-vl的第一阶段训练,采用了相同的训练参数,也对vit采用了learning rate decay,训练过程中loss先慢慢下降,但后面升高了,升高之后发现模型训崩了,排除了训练数据问题,不知道是哪里的问题,放开vit训练久了之后就崩了?
期望行为 | Expected Behavior
No response
复现方法 | Steps To Reproduce
No response
运行环境 | Environment
备注 | Anything else?
No response
The text was updated successfully, but these errors were encountered: