You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi, for the LLaMA 7B and 13B, we follow the instruction format in LLaVA. In the pretraining stage, the main focus is image caption. So, it works well with plain style.
https://github.com/dvlab-research/MGM/blob/main/scripts/llama/train/stage_1_2_full_v7b_336_hr_768.sh
在这个脚本中pretrain用的--version plain
而finetune用的是--version v1
前后不一致模型不会混乱吗
The text was updated successfully, but these errors were encountered: