HF model format : vlm weights not in llama-vid-7b-full-336 #81

nileshkokane01 · 2024-04-12T07:16:44Z

I am trying to convert the the llama-vid models to HF - huggingface/transformers#29971 but I do not find the qformer weights , specifically the lines searches for keys related to vlm and fails for llama-vid-7b-full-336.

Can you please assist me with this , and let me know where can I find the weights?
Although I see the Bert -Encoder/Tokenizer is been initialized by this line , but can't find the projection weights.

nileshkokane01 changed the title ~~Hugging face model format : vlm weights not in llama-vid-7b-full-336 : pytorch_model-0000x-of-00002.bin~~ HF model format : vlm weights not in llama-vid-7b-full-336 : pytorch_model-0000x-of-00002.bin Apr 12, 2024

nileshkokane01 changed the title ~~HF model format : vlm weights not in llama-vid-7b-full-336 : pytorch_model-0000x-of-00002.bin~~ HF model format : vlm weights not in llama-vid-7b-full-336 Apr 12, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

HF model format : vlm weights not in llama-vid-7b-full-336 #81

HF model format : vlm weights not in llama-vid-7b-full-336 #81

nileshkokane01 commented Apr 12, 2024 •

edited

HF model format : vlm weights not in llama-vid-7b-full-336 #81

HF model format : vlm weights not in llama-vid-7b-full-336 #81

Comments

nileshkokane01 commented Apr 12, 2024 • edited

nileshkokane01 commented Apr 12, 2024 •

edited