PAD token missing ?

[omkar-12bits]

i tried using eos_token , unk_token and bos_token with left and right padding side but whenever the padding tokens size increases the outputs are pure garbage.

[omkar-12bits]

after trying this on both mistral and mixtral its sure that paddings doesn't work very well with these models.
i was just playing with prompts at inference time and saw that paddings makes generation worst.
if inference on batches doesn't work well then how does it performs while training ? shouldn't it also produce garbage ?

[geronimi73]

can you post the code you use please?