TypeError: can only concatenate str (not "int") to str

[RunForRes]

When I run the command "torchrun --nproc_per_node 1 example_chat_completion.py
--ckpt_dir /data/pretrained_models/llama3/Meta-Llama-3-8B-Instruct/
--tokenizer_path /data/pretrained_models/llama3/Meta-Llama-3-8B-Instruct/tokenizer.model
--max_seq_len 512 --max_batch_size 6", it throws a type error like this.

But when I run example_chat_completion.py directly without using torchrun, it works normally.

[ailuropodaWu]

I've faced the same issue, and I found out that adding --max_gen_len 512 at the end of the command could solve the problem. I hope it helps you.