LoRA on StableLM

[aPaleBlueDot]

Hi MLX community,
I'd like to apply lora.py on StableLM, yet I do not know which data format is required for the train/test/validate json files. Any pointers would be appreciated.
Cheers

[awni]

Check out the section in the docs on the data formats

[aPaleBlueDot]

Thx! So the data format is independent of the ML model, I didn't know that.

[awni]

If you use the chat template then the tokenizer will handle applying the model specific template.

[aPaleBlueDot]

Great, so that's what took place behind the scenes when I ran the lora example provided.
Thanks again for your and your team's efforts on mlx.