[WIP] adding chatbot-e2e

[HamidShojanazeri]

Main Goal

Building an e2e recipe for building chatbots where we need to fine-tune a model and wont be able to rely only on RAG.

This is just a work in progress and have many gaps to fill/ fix. Please dont review it as a ready work.

High level idea

We want to focus on following stages:

• Data pipelines for creating datasets for chatbots
• Data processing/ quality assurance practices/pipelines/tooling
• Evaluation process
• Fine-tuning a model/ Best practices for fine-tuning/ LORA/QLORA/ hyper params.

Use-case

We want to use this as an example to develop the e2e recipe and share it with broader community to customize for their own use-cases. As an example we use LLAMA (or could be PyTorch) FAQ model.

• Llama FAQ model using OSS llama docs, github docs, papers, website, etc.
• Proposed data pipeline, using Llama 70b as the teacher model to create Q&A pairs from Llama docs as mentioned above.[ Open to any other ideas here]
• Data Quality/ Eval using same teacher model [ Open to any other ideas here]