GitHub - Lizhecheng02/Kaggle-LLM_Prompt_Recovery: LLMs are commonly used to rewrite or make stylistic changes to text. The goal is to recover the LLM prompt that was used to transform a given text.

This Repo is for Kaggle - LLM Prompt Recovery

Python Environment

1. Install Packages

pip install -r requirements.txt

Prepare Data

1. Set Kaggle Api

export KAGGLE_USERNAME="your_kaggle_username"
export KAGGLE_KEY="your_api_key"

2. Download Dataset

cd datasets
kaggle datasets download -d lizhecheng/lzc-llm-prompt-recovery-dataset
unzip lzc-llm-prompt-recovery-dataset.zip
kaggle datasets download -d lizhecheng/llm-prompt-recovery-extra-dataset
unzip llm-prompt-recovery-extra-dataset.zip
kaggle competitions download -c llm-prompt-recovery
unzip llm-prompt-recovery.zip

Train Model

You can use different ipynb or py files to do it. (However, there is a problem with very huge loss while fine-tuning gemma-7b)

Name		Name	Last commit message	Last commit date
Latest commit History 45 Commits
data_cleaning		data_cleaning
data_generation		data_generation
datasets		datasets
submissions		submissions
unsloth		unsloth
README.md		README.md
eda.ipynb		eda.ipynb
gemma-7b-base-inference.py		gemma-7b-base-inference.py
gemma-7b-base-train.py		gemma-7b-base-train.py
gemma-7b-it-inference.py		gemma-7b-it-inference.py
gemma-7b-it-train.py		gemma-7b-it-train.py
kaggle-inference-completion.ipynb		kaggle-inference-completion.ipynb
kaggle-training-chat-gemma.ipynb		kaggle-training-chat-gemma.ipynb
kaggle-training-chat-mistral.ipynb		kaggle-training-chat-mistral.ipynb
kaggle-training-chat-openchat.ipynb		kaggle-training-chat-openchat.ipynb
kaggle-training-completion.ipynb		kaggle-training-completion.ipynb
requirements.txt		requirements.txt

Lizhecheng02/Kaggle-LLM_Prompt_Recovery

Folders and files

Latest commit

History

Repository files navigation

This Repo is for Kaggle - LLM Prompt Recovery

Python Environment

1. Install Packages

Prepare Data

1. Set Kaggle Api

2. Download Dataset

Train Model

About

Topics

Resources

Stars

Watchers

Forks

Languages