Skip to content

meta's LLMA-2 based chat framework, optimized for news contents.

License

Notifications You must be signed in to change notification settings

Ransaka/daily-llama

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

18 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

daily-llama 🦙

Retrieval augmented generation framework based on news contents.

This project presents a retrieval-augmented generation framework tailored for news content. By employing the FAISS index for efficient similarity search, relevant documents are retrieved. Leveraging the LLAMA-2 model, these retrieved documents serve as a foundation for generating comprehensive and contextually accurate answers.

daily-llama

Demo

chat-demo.mp4

Usage info

python3 daily-llama.py --dataset_path data/news-small.json --load_in_4bit True --query "What happened with Dimuth's cricket career?"

Sample Response

Based on past newspaper contents, it appears that Dimuth Karunaratne's cricket career has been impacted by recent legal issues. According to a news article from March 2023, he was charged with driving under the influence of liquor and was released on bail after being produced before the Colombo Fort Magistrate Court. Additionally, he has requested the national cricket selection committee to reconsider his request to step down as Sri Lanka's Test captain due to personal reasons. However, it is unclear at this time how these legal issues will affect his playing career moving forward.

Gradio App Example

git clone https://github.com/Ransaka/daily-llama.git
cd /content/daily-llama
pip install -r requirements.txt --q
python server.py --dataset_path data/news-small.json --load_in_4bit True # you may require `huggingface-cli login` prior to this step

Alt text

About

meta's LLMA-2 based chat framework, optimized for news contents.

Topics

Resources

License

Stars

Watchers

Forks