Transformers (Attention is all you need)

Articles

• Transformers-An Intuition
• Text Generation v/s Text2Text Generation
• LLMs Parameters
• BERT: Overview
• GPT: Overview
• T5: Overview

Repository Contents

Types

1. Encoder Only Models
2. Decoder Only Models
3. Encoder-Decoder Models

Codes

1. Tokenizer
2. Word Embedding
3. Semantic Search
4. Tokenization Positional_Encoding Self Attention
5. Extractive QnA with BERT
6. Instruction following using GPT
7. Product Review using T5
8. Decoder Only Model
9. Fill-Mask Encoder Only Model
10. Sentiment Analysis Encoder Only Model
11. Encoder-Decoder Model

Theory Stuffs

1. Hand-written Notes
2. Hyperparameters
3. Basics
4. Attention is all you need from scratch *WIP