An implementation of (something like) the LongNet dilated attention paper

seq2seq model enhanced with attention mechanism

Return attention-grabbing messages ready to be printed in your terminal.

Chinese NER with Step-wise Attention

Pytorch implementation of Hierarchical Attention-Based Recurrent Highway Networks for Time Series Prediction https://arxiv.org/abs/1806.00685

Experiments in meta-learning visual attention in convolutional neural networks.

The Pytorch reimplementation of ViT (Vision Transformer)

pytorch-implement

Some demo seq2seq models implemented with pytorch, including rnn, cnn, attention, and transformer.

nlp intro project

An implementation of Deepmind's Alphafold2 for 3D protein structure prediction.

Project 3 of Term 1 in the Udacity Self Driving Car Nanodegree

An unofficial Torch implementation of J. Lu, C. Xiong, et al., Knowing when to Look: Adaptive Attention via a Visual Sentinel for Image Captioning, 2017 with deformable adaptive attention

Relational Attention in PyTorch

A Baby Llama model

This is a repository for my doctoral research on attention economy and popular music.

This repository is to understand Attention mechanism for the Classification task. The task used here for explanation is Recognizing Textual Entailment. It is a Natural Language Inference task.