PyTorch Layer Normalization

Implementation of the paper: Layer Normalization

Install

pip install torch-layer-normalization

Usage

from torch_layer_normalization import LayerNormalization

LayerNormalization(normal_shape=normal_shape)
# The `normal_shape` could be the last dimension of the input tensor or the shape of the input tensor.