We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
80c8b46
Sequence parallel attention adopting a hybrid ulysses and ring attention approach. Support GQA Support QKV packed.
