Skip to content

Commit

Permalink
Vulkan Bugfixes and Improvements (#7084)
Browse files Browse the repository at this point in the history 
* Modify mat mat mul shader for mul_mat_id, modify mat vec mul shaders for single call batch operation

* Further work towards MoE, disabled for now

* Disable MoE code (not ready yet), fix a number of bugs in shaders and Vulkan code

* Add softmax with f16 mask and pos buffer support

* Disable mul_mat_id shaders for now

* Fix flake8

* Fix validation errors caused by empty buffers on larger batch sizes
  • Loading branch information
@0cc4m
0cc4m committed May 9, 2024
1 parent d46dbc7 commit befddd0
Show file tree
Hide file tree
Showing 3 changed files with 48,334 additions and 39,647 deletions.

0 comments on commit befddd0

Please sign in to comment.