Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

论文中的图4的可视化 #17

Open
long-wa opened this issue May 31, 2023 · 2 comments
Open

论文中的图4的可视化 #17

long-wa opened this issue May 31, 2023 · 2 comments
Labels
visualization

Comments

@long-wa
Copy link

long-wa commented May 31, 2023

作者您好，请问一下图4中的可视化所采用的top-k 的值是不是16啊，这个可视化来自阶段 3 吗，还是可视化的时候您们在阶段1就选用了top-k的值为16。
@rayleizhu
Copy link
Owner

阶段3，在论文Section 4.5有提到。更具体一点，是阶段3的最后一个block中的attention。可视化代码在整理，很快就会发布了。

@long-wa
Copy link
Author

long-wa commented May 31, 2023

真的太谢谢您了，

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
visualization
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@rayleizhu @long-wa