๐ Postgrad at WHU
๐ Unleashing the power of LLM & supercharging MoE efficiency
๐ฏ Graduating in 2025
๐ก Seeking PhD opportunities.
-
WuHan University
- WuHan
- https://scholar.google.com/citations?user=eoUnS60AAAAJ&hl=en&authuser=1
- @gaoqiang_nlp
Block or Report
Block or report cooper12121
Report abuse
Contact GitHub support about this userโs behavior. Learn more about reporting abuse.
Report abusePinned
-
llama3-Chinese
llama3-Chinese Publicๅฏนllama3่ฟ่กไธญๆๅ จๅ้ข่ฎญ็ป๏ผๅบๅซไบๅ ถไปไฝฟ็จlora้ข่ฎญ็ป็้กน็ฎใ
Python 11
-
llama3-8x8b-MoE
llama3-8x8b-MoE PublicCopy the MLP of llama3 8 times as 8 experts , created a router with random initialization,add load balancing loss to construct an 8x8b MoE model based on llama3.
Something went wrong, please refresh the page to try again.
If the problem persists, check the GitHub status page or contact support.
If the problem persists, check the GitHub status page or contact support.