Discussions

• 1 You must be logged in to vote

  💬

  would intel cpu like xeon be supported?

  leiwen83 started May 12, 2024 in General

  

  

  1
• 1 You must be logged in to vote

  💬

  Is batch Inference supported?

  imneov started Apr 16, 2024 in General

  

  

  

  

  3
• 1 You must be logged in to vote

  💬

  no difference speed between fp8 and original fp16

  leiwen83 started May 13, 2024 in General · Closed

  

  

  1
• 1 You must be logged in to vote

  💬

  How gptq or awq converted into gf4?

  leiwen83 started May 13, 2024 in General

  

  

  0
• 1 You must be logged in to vote

  💬

  Would tp be supported?

  leiwen83 started May 13, 2024 in General

  

  

  0