amd epyc with this motherboard to future proof 1TB llama models.

[ouvaa]

thinking of buying this for llama inference etc. what do u guys think? at least i can support 1TB llama models comfortably.
now we have 281GB Mistral which i havent test yet (coz i dont hv the hardware)
https://www.gigabyte.com/Enterprise/Server-Motherboard/MZ33-AR0-rev-1x

opinion? how many tok/s do u guys reckon i can get out of this? i read about 12 channel bandwidth meaning can support up to around 400GB/s bandwidth? possible to go higher? pure cpu inference only. i'm talking about the 281GB now coz i was thinking of getting Mac Studio with 192GB but even this cant support 281GB.

opinions / suggestions appreciated.