Homelabber uses second-gen Optane memory sticks to run a 2.8-trillion-parameter AI model on CPU alone — warns that Optane’s extreme heat can ‘burn out’ nearby memory DRAM, used blower fans to prevent melting RAM
Follow us Add us as a preferred source on Google Newsletter Subscribe to our newsletter A homelab builder on Reddit has run Moonshot AI’s 2.8-trillion-parameter Kimi K3 AI model on discontinued second-gen Optane PMem 200 memory, using a 40-core 3rd-gen Xeon Scalable CPU and not a GPU for inference. The build runs hot, and the…