Hardware

Homelabber’s second-gen Optane build uses two RTX 3090s to run 2.8-trillion-parameter Kimi AI model at 3.11 tokens per second

A Reddit homelabber’s Optane PMem 200 server now runs Moonshot AI’s Kimi K3 at 3.11 tokens/s with two RTX 3090s and a RAM drive.

Quelle: Originalartikel öffnen

AI Assistant
Context loaded: Homelabber’s second-gen Optane build uses two RTX 3090s to r