General

AI enthusiast adds Nvidia Tesla V100 as loud as a lawnmower to gaming PC for $266 — 32GB of VRAM rig can run 27 billion parameter model at 32 tokens per second

By Loading...

A computing enthusiast has repurposed a very noisy and largely obsolete enterprise GPU (with lots of VRAM) for local LLM inference purposes.

Quelle: Originalartikel öffnen

AI Assistant
Context loaded: AI enthusiast adds Nvidia Tesla V100 as loud as a lawnmower