Category: General

General Loading...

In-House LLM Serving at Netflix

By AI Platform’s Model Runtime team and Inference teamIntroductionMost organizations consume LLMs through hosted APIs. Netflix went further — we run the full stack ourselves, from model deployment...

Read more