Tag: finops

All the articles with the tag "finops".

• Scaling LiteLLM on AWS

  Updated:22 Sep, 2026

  A reference architecture and operating guide for running LiteLLM as an enterprise LLM gateway on AWS with Amazon Bedrock, plus the FinOps, governance and security work that scales with it, and a managed alternative on AgentCore Gateway.

• Replicating RouteLLM on Amazon Bedrock

  21 Sep, 2026

  Prompt-only LLM routers post strong in-distribution scores that are almost entirely recognition of which group a prompt came from. A reproduction of RouteLLM on Amazon Bedrock and AgentCore Gateway, a diagnostic suite that exposes it, and a zero-cost deferral rule that works where prompt-only routing does not.