Building an AI Gateway in .NET
How to centralise model access, resilience, routing, telemetry and cost tracking without dragging business logic into a shared AI service.

Search for a command to run...
Articles tagged with #software-architecture
How to centralise model access, resilience, routing, telemetry and cost tracking without dragging business logic into a shared AI service.

AI features in .NET apps are starting to move past the simple chat box. At first, Devs usually adds one model call. The app sends a prompt, gets a response, and shows it to the user. That is easy enou

In the last post, we built a small chaos proxy in C#. That proxy sat between our application and a downstream API. It made the network awkward on purpose. Sometimes it added latency. Sometimes it retu

Most API clients are tested against the best possible version of the downstream system. The downstream responds quickly. The JSON is valid. The status code makes sense. The connection stays open. The

A bytecode VM sounds like something that belongs inside a language runtime, a game engine, or a browser. But the basic idea is much smaller than it looks. You define a small set of instructions. You s

You often find that a performance problem in .NET is not caused by one dramatic mistake. It usually come from a small, ordinary decision repeated millions of times. One of those decisions is how your
