Randomized trials on your traffic. You approve; winners go live.
Ship agents. Metrx works to keep each one on the cheapest configuration that still holds quality — proven on your traffic, and switched only under the authority you set.
You picked a model at launch and never looked again.
Metrx re-checks the pick as prices and models change, and tells you when a cheaper one holds.
Changing prod config is a leap of faith with no rollback.
Every change is designed to run against a holdout with breakers armed. A bad one reverts on its own.
Benchmarks tell you what a model can do, not what it does for you.
The only trial that counts runs on your traffic, your prompts, your users.
Two loops, always running.
Find, prove, and apply better configurations.
Generate candidate configurations — model, prompt, parameters, routing — and prove model and route switches with pre-registered randomized trials on your traffic. Promotion only follows causal evidence.
Guard every configuration that's already live.
Watch every live configuration for drift, re-check incumbents when a provider ships a model release, and roll back when a breaker trips. The last proven config is restored automatically.
Every promotion carries a re-runnable evidence record — inputs, splits, readouts. See one end to end in a read-only demo workspace.
Explore a live workspace →Put every workload on its best proven configuration.
Connect a workload, approve an acceptance contract, and let the loops run.
Figures shown in the demo workspace are synthetic. Every number carries its provenance.