03/Flow Routing
Score Router
Picks the best candidate member by a chosen metric.
The score router compares candidate members by a selected metric and picks the best (lowest value). Each member is represented by the best value among its healthy nodes; unhealthy nodes are excluded.
| Metric | Meaning | Picks |
|---|---|---|
| latency | Average response time | Fastest |
| load | Current active requests | Least busy |
| error_rate | Error rate | Fewest errors |
| cost | Cost per 1M tokens | Cheapest |
Entry
routerScoremetric: cost
Model A5.0 $/1M
Model B1.0 $/1M ✓
latency/load/error_rate come from Tier 0 node telemetry. cost is read from the per-member "Cost/1M" field; unknown cost loses (known-cheap wins). On equal telemetry, document order is used.