Compare models
The latest run of each model on one project, mode, suite and env, aligned case by case. Cases the models disagree on are listed first.
Pass rate by model
| Case | pg_kafka · 10-09 · ae666ab 100% |
|---|---|
| consume · 1024B | ✓ pass1.00 judge14,311 msgs/sec · p50 0ms · p99 0.02ms |
| end-to-end · 1024B | ✓ pass0.09 judge103 msgs/sec · p50 10.91ms · p99 101.93ms |
| produce · batched(100) · 1024B | ✓ pass1.00 judge8,484 msgs/sec · p50 11.51ms · p99 13.5ms |
| produce · batched(100) · shadow-async · 1024B | ✓ pass1.00 judge5,528 msgs/sec · p50 14.06ms · p99 94.01ms |
| produce · batched(100) · shadow-sync · 1024B | ✓ pass1.00 judge8,526 msgs/sec · p50 11.42ms · p99 13.31ms |
| produce · unbatched · 1024B | ✓ pass0.21 judge254 msgs/sec · p50 2.29ms · p99 52.34ms |
Scope: pg_kafka · benchmark · (no suite) · ci