Skip to content

Pull requests: OpenRouterTeam/benchmark-harness

Pull request creation is restricted
7 Open 17 Closed
7 Open 17 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

feat(providers): enable OpenRouter response caching with per-epoch salts
#24 opened Aug 13, 2026 by abhinav-pola Contributor Loading…
3 of 5 tasks
@abhinav-pola
2
feat(terminal-bench): selectable agent harness plus full control and tracking
#20 opened Aug 12, 2026 by abhinav-pola Contributor Loading…
5
feat: add agent_dx benchmark for OpenRouter agent-experience evals
#15 opened Aug 7, 2026 by devin-ai-integration Bot Loading…
5 tasks done
7
feat(benchmarks): chess — full games vs Stockfish, first-party original
#4 opened Aug 5, 2026 by LukasParke Loading…
2
feat(benchmarks): EvalManifestV1 — unified eval description schema + first-party manifests
#3 opened Aug 5, 2026 by LukasParke Loading…
2
feat(benchmarks): custom_eval — declarative user evals as run-config data
#2 opened Aug 5, 2026 by LukasParke Loading…
2
feat(harness): durable per-(sample, epoch) result store + fiber-scoped request context
#1 opened Aug 5, 2026 by LukasParke Loading…
3
ProTip! Exclude everything labeled bug with -label:bug.