feat: add CVRP benchmark (VehicleRouting/CVRP) - #102

Open

zzy2007zzy2007 wants to merge 19 commits into

EinsiaLab:mainfrom

zzy2007zzy2007:feat/VehicleRouting/CVRP

Commits on Aug 7, 2026

feat: add CVRP benchmark (VehicleRouting/CVRP)
zzy
committed
4f78bf8
docs: add VehicleRouting domain README
zzy
committed
78f0790

Commits on Aug 12, 2026

fix: address PR review — held-out instances, sandbox scoping, validators, run records, docker isolation, tests
zzy
committed
9a9ae6a
feat: generate fresh instances at evaluation time (anti-hardcoding)
zzy
committed
674a1cf
docs: fix unit test count in README (22 evaluator tests after runtime-generation additions)
zzy
committed
6fc3aaa
docs: document docker-mode runtime instance generation via task.runtime.env
zzy
committed
0cd8048
docs: note docker-mode generation requires the unified runtime env-forwarding fix
zzy
committed
752561d
docs: revert docker-mode runtime generation note to framework-level limitation wording
zzy
committed
1fd7622
fix: make docker isolation mode score correctly without framework changes
zzy
committed
efe2df9
docs: correct held-out/threat-model claims (instances are visible, not hidden)
zzy
committed
da14b0e
docs: add agent multi-run statistics (reviewer item 5 completion)
zzy
committed
e36b960
docs: fix README/Task inconsistencies (held-out visibility, best scores)
zzy
committed
0e45c3d
fix: keep held-out instances out of the evaluation sandbox
zzy
committed
6a4bc26
fix: use {benchmark_source} placeholder; test the sandbox evaluator copy
zzy
committed
8398c29
fix: close FRONTIER_ENGINEERING_ROOT env side channel (scoring-integrity)
zzy
committed
a940bb3

Commits on Aug 13, 2026

docs: fix unit-test counts in README (23 evaluator / 16 validator / 5 ref / 6 sandbox)
zzy
committed
256a80a
docs: fix held-out visibility claim and zh test counts
zzy
committed
b54710a
fix: move unittest main block to end of test_validator + typo
zzy
committed
6727624
docs: add CVRP entry to the repo task-details table (EN/ZH)
zzy
committed
ece8a74