Skip to content

docs: require benchmark registry index regeneration - #1807

Open
git-jxj wants to merge 1 commit into
modelscope:mainfrom
git-jxj:docs/fix-benchmark-registry-onboarding
Open

git-jxj wants to merge 1 commit into
modelscope:mainfrom
git-jxj:docs/fix-benchmark-registry-onboarding

Conversation

@git-jxj

@git-jxj git-jxj commented Oct 5, 2026

Copy link
Copy Markdown
Contributor

The benchmark contribution guide says adapters are imported at startup and makes the only index-refreshing workflow optional. Since the lazy registry change, following the two-file example leaves _index.json stale and fails the existing registry contract tests.

Describe on-demand loading and add a required index-generation step, including the local contract check and the instruction to commit the generated index.

Validation: created the guide's sample adapter and reproduced two failing index checks; make docs-update-index resolved both and all 27 registry contract tests passed. make lint and the CI Lite smoke test passed. The sample adapter and its generated index entry were removed after validation.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant