Skip to content

Reduce CLI startup cost and add local test iteration tools - #867

Closed
cpojer wants to merge 27 commits into
mainfrom
cpojer/tests
Closed

cpojer wants to merge 27 commits into
mainfrom
cpojer/tests

Conversation

@cpojer

@cpojer cpojer commented Nov 17, 2026 •

Copy link
Copy Markdown
Member

Token-only Cloudflare operations load OAuth storage and terminal UI code that they do not use. Load those dependencies only for OAuth and interactive login; measured median startup of the shipped operation process dropped from 74.7 ms to 38.9 ms.

This PR also adds two uncached repository commands:

  • vp run test:iterate <file> uses native Vitest dependency records for local iteration. Its explicit boolean flag preserves forwarded filename filters, covered by a parser regression. Filesystem/subprocess limitations are documented; affected and full verification remain required.
  • vp run test:benchmark writes opt-in timing, machine, and test-contract reports without changing test selection or execution.

The build-cache migration, generated fixture registry, test splits, scheduling experiments, and CI changes have been removed. The final diff is seven files; existing test cases and isolation remain intact. SDK PGlite tests also use separate processes on Windows after CI reproduced the same native Node/V8 JIT teardown crash already isolated on Linux and macOS.

Validation: token-only and interactive-login process regressions; iteration parser regression; workspace vp check; all 35 compiler checks. Affected verification conservatively selected the complete suite: 17,554 passed, 35 skipped; the final direct full run took 164.31 seconds, versus the original 164.3-second baseline. This is not a claim of faster full-suite execution.

All exact-head checks pass, including Linux and Windows SDK checks, platform/schema/PostgreSQL tests, and npm/pnpm packed-consumer checks. The browser-concurrency investigation remains outside this PR.

@cloudflare-workers-and-pages

cloudflare-workers-and-pages Bot commented Nov 17, 2026 •

Copy link
Copy Markdown

🚀 Deploying Preview to Cloudflare 🚀

Preview URL: https://cpojer-tests-void-cloud.voidzero-docs.workers.dev (commit cc0f1a6)

This URL reflects your latest Preview deployment

Preview Deployments by commit

Status Deployment URL Commit Updated (UTC) See this deployment's details
  • Build: Success ✅
  • Deployment: Success ✅

View logs ↗
https://4975c840-void-cloud.voidzero-docs.workers.dev 16a41e7 2026-11-17T15:08:30.683Z Visit the dashboard ↗
  • Build: Success ✅
  • Deployment: Success ✅

View logs ↗
https://2b554c84-void-cloud.voidzero-docs.workers.dev cc0f1a6 2026-11-17T15:37:14.507Z Visit the dashboard ↗
  • Build: Success ✅
  • Deployment: Success ✅

View logs ↗
https://a49e6148-void-cloud.voidzero-docs.workers.dev 08d6004 2026-11-17T14:48:52.847Z Visit the dashboard ↗
  • Build: Success ✅
  • Deployment: Success ✅

View logs ↗
https://84068dad-void-cloud.voidzero-docs.workers.dev 23d8469 2026-11-17T15:23:36.834Z Visit the dashboard ↗
  • Build: Success ✅
  • Deployment: Success ✅

View logs ↗
https://5fe741b5-void-cloud.voidzero-docs.workers.dev 58b3421 2026-11-17T14:56:54.892Z Visit the dashboard ↗
  • Build: Success ✅
  • Deployment: Success ✅

View logs ↗
https://85e5df9f-void-cloud.voidzero-docs.workers.dev aab5187 2026-11-17T14:43:00.531Z Visit the dashboard ↗
  • Build: Success ✅
  • Deployment: Success ✅

View logs ↗
https://d16815e5-void-cloud.voidzero-docs.workers.dev 9b6ff70 2026-11-17T14:29:13.211Z Visit the dashboard ↗
  • Build: Success ✅
  • Deployment: Success ✅

View logs ↗
https://aa35c26c-void-cloud.voidzero-docs.workers.dev acfc740 2026-11-17T13:15:44.670Z Visit the dashboard ↗
  • Build: Success ✅
  • Deployment: Success ✅

View logs ↗
https://55985437-void-cloud.voidzero-docs.workers.dev 72a10d1 2026-11-17T12:10:48.581Z Visit the dashboard ↗
  • Build: Success ✅
  • Deployment: Success ✅

View logs ↗
https://3659c461-void-cloud.voidzero-docs.workers.dev 5c63fe4 2026-11-17T11:14:40.465Z Visit the dashboard ↗

@cpojer cpojer changed the title Speed up test preparation and execution Reduce CLI startup cost and add local test iteration tools Nov 17, 2026
@cpojer
cpojer marked this pull request as ready for review November 17, 2026 15:49
@cpojer

cpojer commented Nov 17, 2026

Copy link
Copy Markdown
Member Author

Unbelievable. It couldn't even speed up tests by 10%.

CleanShot 2026-11-18 at 01 26 48@2x

@cpojer cpojer closed this Nov 17, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant