Skip to content

Wire Huber flux-scale into epoch QA; run Jan-Apr campaign from main worktree - #175

Open
jakobtfaber wants to merge 4 commits into
mainfrom
agent/qa-fail-fixes-online
Open

Wire Huber flux-scale into epoch QA; run Jan-Apr campaign from main worktree#175
jakobtfaber wants to merge 4 commits into
mainfrom
agent/qa-fail-fixes-online

Conversation

@jakobtfaber

Copy link
Copy Markdown
Contributor

Summary

  • Lands the offline Huber mosaic flux-scale salvage (flux_scale_correction mosaic apply + scripts/apply_flux_scale_correction.py) into batch_pipeline before three-gate epoch QA (default on; --skip-flux-scale-correction to disable).
  • Points Jan–Apr campaign systemd units at a main-based worktree so calibrator-aware epoch gaincal, VLASS-full catalog fallback, and direct-first gating from main are what the live campaign runs.
  • Keeps shared H17 state via DSA110_CAMPAIGN_DIR / catalog / DB env overrides; ticket watcher included.

Why

2026-01-25 hours 0–3 QA-FAIL’d on cold flux ratios (~0.69–0.73) after LOW_SNR → static daily .g. Investigations produced mainline gaincal/catalog fixes and an untracked Huber apply path; the campaign was still on an older branch without either wired in.

Test plan

  • pytest tests/test_flux_scale_correction.py (50 passed)
  • Restart dsa110-jan-apr-mosaic-immediate.service from worktree; confirm log shows Flux scale: applied then improved epoch QA for rebuilt hours
  • Confirm hour 22 / Restore strict flux-scale QA on 2026-01-25 hour 22 #157 may still FAIL (Huber gradient ≈ 1 there — separate open issue)

Made with Cursor

Bring Jan–Apr campaign ops onto a main-based worktree with calibrator-aware
epoch gaincal / VLASS-full catalog fallback already on main, and apply the
offline Huber mosaic salvage in-pipeline before three-gate QA so cold
LOW_SNR-fallback mosaics can pass the flux-ratio gate.
The Jan–Apr campaign passes a bounded working-set filter; main's converter
was missing the kwarg, which aborted resume immediately after cutover.
Rolling campaign dry-run requires --mosaic-hour / --tile-workers; these lived
only on the dirty H17 branch. Keep Huber flux-scale wiring and continuum
stage defaults.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant