Skip to content

Log per-submodel MRSTFT metrics during packed validation#669

Merged
sdatkinson merged 1 commit into
sdatkinson:mainfrom
tone-3000:fix/packed-mrstft-per-submodel-logging
May 23, 2026
Merged

Log per-submodel MRSTFT metrics during packed validation#669
sdatkinson merged 1 commit into
sdatkinson:mainfrom
tone-3000:fix/packed-mrstft-per-submodel-logging

Conversation

@woodybury

Copy link
Copy Markdown
Contributor

Summary

  • Packed validation now logs per-submodel metrics for all loss keys (e.g. MRSTFT_packed_0, MRSTFT_packed_1), not only ESR/MSE
  • Aggregate MRSTFT (sum across submodels) is unchanged
  • No extra loss computation; only additional validation log keys

Test plan

  • pytest tests/test_nam/test_train/test_lightning_module.py::test_packed_lightning_validation_logs_per_submodel_and_aggregate
  • pytest tests/test_nam/test_train/test_lightning_module.py::test_packed_lightning_validation_logs_mrstft_per_submodel

Packed training already computed MRSTFT per submodel but only logged
the summed aggregate. Log each loss key as {key}_packed_{i} so MRSTFT
matches ESR/MSE visibility in TensorBoard.

@sdatkinson sdatkinson left a comment

Copy link
Copy Markdown
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! 👍🏻

@sdatkinson sdatkinson merged commit ea4a38c into sdatkinson:main May 23, 2026
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants