Summary
accuracy/test_llm_api_autodeploy.py::TestGemma4MoE::test_bf16 fails deterministically with:
ValueError: Not registered specs: {'dtype': 'auto', 'quant_algo': None, 'kv_cache_quant_algo': None, 'spec_dec_algo': None, ...}
The accuracy reference files (mmlu/gsm8k/mmmu yaml) contain google/gemma-4-26B-A4B-it entries, but none matching the plain bf16/auto config this test requests.
Impact
Ask
Either register the missing spec for the bf16/auto config, or waive the test until it is fixed. Also reported on #12710 (test origin).
cc @NVIDIA/trt-llm-autodeploy-devs
Summary
accuracy/test_llm_api_autodeploy.py::TestGemma4MoE::test_bf16fails deterministically with:The accuracy reference files (mmlu/gsm8k/mmmu yaml) contain
google/gemma-4-26B-A4B-itentries, but none matching the plain bf16/auto config this test requests.Impact
DGX_H100-4_GPUs-AutoDeploy-1is pre-merge, so any unrelated PR whose run selects this stage fails CI (observed on PR [https://nvbugs/6272644][fix] Stabilize and unwaive multi-GPU VisualGen LPIPS tests #15730: L0_MergeRequest_PR builds 47313 and 47345, base = current main in both cases).Ask
Either register the missing spec for the bf16/auto config, or waive the test until it is fixed. Also reported on #12710 (test origin).
cc @NVIDIA/trt-llm-autodeploy-devs