Skip to content

[TRTQA-3272][test] Waive 7 failed cases for main in QA CI#16602

Merged
xinhe-nv merged 1 commit into
NVIDIA:mainfrom
trtllm-agent:trtllm-ci-report/waive-20260720-062252
Jul 20, 2026
Merged

[TRTQA-3272][test] Waive 7 failed cases for main in QA CI#16602
xinhe-nv merged 1 commit into
NVIDIA:mainfrom
trtllm-agent:trtllm-ci-report/waive-20260720-062252

Conversation

@trtllm-agent

@trtllm-agent trtllm-agent commented Jul 20, 2026

Copy link
Copy Markdown
Collaborator

Auto-generated Waive PR

Created by: TensorRT LLM CI Report (requested by qa@nvidia.com)
Target branch: main
Bug(s): 6327718, 6472256, 6474888, 6475621, 6475622, 6475623

Waive entries added

full:B200/llmapi/test_llm_api_pytorch_moe_lora.py::test_qwen_moe_routed_expert_multi_lora_varying_ranks[eager] SKIP (https://nvbugs/6475621)
full:B200/disaggregated/test_disaggregated.py::test_disaggregated_stress_test[input8k-output1k-conc512-qwen3_32b_fp8_stress] SKIP (https://nvbugs/6472256)
full:B200/disaggregated/test_disaggregated.py::test_disaggregated_stress_test[input8k-output1k-conc512-deepseek_r1_v2_fp4_stress] SKIP (https://nvbugs/6472256)
full:B200/accuracy/test_llm_api_pytorch.py::TestDeepSeekV3Lite::test_cute_dsl_nvfp4_4gpus[tp4-fp8kv=False-attention_dp=False-cuda_graph=False-overlap_scheduler=False-torch_compile=True] SKIP (https://nvbugs/6474888)
full:B200/accuracy/test_llm_api_pytorch_multimodal.py::TestNanoV3Omni::test_auto_dtype[fp8] SKIP (https://nvbugs/6475622)
full:B200/accuracy/test_epd_disagg_multimodal.py::TestVideoMMEEPD::test_disaggregated_videomme[nemotron_nano_v3_omni_fp8] SKIP (https://nvbugs/6327718)
full:B200/llmapi/test_llm_api_pytorch_moe_lora.py::test_qwen_moe_routed_expert_multi_lora_varying_ranks[cudagraph] SKIP (https://nvbugs/6475623)

This PR was auto-generated by TensorRT LLM CI Report. Please review the waive entries before merging.

Summary by CodeRabbit

  • Tests
    • Updated B200 test waivers to reflect current expected results across video, multimodal, quantization, stress, and mixture-of-experts scenarios.
    • Added coverage for several newly identified test cases, including MiniMax, NanoV3 Omni, DeepSeek, and Qwen scenarios.

Bug(s): 6327718, 6472256, 6474888, 6475621, 6475622, 6475623
Requested by: qa@nvidia.com

Signed-off-by: trtllm-agent <296075020+trtllm-agent@users.noreply.github.com>
@xinhe-nv
xinhe-nv enabled auto-merge (squash) July 20, 2026 06:23
@xinhe-nv xinhe-nv changed the title [None][test] Waive 7 failed cases for main in QA CI [TRTQA-3272][test] Waive 7 failed cases for main in QA CI Jul 20, 2026
@xinhe-nv

Copy link
Copy Markdown
Collaborator

/bot skip --comment "waive test only"

@coderabbitai

coderabbitai Bot commented Jul 20, 2026

Copy link
Copy Markdown
Contributor

Review Change Stack

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: b9f90ed9-6900-4868-8540-76513ba5e099

📥 Commits

Reviewing files that changed from the base of the PR and between 447a628 and ee2211d.

📒 Files selected for processing (1)
  • tests/integration/test_lists/waives.txt

📝 Walkthrough

Walkthrough

The full:B200 integration waiver list is revised, removing Exaone entries and adding or relocating waivers for VideoMME, DeepSeekV3Lite, MiniMaxM3, NanoV3Omni, disaggregated stress tests, and Qwen MoE LoRA configurations.

Changes

B200 integration waivers

Layer / File(s) Summary
Update full:B200 waiver coverage
tests/integration/test_lists/waives.txt
The waiver block removes Exaone cases and updates skipped configurations for several model, multimodal, disaggregated, and LoRA integration tests.

Estimated code review effort: 1 (Trivial) | ~3 minutes

Possibly related PRs

Suggested reviewers: dongxuy04, pcastonguay

🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Title check ✅ Passed The title is concise and accurately describes waiving seven QA CI failures on main.
Description check ✅ Passed It includes the change summary, target branch, linked bugs, and the waived test cases, which covers the core intent.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Comment @coderabbitai help to get the list of available commands.

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #60294 [ skip ] triggered by Bot. Commit: ee2211d Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #60294 [ skip ] completed with state SUCCESS. Commit: ee2211d
Skipping testing for commit ee2211d

Link to invocation

@xinhe-nv
xinhe-nv merged commit 5ebcda8 into NVIDIA:main Jul 20, 2026
16 checks passed
@xinhe-nv
xinhe-nv deleted the trtllm-ci-report/waive-20260720-062252 branch July 20, 2026 07:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants