Skip to content

[TRTQA-3278][test] Waive 6 failed cases for main in QA CI#16606

Merged
xinhe-nv merged 4 commits into
NVIDIA:mainfrom
trtllm-agent:trtllm-ci-report/waive-20260720-071005
Jul 20, 2026
Merged

[TRTQA-3278][test] Waive 6 failed cases for main in QA CI#16606
xinhe-nv merged 4 commits into
NVIDIA:mainfrom
trtllm-agent:trtllm-ci-report/waive-20260720-071005

Conversation

@trtllm-agent

@trtllm-agent trtllm-agent commented Jul 20, 2026

Copy link
Copy Markdown
Collaborator

Auto-generated Waive PR

Created by: TensorRT LLM CI Report (requested by qa@nvidia.com)
Target branch: main
Bug(s): 6474888, 6475346, 6475622, 6479708

Waive entries added

full:GB300/accuracy/test_llm_api_pytorch.py::TestGemma3_1BInstruct::test_fp8_prequantized[torch_compile=True] SKIP (https://nvbugs/6475346)
full:GB300/accuracy/test_llm_api_pytorch_multimodal.py::TestGemma3_27BInstruct::test_fp8_prequantized SKIP (https://nvbugs/6479708)
full:GB300/accuracy/test_llm_api_pytorch.py::TestDeepSeekV3Lite::test_cute_dsl_nvfp4_4gpus[tp4-fp8kv=False-attention_dp=False-cuda_graph=False-overlap_scheduler=False-torch_compile=True] SKIP (https://nvbugs/6474888)
full:GB300/accuracy/test_epd_disagg_multimodal.py::TestVideoMMEEPD::test_disaggregated_videomme[nemotron_nano_v3_omni_fp8] SKIP (https://nvbugs/6475622)
full:GB300/accuracy/test_epd_disagg_multimodal.py::TestVideoMMEEPD::test_disaggregated_videomme[nemotron_nano_v3_omni_nvfp4] SKIP (https://nvbugs/6475622)
full:GB300/accuracy/test_epd_disagg_multimodal.py::TestVideoMMEEPD::test_disaggregated_videomme[qwen3vl_2b_instruct] SKIP (https://nvbugs/6475622)

This PR was auto-generated by TensorRT LLM CI Report. Please review the waive entries before merging.

Summary by CodeRabbit

  • Tests
    • Expanded GB300 test waiver coverage for additional multimodal video, DeepSeekV3Lite, and Gemma3 test scenarios.
    • Preserved existing waivers while adding new skipped cases for specific model and hardware configurations.

Bug(s): 6474888, 6475346, 6475622, 6479708
Requested by: qa@nvidia.com

Signed-off-by: trtllm-agent <296075020+trtllm-agent@users.noreply.github.com>
@xinhe-nv xinhe-nv changed the title [None][test] Waive 6 failed cases for main in QA CI [TRTQA-3278][test] Waive 6 failed cases for main in QA CI Jul 20, 2026
@xinhe-nv
xinhe-nv enabled auto-merge (squash) July 20, 2026 07:12
@coderabbitai

coderabbitai Bot commented Jul 20, 2026

Copy link
Copy Markdown
Contributor

Review Change Stack

📝 Walkthrough

Walkthrough

Expands the full:GB300 integration-test waiver block with additional SKIP entries for multimodal EPD video, DeepSeekV3Lite, and Gemma3 configurations.

Changes

GB300 integration waivers

Layer / File(s) Summary
Expand GB300 accuracy waivers
tests/integration/test_lists/waives.txt
Adds SKIP entries for multimodal EPD video, DeepSeekV3Lite, and Gemma3 test cases while preserving existing GB300 waivers.

Estimated code review effort: 1 (Trivial) | ~2 minutes

Possibly related PRs

Suggested reviewers: xinhe-nv

🚥 Pre-merge checks | ✅ 4 | ❌ 1

❌ Failed checks (1 warning)

Check name Status Explanation Resolution
Description check ⚠️ Warning The description is on-topic but misses the template's required Description, Test Coverage, and PR Checklist sections. Add the missing template sections with a brief problem/solution summary, relevant tests, and the checklist confirmation.
✅ Passed checks (4 passed)
Check name Status Explanation
Title check ✅ Passed The title is concise and accurately summarizes the waiver of six failed QA CI cases.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Comment @coderabbitai help to get the list of available commands.

@xinhe-nv

Copy link
Copy Markdown
Collaborator

/bot skip --comment "waive test only on GB300"

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@tests/integration/test_lists/waives.txt`:
- Around line 236-238: Update the NVIDIA copyright header in the waives.txt file
according to the repository’s standard header format, adding one if absent or
updating its year if present. Preserve all existing waiver entries unchanged.
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: 7cc38ad6-6e3c-4ddb-b0d9-a84d57c7bb0d

📥 Commits

Reviewing files that changed from the base of the PR and between 454fed3 and e8fbe17.

📒 Files selected for processing (1)
  • tests/integration/test_lists/waives.txt

Comment thread tests/integration/test_lists/waives.txt
@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #60307 [ skip ] triggered by Bot. Commit: e8fbe17 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #60307 [ skip ] completed with state SUCCESS. Commit: e8fbe17
Skipping testing for commit e8fbe17

Link to invocation

@xinhe-nv

Copy link
Copy Markdown
Collaborator

/bot skip --comment "waive test only on GB300"

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #60318 [ skip ] triggered by Bot. Commit: f741581 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #60318 [ skip ] completed with state SUCCESS. Commit: f741581
Skipping testing for commit f741581

Link to invocation

@xinhe-nv
xinhe-nv merged commit a857096 into NVIDIA:main Jul 20, 2026
7 checks passed
@xinhe-nv
xinhe-nv deleted the trtllm-ci-report/waive-20260720-071005 branch July 20, 2026 08:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants