[codex] Support GLM-5.2 744B Modal H100 run - #90
Draft
pawalt wants to merge 1 commit into
Draft
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds a Modal/SLIME configuration and runtime support needed to run GLM-5.2-744B-A40B GRPO on a 32-node H100 allocation.
The working path uses colocated SGLang rollout engines instead of PD disaggregation because the available Modal/AWS transfer paths were not viable for this setup: Mooncake TCP failed CUDA buffer copies, NIXL/libfabric needed unavailable EFA memory-registration privileges, and NIXL/UCX only exposed loopback to the plugin.
Changes
glm52_744b_a40bexperiment config for 32 H100 nodes, FP8 GLM-5.2, DAPO-Math, colocated rollout, EFA disabled, and the validated memory settings.Validation
PYTHONPATH=slime uv run python -c "from configs.glm52_744b_a40b import slime, modal; ..."rollout_max_response_len 1024max_tokens_per_gpu 4096data_pad_size_multiplier 64efa_enabled Falseuv run python -m py_compileon all changed Python files.ap-FhbQwfQSx1MpdtFmgeE7dLq5nwqqfdupdate_weightscompleted in7429.1s64/64, response length1024, rollout time75.38s3/3microbatches without the previous RoPE, MoE, or fused CE OOM failures0metrics logged successfully