File tree Expand file tree Collapse file tree
examples/inference/sglang Expand file tree Collapse file tree Original file line number Diff line number Diff line change @@ -365,9 +365,10 @@ Below is an example for running `zai-org/GLM-4.5-Air-FP8`:
365365 - count: 1
366366 # For now replica group with router must have count: 1
367367 commands:
368- - pip install sglang_router
368+ - pip install smg
369369 - |
370- python -m sglang_router.launch_router \
370+ smg launch \
371+ --host 0.0.0.0 \
371372 --port 8000 \
372373 --pd-disaggregation \
373374 --prefill-policy cache_aware
Original file line number Diff line number Diff line change @@ -157,9 +157,9 @@ To run SGLang with [PD disaggregation](https://docs.sglang.io/advanced_features/
157157 - count: 1
158158 # For now replica group with router must have count: 1
159159 commands:
160- - pip install sglang_router
160+ - pip install smg
161161 - |
162- python -m sglang_router.launch_router \
162+ smg launch \
163163 --host 0.0.0.0 \
164164 --port 8000 \
165165 --pd-disaggregation \
You can’t perform that action at this time.
0 commit comments