Skip to content

Commit 9feb5a0

Browse files
Bihan  RanaBihan  Rana
authored andcommitted
Replace sglang_router with smg in PD examples
1 parent f1102fd commit 9feb5a0

2 files changed

Lines changed: 5 additions & 4 deletions

File tree

docs/docs/concepts/services.md

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -365,9 +365,10 @@ Below is an example for running `zai-org/GLM-4.5-Air-FP8`:
365365
- count: 1
366366
# For now replica group with router must have count: 1
367367
commands:
368-
- pip install sglang_router
368+
- pip install smg
369369
- |
370-
python -m sglang_router.launch_router \
370+
smg launch \
371+
--host 0.0.0.0 \
371372
--port 8000 \
372373
--pd-disaggregation \
373374
--prefill-policy cache_aware

examples/inference/sglang/README.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -157,9 +157,9 @@ To run SGLang with [PD disaggregation](https://docs.sglang.io/advanced_features/
157157
- count: 1
158158
# For now replica group with router must have count: 1
159159
commands:
160-
- pip install sglang_router
160+
- pip install smg
161161
- |
162-
python -m sglang_router.launch_router \
162+
smg launch \
163163
--host 0.0.0.0 \
164164
--port 8000 \
165165
--pd-disaggregation \

0 commit comments

Comments
 (0)