Popular repositories Loading

1. MiniServeLLM MiniServeLLM Public

   Python

2. CUDAlab CUDAlab Public

   Makefile

3. cuda_tutorial cuda_tutorial Public

   Cuda

4. vllm-omni vllm-omni Public

   Forked from vllm-project/vllm-omni

   A framework for efficient model inference with omni-modality models

   Python

5. sglang-omni sglang-omni Public

   Forked from sgl-project/sglang-omni

   SGLang-Omni empowers high-performance serving for TTS, ASR, speech and omni models.

   Python

6. CosyVoice CosyVoice Public

   Forked from QwenAudio/CosyVoice

   Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.

   Python