Skip to content

[enhancement]: Qwen2.5-VL GGUF text encoder (Qwen-Image) #9732

Description

@Pfannkuchensack

Is there an existing issue for this?

  • I have searched the existing issues

What should this feature add?

Load GGUF builds of the Qwen2.5-VL text encoder used by Qwen-Image. The Qwen-Image transformer already loads from
GGUF, but the encoder only loads as a folder, bf16/fp8 single file or nvfp4; there is no GGUF config for
QwenVLEncoder.

Alternatives

Use the nvfp4 or fp8 encoder.

Additional Content

  • Demand: GGUF builds of Qwen2.5-VL-7B are common (e.g. unsloth/Qwen2.5-VL-7B-Instruct-GGUF), and Qwen-Image
    encoder variants are published as GGUF (e.g. pottokao/Qwen-Image-2.1-Text-Encoder-Heretic-GGUF, ~225k).
  • The Qwen3-VL GGUF encoder loader (language tower only, mmproj refused) is the closest template.
  • Qwen-Image 2.1 itself is tracked in [enhancement]: add Qwen-Image-2.1 support #9594.

The full matrix of what loads today is in #9726 (Model Format Support page).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions