You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
[enhancement]: Ministral 3B GGUF text encoder (ERNIE-Image) #9731
Load GGUF builds of ERNIE-Image's Ministral 3B text encoder. Today configs/mistral_encoder.py refuses them
("Ministral 3B GGUF encoders are not supported"): the Mistral GGUF loader builds a MistralModel with RoPE read
from GGUF metadata, while Ministral 3B needs Ministral3Model (YaRN scaling and a position-dependent attention
scale). Packed nvfp4 Ministral builds are refused as well.
Alternatives
Use the 7.7 GB safetensors encoder (the ERNIE-Image starters install it).
Is there an existing issue for this?
What should this feature add?
Load GGUF builds of ERNIE-Image's Ministral 3B text encoder. Today
configs/mistral_encoder.pyrefuses them("Ministral 3B GGUF encoders are not supported"): the Mistral GGUF loader builds a
MistralModelwith RoPE readfrom GGUF metadata, while Ministral 3B needs
Ministral3Model(YaRN scaling and a position-dependent attentionscale). Packed nvfp4 Ministral builds are refused as well.
Alternatives
Use the 7.7 GB safetensors encoder (the ERNIE-Image starters install it).
Additional Content
moritalous/Ministral-3-3B-Base-ERNIE-Image-TE-sdcpp-GGUF,ponpoke/ERNIE-Image-Abliterated-GGUF(text encoder files).
The full matrix of what loads today is in #9726 (Model Format Support page).