Skip to content

[enhancement]: Anima GGUF transformers #9729

Description

@Pfannkuchensack

Is there an existing issue for this?

  • I have searched the existing issues

What should this feature add?

Load community GGUF builds of the Anima transformer. Anima loads as bf16, scaled fp8, int8 and MXFP8 single files,
but there is no GGUF config, so a .gguf Anima file does not install as Anima.

Alternatives

Use the fp8 or int8 single file.

Additional Content

The full matrix of what loads today is in #9726 (Model Format Support page).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions