Skip to content

Add vMLX engine integration (jangl quants) #34

Description

@igurss

Community request to support vMLX, which uses jangl quantization format. Lower priority than vllm-mlx — needs investigation on API compatibility and whether jangl quants are widely used enough to justify leaderboard results alongside MLX-native quantizations.

Metadata

Metadata

Assignees

Labels

engineEngine integration (oMLX, Rapid-MLX, mlx-lm)enhancementNew feature or request

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions