You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Right now almost all Eagle3 Speculative Decoding models are for vLLM and not MLX-LM, which is very annoying for specialized hardware. Could there be a way of converting them without losing anything crucial? waybarrios/vllm-mlx#45 (comment)