End to End Generative AI Industry Projects on LLM Models with Deployment_Awesome LLM Projects

All-in-one UI for merged LLMs in Hugging Face

Tools for merging pretrained Large Language Models and create Mixture of Experts (MoE) from open-source models.

Intelligent layer pruning toolkit for LLMs featuring iterative optimization, self-healing algorithms, and comprehensive benchmarking.

Mergekit supports various architectures like Llama, Mistral, and more models, enabling merges on CPU or GPU with low memory needs through lazy tensor loading and out-of-core processing. It handles elaborate operations such as interpolated gradients, frankenmerging (layer-wise), LoRA extraction, and mixture of experts merging.​ [ by Arcee AI ]

Mergekit Assistant is a cutting-edge toolkit designed for the seamless merging of pre-trained language models. It supports an array of models, offers various merging methods, and optimizes for low-resource environments with both CPU and GPU compatibility.

A continuous generalist web navigation agent that merges individually fine-tuned LLMs as domain experts.

🛠️ Optimize LLMs with advanced pruning strategies and real-time visualization for smaller, faster models without losing intelligence.

Behavioral auditing toolkit for LLMs: rho-audit measures factual accuracy, bias, sycophancy, toxicity, and reasoning via teacher-forced confidence probes. SVD compression with knowledge preservation. Steering vectors for runtime behavioral control. 12-model merge audit across SLERP/TIES/DARE-TIES/Linear.