Popular repositories Loading

1. llm-inference-optimization-lab llm-inference-optimization-lab Public

   Reproducible llama.cpp CPU inference profiling and a deterministic LLM serving simulator with continuous batching, KV cache, prefix caching, and workload-driven latency analysis.

   C++ 43 4

2. llm-engineering-platform llm-engineering-platform Public

   A production-oriented LLM engineering platform with OpenAI-compatible serving, streaming, observability, evaluation, reproducible experiments, and deterministic RAG.

   Python 17

3. omiv-kimi-k3-validation omiv-kimi-k3-validation Public

   Evidence-backed structural validation of Kimi K3 UD-IQ1_M and UD-Q4_K_XL split GGUF releases using OMIV.

   Shell 14

4. www www Public