Pinned Loading

1. auto-tuning-vllm auto-tuning-vllm Public

   Auto-tuning for vllm. Getting the best performance out of your LLM deployment (vllm+guidellm+optuna)

   Python 51 15

2. performance-dashboard performance-dashboard Public

   A comprehensive performance analysis dashboard for RHAIIS (Red Hat AI Inference server) benchmarks. This dashboard provides interactive visualizations and analysis of AI model performance across di…

   Python 5 4

3. mlperf-inference-6.0-redhat mlperf-inference-6.0-redhat Public

   Forked from mlcommons/inference

   Reference implementations of MLPerf™ inference benchmarks

   Python 3 2

4. LLM-inference-benchmark-guide LLM-inference-benchmark-guide Public

   This repository serves as a comprehensive methodology guide for benchmarking LLM inference across a variety of hardware accelerators and inference engines.

   2

5. gpu-burn gpu-burn Public

   C++ 1 2

6. llm-d-bench llm-d-bench Public

   llm-d benchmarking automation work

   Python 3