Skip to content

@METR METR

Change the repository type filter

All

    Repositories list

    50 repositories

    • inspect-action

      Public
      Running UK AISI's Inspect in the Cloud
      aiinspectelicitationai-evaluationevals
      Python
      •
      MIT License
      •5•9•36•13•Updated Jan 6, 2026Jan 6, 2026

    • inspect_ai

      Public
      Inspect: A framework for large language model evaluations
      Python
      •
      MIT License
      •365•4•1•0•Updated Jan 6, 2026Jan 6, 2026

    • task-assets

      Public
      Python
      •0•0•1•1•Updated Jan 6, 2026Jan 6, 2026

    • inspect-verifiers-bridge

      Public
      Bridge for inspect <> verifiers.
      Python
      •
      MIT License
      •0•0•0•0•Updated Jan 5, 2026Jan 5, 2026

    • prime-rl

      Public
      Decentralized RL Training at Scale
      Python
      •
      Apache License 2.0
      •168•0•0•0•Updated Jan 5, 2026Jan 5, 2026

    • inspect-agents

      Public
      A collection of METR wrappers around Inspect agents and of METR scanners for Inspect Scout. Intended to allow consistent usage and customization.
      Python
      •1•4•4•0•Updated Jan 5, 2026Jan 5, 2026

    • triframe_inspect

      Public
      Python
      •1•1•8•1•Updated Jan 5, 2026Jan 5, 2026

    • inspect_scout

      Public
      Python
      •
      MIT License
      •5•1•0•0•Updated Jan 3, 2026Jan 3, 2026

    • terraform-docker-build

      Public
      Build docker containers using docker build cloud without a docker daemon
      HCL
      •
      MIT License
      •0•1•0•0•Updated Jan 2, 2026Jan 2, 2026

    • inspect_k8s_sandbox

      Public
      A Kubernetes sandbox environment for use with inspect_ai
      Python
      •
      MIT License
      •15•2•0•0•Updated Jan 2, 2026Jan 2, 2026

    • modelscan-inspect

      Public
      Modelscan but in Inspect
      Python
      •0•2•0•2•Updated Dec 15, 2025Dec 15, 2025

    • inspect-tasks-public

      Public
      Python
      •
      Other
      •5•4•12•3•Updated Dec 10, 2025Dec 10, 2025

    • cross-domain-horizon

      Public
      Estimate the time horizon of AIs over time on various domains like knowledge and vision
      Python
      •0•4•0•0•Updated Dec 3, 2025Dec 3, 2025

    • evaluation-resources

      Public
      SCSS
      •
      MIT License
      •4•3•0•1•Updated Nov 20, 2025Nov 20, 2025

    • hcast-public

      Public
      HTML
      •
      Other
      •3•18•2•0•Updated Nov 19, 2025Nov 19, 2025

    • public-tasks

      Public
      HTML
      •
      Other
      •17•114•1•2•Updated Nov 19, 2025Nov 19, 2025

    • inspect_swe

      Public
      Software Engineering Agents for Inspect AI
      Python
      •
      MIT License
      •9•1•0•0•Updated Nov 11, 2025Nov 11, 2025

    • vivaria

      Public
      Vivaria is METR's tool for running evaluations and conducting agent elicitation research.
      aielicitationai-evaluationevals
      TypeScript
      •
      MIT License
      •39•128•218•6•Updated Nov 11, 2025Nov 11, 2025

    • inspect-metr-task-bridge

      Public
      Python
      •1•1•14•0•Updated Nov 6, 2025Nov 6, 2025

    • task-aux-vm-helpers

      Public
      Python
      •1•0•0•0•Updated Nov 5, 2025Nov 5, 2025

    • .github

      Public
      0•0•0•0•Updated Nov 5, 2025Nov 5, 2025

    • task-artifacts

      Public
      Python
      •0•0•0•0•Updated Nov 5, 2025Nov 5, 2025

    • RE-Bench

      Public
      Python
      •
      Other
      •17•127•5•0•Updated Oct 16, 2025Oct 16, 2025

    • asciigraph

      Public
      Go package to make lightweight ASCII line graph ╭┈╯ in command line apps with no other dependencies.
      Go
      •
      BSD 3-Clause "New" or "Revised" License
      •109•0•0•0•Updated Oct 14, 2025Oct 14, 2025

    • task-protected-scoring

      Public
      Python
      •1•1•3•0•Updated Oct 6, 2025Oct 6, 2025

    • spacelift-tailscale

      Public
      Docker image for Spacelift containing Tailscale
      Shell
      •
      Apache License 2.0
      •7•0•0•0•Updated Sep 26, 2025Sep 26, 2025

    • CoT-faithfulness-and-monitorability

      Public
      Python
      •0•2•1•1•Updated Sep 12, 2025Sep 12, 2025

    • swe-bench-labeling

      Public
      Some data on SWE-Bench diffs, for labeling.
      0•0•0•0•Updated Sep 3, 2025Sep 3, 2025

    • terraform-aws-lambda

      Public
      Terraform module, which takes care of a lot of AWS Lambda/serverless tasks (build dependencies, packages, updates, deployments) in countless combinations 🇺🇦
      HCL
      •
      Apache License 2.0
      •752•0•0•0•Updated Aug 31, 2025Aug 31, 2025

    • gdm-replication

      Public
      Python
      •0•0•0•0•Updated Aug 2, 2025Aug 2, 2025