Modaic 🐙

Modular Agent Infrastructure Collection, a Python framework for maintaining DSPy applications.

Key Features

• Hub Support: Load and share precompiled DSPY programs from Modaic Hub
• Program Framework: Precompiled and auto-loading DSPY programs
• Automated LM Judge Alignment: Continuously align your LM judges to your preferences while staying at the Pareto frontier!

Installation

Using uv (recommended)

uv add modaic

Optional (for hub operations):

export MODAIC_TOKEN="<your-token>"

Using pip

Please note that you will not be able to push DSPY programs to the Modaic Hub with pip.

pip install modaic

Quick Start

Creating a Simple Program

from modaic import PrecompiledProgram, PrecompiledConfig

class WeatherConfig(PrecompiledConfig):
    weather: str = "sunny"

class WeatherProgram(PrecompiledProgram):
    config: WeatherConfig

    def __init__(self, config: WeatherConfig, **kwargs):
        super().__init__(config, **kwargs)

    def forward(self, query: str) -> str:
        return f"The weather in {query} is {self.config.weather}."

weather_program = WeatherProgram(WeatherConfig())
print(weather_program(query="Tokyo"))

Save and load locally:

weather_program.save_precompiled("./my-weather")

from modaic import AutoProgram, AutoConfig

cfg = AutoConfig.from_precompiled("./my-weather", local=True)
loaded = AutoProgram.from_precompiled("./my-weather", local=True)
print(loaded(query="Kyoto"))

Architecture

Program Types

1. PrecompiledProgram: Statically defined programs with explicit configuration
2. AutoProgram: Dynamically loaded programs from Modaic Hub or local repositories

Support

For issues and questions:

• GitHub Issues: https://github.com/modaic-ai/modaic/issues
• Docs: https://docs.modaic.dev