title	SimpleAudit Studio
emoji	🔍
colorFrom	blue
colorTo	indigo
sdk	docker
app_port	7860
pinned	false

SimpleAudit Studio

A self-hostable platform for reproducible AI model audits using the SimpleAudit engine.

Quick run

Needs uv:

uvx simpleaudit-studio@latest

To run the latest code from GitHub instead of the published package:

uvx --from "git+https://github.com/SimulaMet/SimpleAuditStudio@main" spin

Open http://localhost:8000. Try the live demo if you do not want to install anything.

Development

git clone https://github.com/SimulaMet/SimpleAuditStudio
cd SimpleAuditStudio
cp .env.dev.example .env
uv sync --extra dev
uv run manage.py setup_local
uv run manage.py dev

The app opens at http://localhost:8000 with live reload. Use --no-browser to skip opening a browser.

What it does

• Build versioned scenario sets and register OpenAI-compatible models.
• Define judges and run audits across models, scenarios, and settings.
• Review runs live and compare results in the dashboard.
• Monitor models for drift on a schedule.

Documentation

• Deployment — all run commands, settings, chat, upgrades, backups, and production notes
• Chat — chat setup and privacy details
• Architecture — system design and service boundaries
• Domain model — core data and invariants

Contributing

Architecture decisions are documented in docs/architecture.md.