Skip to content

feat: add CLI history baseline and regression ergonomics - #46

Merged
salim4n merged 1 commit into
mainfrom
feat/cli-history-baseline-regression
Jun 30, 2026
Merged

feat: add CLI history baseline and regression ergonomics#46
salim4n merged 1 commit into
mainfrom
feat/cli-history-baseline-regression

Conversation

@salim4n

@salim4n salim4n commented Jun 30, 2026

Copy link
Copy Markdown
Member

Summary

  • Add CLI history commands: eval history list and eval history show.
  • Add eval run --history ... --record-history for local JSONL history.
  • Add baseline selection with --baseline latest|entry-id and regression checks with thresholds.
  • Add optional regression Markdown output and docs for local/CI loops.

Out of scope

  • Database or hosted history
  • SaaS dashboard
  • Remote execution
  • Provider calls
  • New reward algorithms
  • PPO or policy optimization

Validation

  • bun test packages/cli/src/index.test.ts
  • bun run lint
  • bun run typecheck
  • bun run test
  • bun run build
  • bun run pack:check
  • CLI smoke: record history, baseline latest regression, list, show
  • git diff --check

@salim4n
salim4n merged commit 2785861 into main Jun 30, 2026
1 check passed
@salim4n
salim4n deleted the feat/cli-history-baseline-regression branch June 30, 2026 22:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant