Skip to content

Add CPU/media benchmarking, speech scorers and efficient run tooling - #11

Merged
haaziq-sl merged 4 commits into
mainfrom
feature/cpu-speech-efficiency
Nov 6, 2026
Merged

haaziq-sl merged 4 commits into
mainfrom
feature/cpu-speech-efficiency

Conversation

@haaziq-sl

@haaziq-sl haaziq-sl commented Nov 6, 2026 •

Copy link
Copy Markdown
Collaborator

CPU and speech optimization currently require custom orchestration and scorer scripts, while agents repeatedly reload logs and saved-run context. This adds reusable CPU/media benchmarking and speech-quality tools, plus compact evidence inspection and validated run resumption.

Changes

  • Require fresh web research for baselines and tuning recipes on the exact model and hardware. Engine lists are examples with no fixed count; recheck past surveys and platform exclusions, then tune and measure locally with versions and workloads pinned for each comparison.
  • Support fresh-process audio/image rounds, stable audio identities across port changes, TTS intake fields, CPU diagnostics and thread/affinity screens. Reports retain environment and memory context and reject incomplete round coverage.
  • Add opt-in evidence summaries, post-timing request/token accounting and read-only run resumption with policy/evidence validation, including compatibility with older media intakes. Full evidence remains accessible.
  • Add local Faster Whisper, UTMOSv2 and SpeechBrain ECAPA adapters, with WER/CER, naturalness and optional voice-reference checks. Scorers run in a separate CPU environment, bind observations to registered policies and saved PCM, and retain exact-output and separate listening requirements.

Addresses #5, #6, #7, #8, #9 and #10.

Validation

  • Runtime/scorer changes: full suite 1,971 passed, 90 skipped, including installed-wheel and MCP checks.
  • Baseline-selection instruction update: 386 passed, 1 skipped across skill, workflow, plain-language and OpenCode checks.
  • Real CPU execution of all three scorers and the complete policy → saved-audio replay → scoring → quality → report workflow, with network calls blocked.
  • Missing/modified PCM and mismatched score identities were rejected; identical inputs produced matching observations.
  • The real-model smoke used one public synthetic sample. Its quality verdict correctly remained UNPROVEN; this was not a full KittenTTS optimization or listening study.

Release follow-up

The package version and plugin install pins remain at 0.1.0. Users need a new PyPI runtime release and coordinated launcher/install-pin updates to receive the new operations. This PR does not publish a package.

Add fresh-process audio/image rounds, stable audio endpoint identities, TTS intake fields, CPU diagnostics and tuning manifests. Record environment and memory context, check round coverage, and bind registered speech-quality evidence to comparisons. Addresses issues #5 through #10.
Add opt-in compact summaries with complete pagination, post-timing serving accounting, and validated read-only run checkpoints. Preserve full evidence access and reject changed policy or invalid spending records. Include pagination and portable-path regression fixes.
Run pinned Faster Whisper, UTMOSv2 and ECAPA models in a separate offline CPU environment. Bind observations to registered policies and retained PCM, support CER alongside WER, and preserve exact-output and listening requirements. Document scorer setup and expose the operations through CLI and MCP.
@haaziq-sl
haaziq-sl merged commit 782b872 into main Nov 6, 2026
5 checks passed
@haaziq-sl
haaziq-sl deleted the feature/cpu-speech-efficiency branch November 6, 2026 23:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant