Skip to content

Add opt-in native SequenceModel counter probe - #32

Merged
PyYoshi merged 1 commit into
devfrom
v3/sequence-native-probe
Sep 20, 2026
Merged

PyYoshi merged 1 commit into
devfrom
v3/sequence-native-probe

Conversation

@PyYoshi

@PyYoshi PyYoshi commented Sep 20, 2026

Copy link
Copy Markdown
Owner

概要

  • validated model headerを既存static libraryへリンクする独立diagnostic harness
  • 既存filter → 単一proberへのone-shot feed、実counter/state/confidence bits/resetを観測
  • compiler/header/library/binary/input hashを記録。engine/filter実装を複製・変更しない
  • 日本語仕様、人工モデルnative5件+実行前limit1件、Linux diagnostics CI接続

検証

  • モデル関連66テスト成功(native toolsあり)
  • GCC16 / Clang22でnative probe6件成功
  • Paris Stories validation16文書 × identity/filtered2モデルでnative counterとPython統計が全一致。各観測2回一致
  • confidenceは負値/1超もあり得る内部値。公開API結果・精度・校正済み確率ではない
  • native source、既定model、公開API、CMake targetは不変。P01/fuzzは再開しない

Related: PyYoshi/cChardet#123

@PyYoshi
PyYoshi marked this pull request as ready for review September 20, 2026 21:10
@PyYoshi
PyYoshi merged commit e86cc08 into dev Sep 20, 2026
11 checks passed
@PyYoshi
PyYoshi deleted the v3/sequence-native-probe branch September 20, 2026 21:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant