Skip to content

Compare generated models against legacy French reference - #33

Merged
PyYoshi merged 1 commit into
devfrom
v3/legacy-model-comparison
Sep 20, 2026
Merged

PyYoshi merged 1 commit into
devfrom
v3/legacy-model-comparison

Conversation

@PyYoshi

@PyYoshi PyYoshi commented Sep 20, 2026

Copy link
Copy Markdown
Owner

概要

  • 既存Windows_1252FrenchModelをlibrary symbolとして直接参照。tableコピー・新規契約への変換なし
  • identity/filtered/legacyを同じnative harness、library、入力条件で比較
  • training/evaluation分離とprovenance確認、内部confidenceの負値/1超/非有限を分離
  • legacy training overlapはUNKNOWN。正解率・校正済み確率へ読み替えない
  • 日本語仕様と4テストを追加

検証

  • モデル70 tests成功(native toolsあり)、なし62成功/8skip
  • Clangで追加4 tests成功、Ruff/diff check成功
  • Paris16文書・Rust book別章で2回のreportが全byte一致
  • 既存modelも全件detecting。生成modelだけの失敗状態とは扱わない
  • engine/既定model登録/公開API/P01は変更しない

Related: PyYoshi/cChardet#123

@PyYoshi
PyYoshi marked this pull request as ready for review September 20, 2026 21:23
@PyYoshi
PyYoshi merged commit 05c43c7 into dev Sep 20, 2026
11 checks passed
@PyYoshi
PyYoshi deleted the v3/legacy-model-comparison branch September 20, 2026 21:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant