Skip to content

Add provenance-checked spoken French training corpus - #37

Merged
PyYoshi merged 1 commit into
devfrom
v3/paris-training-corpus
Sep 20, 2026
Merged

PyYoshi merged 1 commit into
devfrom
v3/paris-training-corpus

Conversation

@PyYoshi

@PyYoshi PyYoshi commented Sep 20, 2026

Copy link
Copy Markdown
Owner

概要

  • 既存validation専用pilotを維持し、固定revisionのupstream trainを別profileで取り込む
  • 元1387文のうち録音ID欠落27文、validationと同じ録音38文を明示recipeで隔離し、rawを保持
  • 残る32録音1322文をtrainingに固定。既存validationのsplit・本文は変更しない
  • source hash/origin/sentence IDのcross-split重複を拒否してから出力
  • CC BY-SA 4.0の出典・notice・抽出条件を保存。toolはMIT、生成modelの配布条件は未決定

検証

  • corpus 49 tests、source acquisition 39 tests成功
  • UTF-8/cp1252 64 variants全件strict往復成功、別出力への取込/生成の全byte一致
  • training32 + validation16の1128 pairでchar5近似候補0(独立性の証明ではない)
  • Ruff E/F、git diff --check

原文/生成modelはGit管理外。test・音声の取得、model再学習、holdout予測、P01再開は行っていない。

@PyYoshi
PyYoshi marked this pull request as ready for review September 20, 2026 22:29
@PyYoshi
PyYoshi merged commit 6132450 into dev Sep 20, 2026
11 checks passed
@PyYoshi
PyYoshi deleted the v3/paris-training-corpus branch September 20, 2026 22:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant