Repository navigation
[dataflow-dataset] DataFlow Dataset Build Report (mixed) — 2026-10-23 #71322
Closed
Replies: 1 comment
|
This discussion was automatically closed because it expired on 2026-10-30T03:01:37.959Z.
|
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Summary
Built a cleaned, deduplicated dataset from GitHub discussions and PRs.
mixedCharNumberFilter,HashDeduplicateFilter(DataFlow 1.0.10);python_alpha_ratio_filter(Python)DataFlow handled length filtering and exact-hash dedup; the alpha-ratio filter ran in Python (
AlphaWordsFilterskipped to avoid NLTK downloads).Records by Source
Notes
upload_artifactsafe-output is not enabled in this run, sodataset_clean.jsonlwas not uploaded. It remains at/tmp/gh-aw/agent/dataflow/output/dataset_clean.jsonl.Generated by DataFlow PR & Discussion Dataset Builder — Run #39891985726
All reactions