ci: validate sample_data blocks, ported from DLEAPP - #405
Merged
Conversation
Adds DLEAPP's validate_sample_data.py with only the tool name and env var adapted, plus its workflow. CI runs the structural tier (well-formed sample_data mappings, comparable row counts) on every artifact PR; the registry and row-count tiers run locally against the private corpus registry. One generalization over the DLEAPP original, applied there in the same pass: --run picks the -t input type from the corpus file extension instead of hardcoding zip, since registries point at zip, tar, and tar.gz images alike. Verified: structural tier runs clean here, registry tier exercised against the local corpus registry, pylint --disable=C,R scores 10/10. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Ports DLEAPP's sample_data validator, with only the tool name and env var adapted. CI runs the structural tier (well-formed sample_data mappings, comparable row counts) on artifact PRs; the registry and row-count tiers need the private corpus registry and run locally:
One generalization over the DLEAPP original, applied to DLEAPP in the same pass so the five copies stay in lockstep: --run picks the -t input type from the corpus file extension instead of hardcoding zip, since the registries point at zip, tar, and tar.gz images alike.
Verified before opening: structural tier runs clean in this repo, the registry tier was exercised against the local corpus registry, and pylint --disable=C,R scores the script 10/10.
Part of a CI leveling pass across the five cores.
🤖 Generated with Claude Code