Skip to content

Add unified input provenance helper - #202

Merged
yoshifuminakamura merged 1 commit into
developfrom
feature/prestaged-input-provenance
Sep 12, 2026
Merged

yoshifuminakamura merged 1 commit into
developfrom
feature/prestaged-input-provenance

Conversation

@yoshifuminakamura

@yoshifuminakamura yoshifuminakamura commented Sep 11, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • Add a single bk_record_input helper that records input facts from parameters, command arguments, repository URLs, paths, and pre-staged dataset hints.
  • Move application examples to that common helper instead of app-local JSON or typed helper selection.
  • Keep source URL recording separate from public reuse eligibility checks.
  • Add a common Result JSON step that confirms github.com and gitlab.com repository visibility with anonymous provider APIs before adding public_access_check metadata.
  • Strip app-supplied public-access flags before Result JSON publication, require the confirmation host to match the exported URL host, and treat unconfirmed URLs as non-public for reuse export.
  • Accept parameter-only self-contained input in Portal summaries.

Validation

  • bash -n scripts/result.sh scripts/bk_functions.sh scripts/tests/test_result_common_json_contract.sh scripts/tests/test_bk_input_info.sh programs/genesis/run.sh programs/petsc-gmres/run.sh programs/qws/run.sh programs/salmon/run.sh programs/scale-letkf/run.sh
  • shellcheck -S error -f gcc scripts/result.sh scripts/bk_functions.sh scripts/tests/test_result_common_json_contract.sh scripts/tests/test_bk_input_info.sh programs/genesis/run.sh programs/petsc-gmres/run.sh programs/qws/run.sh programs/salmon/run.sh programs/scale-letkf/run.sh
  • bash scripts/tests/test_bk_input_info.sh
  • bash scripts/tests/test_result_common_json_contract.sh
  • python -m py_compile result_server/utils/result_records.py result_server/utils/public_reuse.py result_server/utils/evidence_packet.py result_server/utils/evidence_snapshot.py result_server/tests/test_results_loader.py result_server/tests/test_public_result_routes.py result_server/tests/test_evidence_snapshot.py

Note: pytest route tests were not run locally because the local Python environment is missing test dependencies; CI will cover them.

@yoshifuminakamura
yoshifuminakamura force-pushed the feature/prestaged-input-provenance branch from 35a04c0 to bf01512 Compare September 11, 2026 15:46
@yoshifuminakamura yoshifuminakamura changed the title Record declared input provenance for pre-staged data Add input provenance item helper Sep 11, 2026
@yoshifuminakamura
yoshifuminakamura force-pushed the feature/prestaged-input-provenance branch from bf01512 to d112702 Compare September 11, 2026 22:38
@yoshifuminakamura yoshifuminakamura changed the title Add input provenance item helper Add typed input provenance helpers Sep 11, 2026
@yoshifuminakamura
yoshifuminakamura force-pushed the feature/prestaged-input-provenance branch from d112702 to 27c7742 Compare September 12, 2026 02:41
@yoshifuminakamura yoshifuminakamura changed the title Add typed input provenance helpers Add unified input provenance helper Sep 12, 2026
@yoshifuminakamura
yoshifuminakamura force-pushed the feature/prestaged-input-provenance branch 4 times, most recently from 5ec3f5d to a4f1e0b Compare September 12, 2026 03:29
Signed-off-by: yoshifuminakamura <nakamura@riken.jp>
@yoshifuminakamura
yoshifuminakamura force-pushed the feature/prestaged-input-provenance branch from a4f1e0b to 74c93da Compare September 12, 2026 06:16
@yoshifuminakamura
yoshifuminakamura merged commit e96e7f4 into develop Sep 12, 2026
8 checks passed
@yoshifuminakamura
yoshifuminakamura deleted the feature/prestaged-input-provenance branch September 12, 2026 07:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant