Skip to content

Update data contribution process for new web3.storage #4340

Open

Description

@thewtex

web3.storage recently changed its interface. Update our data upload process and docs accordingly.

Activity

  1. added
    type:InfrastructureInfrastructure/ecosystem related changes, such as CMake or buildbots
    on Nov 20, 2023
  2. self-assigned this
    on Nov 20, 2023
  3. dzenanz commented on Mar 16, 2026

    @dzenanz
    Member

    On https://content-link-upload.itk.org/ clicking Sign in with GitHub leads to https://content-link-upload.itk.org/auth/login with content:

    Page not found
    Looks like you’ve followed a broken link or entered a URL that doesn’t exist on this site.

    If this is your site, and you weren’t expecting a 404 for this path, please visit Netlify’s “page not found” support guide for troubleshooting tips.

  4. dzenanz commented on Mar 16, 2026

    @dzenanz
    Member

    The most discussion about this happened in PR #5836.

  5. thewtex commented on Mar 16, 2026

    @thewtex
    MemberAuthor

    On https://content-link-upload.itk.org/ clicking Sign in with GitHub leads to https://content-link-upload.itk.org/auth/login with content:

    The migration is not complete. ETA the end of this week. It is being tracked in this issue: InsightSoftwareConsortium/cmake-w3-externaldata-upload#3

  6. N-Dekker commented on Apr 3, 2026

    @N-Dekker
    Contributor
  7. thewtex commented on Apr 6, 2026

    @thewtex
    MemberAuthor

    I am working on this more this week.

  8. dzenanz commented on Sep 23, 2026

    @dzenanz
    Member

    The instructions don't work on Windows:

    C:\Dev\ITK-git>pixi run -e external-data-upload python Utilities/Maintenance/ExternalDataUpload/upload.py "C:/Dev/ITK-git/Testing/Data/Input/rf_voltage_15_freq_0005000000_2017-5-31_12-36-44_ReferenceSpectrum_side_lines_03_fft1d_size_128.mha" --testing-data-repo C:\Dev\ITKTestingData
    ==> Packing rf_voltage_15_freq_0005000000_2017-5-31_12-36-44_ReferenceSpectrum_side_lines_03_fft1d_size_128.mha into a CAR (unixfs-v1-2025 profile)...
    ==> Uploading to Filebase bucket 'itk-test-data'...
    Traceback (most recent call last):
      File "C:\Dev\ITK-git\Utilities\Maintenance\ExternalDataUpload\upload.py", line 386, in <module>
        raise SystemExit(main())
                         ~~~~^^
      File "C:\Dev\ITK-git\Utilities\Maintenance\ExternalDataUpload\upload.py", line 351, in main
        cid = upload_file_to_filebase(abs_path, bucket, access_key, secret_key)
      File "C:\Dev\ITK-git\Utilities\Maintenance\ExternalDataUpload\upload.py", line 155, in upload_file_to_filebase
        local_cid = build_car(input_path, car_path)
      File "C:\Dev\ITK-git\Utilities\Maintenance\ExternalDataUpload\upload.py", line 45, in build_car
        result = subprocess.run(
            [
        ...<11 lines>...
            check=True,
        )
      File "C:\Dev\ITK-git\.pixi\envs\external-data-upload\Lib\subprocess.py", line 554, in run
        with Popen(*popenargs, **kwargs) as process:
             ~~~~~^^^^^^^^^^^^^^^^^^^^^^
      File "C:\Dev\ITK-git\.pixi\envs\external-data-upload\Lib\subprocess.py", line 1039, in __init__
        self._execute_child(args, executable, preexec_fn, close_fds,
        ~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
                            pass_fds, cwd, env,
                            ^^^^^^^^^^^^^^^^^^^
        ...<5 lines>...
                            gid, gids, uid, umask,
                            ^^^^^^^^^^^^^^^^^^^^^^
                            start_new_session, process_group)
                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
      File "C:\Dev\ITK-git\.pixi\envs\external-data-upload\Lib\subprocess.py", line 1554, in _execute_child
        hp, ht, pid, tid = _winapi.CreateProcess(executable, args,
                           ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^
                                 # no special security
                                 ^^^^^^^^^^^^^^^^^^^^^
        ...<4 lines>...
                                 cwd,
                                 ^^^^
                                 startupinfo)
                                 ^^^^^^^^^^^^
    FileNotFoundError: [WinError 2] The system cannot find the file specified
    

    I was able to follow them on Ubuntu.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

type:InfrastructureInfrastructure/ecosystem related changes, such as CMake or buildbots

Type

No type

Projects

No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions