Skip to content

Feature/cdspt 16114 add parquet streaming functionality - #22

Merged
Suvinthomas merged 2 commits into
mainfrom
feature/CDSPT-16114-add_parquet_streaming_functionality
Oct 23, 2026
Merged

Suvinthomas merged 2 commits into
mainfrom
feature/CDSPT-16114-add_parquet_streaming_functionality

Conversation

@pgodden-jisc

Copy link
Copy Markdown
Contributor

Added a function in data streamer to generate data as parquet files, intended to replace .hyper file generation in TDSA. Unit test runs successfully:
image

@Suvinthomas

Copy link
Copy Markdown
Contributor

Reviewed and tested. Functionality works as expected and is consistent with the existing batch streaming extractor implementation. Approved.
image

@Suvinthomas
Suvinthomas merged commit f4c6ea8 into main Oct 23, 2026
3 checks passed
@Suvinthomas
Suvinthomas deleted the feature/CDSPT-16114-add_parquet_streaming_functionality branch October 23, 2026 13:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants