feat(storage,driver,adapters): add streaming Arrow batches, binary COPY, staged upserts, and index lifecycle by cofin · Pull Request #868 · litestar-org/sqlspec

feat(arrow): add streaming RecordBatch coercion and batch telemetry helpers

cofin

committed

192db7f

feat(postgres): add zero-loop columnar PGCOPY binary encoding and streaming COPY

cofin

committed

9b22b9d

feat(storage): add streaming arrow batch pipeline, vector parquet defaults, and schema-pinned jsonl

cofin

committed

fa978d7

feat(driver): add parallel storage ingestion, staged bulk merge, without_indexes, and dynamic auth providers

cofin

committed

0278f69

feat(duckdb): add container-aware memory clamping, tmpfs spill check, and post-connect parquet_metadata_cache

cofin

committed

e8b9068

refactor(cache): enforce module-level AST ordering and verify L1/L2 cache coordination

cofin

committed

eb83136

fix(types,adapters): resolve driver load overrides, mypy arrow types, and adbc callable import

cofin

committed

a45419a

fix(arrow): cast stream sources to satisfy pyright SupportArrowStream protocol

cofin

committed

e48708d

fix(postgres): default enable_pgcopy_binary to opt-in for adapter copy compatibility

cofin

committed

9d2a7d7

fix(driver,storage,adapters): harden staged bulk loads, streaming storage, pgcopy, and telemetry

cofin

committed

05c7b40

fix(driver,storage,adapters): align sync load overrides, pipeline batch write args, and batch prep typing

cofin

committed

70bb8b3

fix(duckdb): safely detect memory on windows without os.sysconf

cofin

committed

f6a25ee

refactor(sqlite,aiosqlite): debloat ad-hoc execute_many thin path

cofin

committed

cc0259d

docs(data-dictionary): polish method table, eliminate overflow and awkward wraps

cofin

committed

c93ce8d

Navigation Menu

Repository navigation

feat(storage,driver,adapters): add streaming Arrow batches, binary COPY, staged upserts, and index lifecycle - #868

feat(storage,driver,adapters): add streaming Arrow batches, binary COPY, staged upserts, and index lifecycle#868
cofin merged 14 commits into
mainfrom
research_databakes_data_flow

Commits on Oct 31, 2026

feat(arrow): add streaming RecordBatch coercion and batch telemetry helpers

feat(postgres): add zero-loop columnar PGCOPY binary encoding and streaming COPY

feat(storage): add streaming arrow batch pipeline, vector parquet defaults, and schema-pinned jsonl

feat(driver): add parallel storage ingestion, staged bulk merge, without_indexes, and dynamic auth providers

feat(duckdb): add container-aware memory clamping, tmpfs spill check, and post-connect parquet_metadata_cache

refactor(cache): enforce module-level AST ordering and verify L1/L2 cache coordination

fix(types,adapters): resolve driver load overrides, mypy arrow types, and adbc callable import

fix(arrow): cast stream sources to satisfy pyright SupportArrowStream protocol

fix(postgres): default enable_pgcopy_binary to opt-in for adapter copy compatibility

fix(driver,storage,adapters): harden staged bulk loads, streaming storage, pgcopy, and telemetry

fix(driver,storage,adapters): align sync load overrides, pipeline batch write args, and batch prep typing

fix(duckdb): safely detect memory on windows without os.sysconf

refactor(sqlite,aiosqlite): debloat ad-hoc execute_many thin path

docs(data-dictionary): polish method table, eliminate overflow and awkward wraps