Bundle C2Cache, add CTable (.b2z) and hierarchical container support, chunked writes, and fancy coordinate indexing - #290

Merged

FrancescAlted merged 94 commits into

mainfrom

c2cache-monorepo

Sep 1, 2026

Commits on Jun 30, 2026

Add CTable .b2z support: metadata model, fetch pipeline via to_cframe(), Python client Table class
FrancescAlted
committed
3f4748c

Commits on Jul 1, 2026

Fix CTable whole-fetch bug, add Array/Table client hierarchy, and .b2z storage handling
FrancescAlted
committed
32947e8
Add web preview and CLI support for CTable (.b2z) datasets
FrancescAlted
committed
6a45518
Harden CTable (.b2z) row slicing, previews, and CLI edge cases
FrancescAlted
committed
93d9e81
Much cleaner error message for cat2-client on invalid commands
FrancescAlted
committed
ebd52a8
Much cleaner error message for cat2-client on invalid commands
FrancescAlted
committed
86e850a
Potential fix for pull request finding

FrancescAlted
and
Copilot
authored
2adefd8
Fix hardcoded suffix set in get_abspath() to use srv_utils.BLOSC2_NATIVE_SUFFIXES
Copilot
authored
6ce34ca
Potential fix for pull request finding

FrancescAlted
and
Copilot
authored
e3fc9b3
Add test for the table[-1] fix
FrancescAlted
committed
e410ea3
Support browsing TreeStore .b2z containers via virtual paths
FrancescAlted
committed
8ee2af2
Browse hierarchical .b2z (TreeStore) containers and directories
FrancescAlted
committed
4a7e954
Add plan for virtual descent for h5 too
FrancescAlted
committed
af2cce6

Commits on Jul 2, 2026

Commits on Jul 3, 2026

Commits on Jul 4, 2026

Initial plans for remote peer mounts
FrancescAlted
committed
51773ec
Initial implementation of plan
FrancescAlted
committed
3ec12dd
Fix peer-mounts review findings: correctness, error taxonomy, event-loop hygiene

FrancescAlted
and
claude
committed
dbb67dd

Commits on Jul 5, 2026

hdf5 required for the new server
FrancescAlted
committed
a1c1987
Add Docker/Apple-container tooling to manually exercise peer mounts
FrancescAlted
committed
eab1d62

Commits on Jul 6, 2026

Make peer roots fully browsable from the web UI

FrancescAlted
and
claude
committed
19742ec
Add missing files
FrancescAlted
committed
161cb1b
Add compiled static .js and .css files
FrancescAlted
committed
64c5fea
Decouple peer-mount capability into a c2cache provider plugin
FrancescAlted
committed
e4d9ac2
test_peers: add concurrency regression test for peer cache eviction
FrancescAlted
committed
9f5aabb

Commits on Jul 8, 2026

Replace peercache's global io_lock with per-cache locks
FrancescAlted
committed
2f8eacb
Updated instruction for the ongoing split
FrancescAlted
committed
ecd6091

Commits on Jul 9, 2026

Commits on Jul 10, 2026

New plan for allowing CTable mounted from remote peers
FrancescAlted
committed
6a4ffc4
Updated plan
FrancescAlted
committed
ac417b7
New simplified version for supporting .b2z files living in remote peers
FrancescAlted
committed
768dac3

Commits on Jul 11, 2026

Implements plans/caterva3-remote-peer-simplified.md:
FrancescAlted
committed
bad3e68
Require blosc2 >= 4.8.1 for zero-copy from_cframe safety
FrancescAlted
committed
2711c73
Add unit test: null sentinels survive the structured CTable cache
FrancescAlted
committed
fb38325
Add a todo list
FrancescAlted
committed
f3ae633
Retry peer chunk fetch once before marking the peer offline

FrancescAlted
and
claude
committed
fac0787
Enforce per-peer cache_quota with a scoped eviction pass

FrancescAlted
and
claude
committed
8c1694d
Relay whole-file api/download for peer paths

FrancescAlted
and
claude
committed
99508ae
Pin DictStore .b2z container browsing with a test

FrancescAlted
and
claude
committed
0d782ee
New plans for cache server and dynamic mounts
FrancescAlted
committed
58b2199

Commits on Jul 12, 2026

Some refinements on plans
FrancescAlted
committed
5675997

Commits on Jul 14, 2026

Cache whole-file .b2 entries for peer plain-file downloads
FrancescAlted
committed
c98265f

Commits on Aug 17, 2026

Say which responses serve byte ranges, and refuse the rest

FrancescAlted
and
claude
committed
76b2854

Commits on Aug 18, 2026

Serve chunks of a container leaf, and refuse the ones that are not stored

FrancescAlted
and
claude
committed
735e90a
Serve a container leaf from its window in the file

FrancescAlted
and
claude
committed
3576fd4

Commits on Aug 20, 2026

Commits on Aug 21, 2026

Name a filled array by a nonce, and say when it is complete

FrancescAlted
and
claude
committed
33d9f2a
Reach the fill from the client, and say in the docs that it is there

FrancescAlted
and
claude
committed
64f1bdf

Commits on Aug 22, 2026

Say on api/info whether a dataset can be read in ranges

FrancescAlted
and
claude
committed
d760c6f
Gather scattered coordinates on the server, for clients that ask

FrancescAlted
and
claude
committed
2aa1928
Take a fetch's parameters in a body, for keys an URL cannot hold

FrancescAlted
and
claude
committed
a45fe2a
Let this client ask for coordinates too, not only boxes

FrancescAlted
and
claude
committed
e230409
Browse a DictStore .b2z, and stop caching nulls the cache cannot carry

FrancescAlted
and
claude
committed
17f5527
Carry a column's validity across the cache, so masked nulls stay cacheable

FrancescAlted
and
claude
committed
47132ad
Check what a small table's ratio is, not that it flatters the table

FrancescAlted
and
claude
committed
91948b3

Commits on Aug 23, 2026

Keep a write inside the root that let it in

FrancescAlted
and
claude
committed
415b349
Refuse a fetch parameter this server cannot narrow with

FrancescAlted
and
claude
committed
36277e7
Say of a dataset only what fetching it will really do

FrancescAlted
and
claude
committed
3b727c3
Check the whole of a chunk's geometry, and stage each publish apart

FrancescAlted
and
claude
committed
6ed6665
Spell a key the way the server will read it back

FrancescAlted
and
claude
committed
b861f80
Rebuild a peer cache whose format this code has outgrown

FrancescAlted
and
claude
committed
3d86a68
Say in the notes what these endpoints actually do now

FrancescAlted
and
claude
committed
b984475
Run the tests on every branch, not only on main

FrancescAlted
and
claude
committed
9012f0a
Ask for fsspec, which the fill path has needed all along

FrancescAlted
and
claude
committed
1bc0fa2
Rebuild a container leaf where blosc2 cannot say where it lies

FrancescAlted
and
claude
committed
47a1cbe
Stand down the tests that need a blosc2 nobody can install yet

FrancescAlted
and
claude
committed
c22f20b
Let the server import on a Python that reads its annotations eagerly

FrancescAlted
and
claude
committed
bf4263f

Commits on Aug 28, 2026

Publish @personal under the user it belongs to

FrancescAlted
and
claude
committed
989d5b4
Read a peer CTable's info as a CTable's

FrancescAlted
and
claude
committed
244b13c
Name a relayed download's file once

FrancescAlted
and
claude
committed
29ecf93
Keep one bad peer from raising out of the registry

FrancescAlted
and
claude
committed
d0fdeda
Normalize the path in get_chunk

FrancescAlted
and
claude
committed
13d1c31
List a container path that names one leaf as that leaf

FrancescAlted
and
claude
committed
0ee135b
Break the connection on a leaf window that ends early

FrancescAlted
and
claude
committed
d88e2be
Bound the POST api/fetch body at the request, not at the parse

FrancescAlted
and
claude
committed
1ba07d4
Gather eviction candidates only when a quota is exceeded

FrancescAlted
and
claude
committed
438fbbd
Hold the per-cache locks weakly

FrancescAlted
and
claude
committed
1482598
Share one filtered-array cache entry between callers

FrancescAlted
and
claude
committed
42dc2f7
Ship c2cache in the container image

FrancescAlted
and
claude
committed
07b217c

Commits on Aug 31, 2026

Fix the review findings on the c2cache branch

FrancescAlted
and
claude
committed
d37c48b
Pin ruff at 0.16.5, and select rules instead of extending them

FrancescAlted
and
claude
committed
b06dd4f
Bundle C2Cache inside Caterva2
FrancescAlted
committed
bbbb5d4