fix(chunk-grids): read mixed regular/rectilinear chunk grids written by zarr 3.2.x - #4375

Draft

d-v-b wants to merge 96 commits into

zarr-developers:mainfrom

d-v-b:fix/mixed-regular-chunk-grid-4374

Commits on Sep 12, 2026

Merge branch 'main' into fix/zero-length-single-invariant
d-v-b
authored
7a2a71a

Commits on Sep 13, 2026

docs: qualify zero-chunk compatibility history
d-v-b
committed
2297c62

Commits on Sep 16, 2026

Merge branch 'main' into fix/zero-length-single-invariant
d-v-b
authored
2873178
Merge branch 'main' into fix/zero-length-single-invariant
d-v-b
authored
d868213

Commits on Sep 18, 2026

Commits on Sep 19, 2026

Commits on Sep 25, 2026

Merge branch 'fix/zero-length-single-invariant' (#4334) into fix/mixed-regular-chunk-grid-4374
d-v-b
committed
e32fd4b
refactor(metadata): read both legacy regular chunk grid forms in one place

d-v-b
and
claude
committed
e324baa
Merge branch 'main' into fix/zero-length-single-invariant
d-v-b
authored
64b3550
fix(metadata): read a stored zero chunk size on a grown axis as one spanning chunk

d-v-b
and
claude
committed
8414ea3
test: a stateful test of one array's create/append/resize/write life

d-v-b
and
claude
committed
2bf32df
Merge branch 'fix/zero-length-single-invariant' (#4334) into fix/mixed-regular-chunk-grid-4374
d-v-b
committed
b2e3c99
fix(metadata): stop the zero chunk size warning from naming writers

d-v-b
and
claude
committed
1723f0b
Merge branch 'fix/zero-length-single-invariant' (#4334) into fix/mixed-regular-chunk-grid-4374
d-v-b
committed
8d672b6
fix(metadata): stop the mixed chunk grid messages from naming releases

d-v-b
and
claude
committed
09639f4
chore(metadata): drop an orphaned comment in ArrayV2Metadata.__init__

d-v-b
and
claude
committed
3d223f1
fix(chunk-grids): size a full-span shard as a multiple of the inner chunk

d-v-b
and
claude
committed
339c514
refactor(metadata): read invalid stored chunk sizes in one module of document upgrades

d-v-b
and
claude
committed
e49eb7e
docs: rewrite the 4334 changelog fragment and trim restating docstrings

d-v-b
and
claude
committed
f6f5c7b
test: model exactly what the store holds in the array lifecycle state machine

d-v-b
and
claude
committed
f873358
Merge branch 'loop/4334' (#4334) into loop/4375

d-v-b
and
claude
committed
d277b47
refactor(metadata): warn about an upgraded document only once it validates

d-v-b
and
claude
committed
ae7c295
fix(metadata): read a regular grid listing chunk edges as a document upgrade

d-v-b
and
claude
committed
d17a848
refactor(metadata): drop numpy and tuple widening from chunk grid metadata

d-v-b
and
claude
committed
8aef319
docs: describe reading mixed regular grids without the rectilinear flag

d-v-b
and
claude
committed
d56ac40
refactor(metadata): warn about an upgraded document only once it validates

d-v-b
and
claude
committed
d9549b8
Merge loop/4334 into w4375
d-v-b
committed
355ce92

Commits on Sep 26, 2026

refactor(metadata): one per-axis rule for stored chunk sizes, one rule for edges

d-v-b
and
claude
committed
5ef0f51
refactor(chunk-grids): start chunk guessing from the one full-span rule

d-v-b
and
claude
committed
192f86c
test: run the array lifecycle state machine in the slow Hypothesis job

d-v-b
and
claude
committed
2e878cf
Merge loop/4334 into loop/4375

d-v-b
and
claude
committed
0723ca3
fix(metadata): read a regular grid mixing sizes and edge lists per axis

d-v-b
and
claude
committed
8e0cfc2
fix(array): check that metadata can be stored before touching the store

d-v-b
and
claude
committed
9c9ee76
fix(array): store upgraded metadata before writing the first chunk

d-v-b
and
claude
committed
c0d4b3c
refactor(metadata): name an array one way in upgrade warnings

d-v-b
and
claude
committed
121b6b2
refactor(metadata): one rule for bare sizes and edge lists; one noun in messages

d-v-b
and
claude
committed
c1353bf
Merge loop/4334 into loop/4375

d-v-b
and
claude
committed
285292b
fix: encode metadata before deleting store content

d-v-b
and
claude
committed
d182618
test: reject a run-length entry that is not a pair

d-v-b
and
claude
committed
d3a6eae
fix(array): store the upgrade of the current stored document before writing

d-v-b
and
claude
committed
f081f1b
test: prefer zero-length axes for stored chunk size 0 in the lifecycle machine

d-v-b
and
claude
committed
9e29333
Merge loop/4334 into loop/4375

d-v-b
and
claude
committed
57b840d
refactor: the caller that knows the node names it in gate errors

d-v-b
and
claude
committed
140a706
fix(group): delete a consolidated member in place, after encoding without it

d-v-b
and
claude
committed
299ecb3
fix(metadata): keep accepting the chunk sizes zarr 3.4.0 accepted in metadata constructors (patch release)

d-v-b
and
claude
committed
632ac2b
fix(array): leave a valid stored document as written on a stale handle's first write

d-v-b
and
claude
committed
245acae
docs: describe the 4334 changes to metadata constructors for a patch release

d-v-b
and
claude
committed
2d0121d
Merge loop/4334 into loop/4375

d-v-b
and
claude
committed
b5dbe10
test: expect the patch release's wording for non-integral chunk edges (patch release)

d-v-b
and
claude
committed
8c6af46
fix(metadata): read float edges only in stored rectilinear documents

d-v-b
and
claude
committed
4c4fe21
Merge loop/4334 into loop/4375

d-v-b
and
claude
committed
d07c05b
test: read float edges in a regular grid that lists chunk edge lengths

d-v-b
and
claude
committed
c678c9c
test(codecs): pickle a ShardingCodec with an inner chunk size of 0

d-v-b
and
claude
committed
6fde402
fix(group): build every node before create_hierarchy deletes or stores anything

d-v-b
and
claude
committed
b0ea125
fix(metadata): warn only where the user must act; guard and refresh upgraded copies

d-v-b
and
claude
committed
a903d66
test: expect the lifecycle machine's upgrade warning only on non-empty axes

d-v-b
and
claude
committed
f78e115
Merge loop/4334 into loop/4375

d-v-b
and
claude
committed
f3d009e
fix(group): encode a group's consolidated metadata before storing member upgrades

d-v-b
and
claude
committed
820f083
fix(metadata): leave a sharded chunk size of 0 unread when the inner shape is invalid

d-v-b
and
claude
committed
bc306aa
perf(metadata): read each upgraded member once, concurrently, and adopt it

d-v-b
and
claude
committed
3bc802f
Merge loop/4334 into loop/4375

d-v-b
and
claude
committed
7f5e5fd
fix(group): store the consolidated metadata as it is after a deletion

d-v-b
and
claude
committed
76e334e
refactor: name a node in errors as "Array 'path': what happened"

d-v-b
and
claude
committed
f78932d
fix(group): adopt refreshed consolidated members in place

d-v-b
and
claude
committed
dc50ec6
fix(metadata): raise the rectilinear flag error when refreshing a consolidated member

d-v-b
and
claude
committed
cddb877
Merge loop/4334 into loop/4375

d-v-b
and
claude
committed
38181f8
fix(group): say nothing was stored when a consolidated member needs the flag

d-v-b
and
claude
committed
b0628e6
perf(group): read each upgraded member once when deleting a member

d-v-b
and
claude
committed
8753ef4
fix(group): store a group's documents only; keep upgraded members as stored

d-v-b
and
claude
committed
4b9f82c
Merge loop/4334 into loop/4375

d-v-b
and
claude
committed
9acf8ee
docs(group): say what consolidated metadata stores for an upgraded array

d-v-b
and
claude
committed
65f3f8e
Merge loop/4334 into loop/4375

d-v-b
and
claude
committed
1bedd32
fix(array): clear the stored document whenever an array stores its metadata

d-v-b
and
claude
committed
faa6efe
Merge loop/4334 into loop/4375

d-v-b
and
claude
committed
8ce9a91
test(metadata): pin that a failed metadata save keeps the stored document mark

d-v-b
and
claude
committed
30d7ca6
Merge loop/4334 into loop/4375

d-v-b
and
claude
committed
8d5785a

Commits on Sep 29, 2026

Merge remote-tracking branch 'up/main' into up/4334
d-v-b
committed
7a0154e
Merge branch 'up/4334' into up/4375
d-v-b
committed
dcffa3d
fix(metadata): read a stored chunk size of 0 as 1, however long the axis
d-v-b
committed
6707b45
Merge branch 'up/4334' into up/4375
d-v-b
committed
07f5b22
fix(metadata): re-save only upgrades that move chunks, and read non-JSON input as is
d-v-b
committed
9e07aaf
Merge branch 'up/4334' into up/4375
d-v-b
committed
1a91532
fix(array): encode new array metadata before deleting an existing node
d-v-b
committed
23231e6
test(metadata): type the rectilinear chunks passed to zarr.create in an overwrite test
d-v-b
committed
d7ff723