Repository navigation
Track Iceberg v3 Feature Support (Roadmap for 0.4.0) #637
Description
We already have partial support for Iceberg v3 in the codebase (e.g., Row Lineage and partition statistics). However, a number of key v3 features are still missing.
This issue serves as a parent tracking issue for the remaining v3 work we plan to (partially) include in the 0.3.0 release.
If you are interested in working on any of the items below, please open a dedicated sub-issue and link it back to this one.
V3 related
1. Schema-Level Support for New v3 Types
Add support for all newly introduced v3 types at the schema level, including:
-
timestamp_ns,timestamptz_ns@zhjwpku -
unknown@manuzhang -
variant@zhjwpku rely on arrow, defered to 0.5.0 -
geometry,geography@wgtmac
2. Column Default Values (Schema Evolution)
Enable schema evolution with default values:
- Support
initial-defaultandwrite-default@huan233usc - Apply defaults correctly during read and write paths @huan233usc feat: apply write defaults in Parquet and Avro writers #942
3. Multi-Argument Transforms (Not planned, as they are not supported by the Java implementation)
4. Binary Deletion Vectors
Add support for deletion vectors (DV):
- Puffin-based DV parsing @zhaoxuan1994
5. Table-Level Encryption Metadata (Not planned for 0.4.0) @shangxinli
Support encryption-related metadata defined in v3:
- Parse and preserve encryption metadata
6. Puffin-Based Statistics (Not planned for 0.4.0)
Support table and partition statistics stored in Puffin files:
- Metadata parsing
- Optional integration into scan planning
Table update and maintenance: #364
- OverwriteFiles @lishuxu
- RowDelta @manuzhang
- MergeAppend @zhjwpku
- DeleteFiles @manuzhang
- RewriteFiles @WZhuo
- ReplacePartitions @shangxinli
- RewriteManifests @zhjwpku feat: add rewrite manifests #774
- CherryPickOperation @shangxinli feat: add CherryPickOperation and wire SnapshotManager::Cherrypick #926
Miscellaneous
- Metadata table inspection @All-less @WZhuo
- LRU cache @HuaHuaY
- Logging interface and spdlog integration @kamcheungting-db
If anything is missing or you have suggestions, feel free to comment or open additional sub-issues.
Activity
[-]Track Iceberg v3 Feature Support (Target: 0.3.0)[/-][+]Track Iceberg v3 Feature Support (Target: 0.4.0)[/+]manuzhang commentedon May 21, 2026
@zhjwpku Can you help to link #665 here as sub-issue? I don't think I have the permission to do so.
unknowndata type #665variantdata type #666geometryandgeographydata type #667manuzhang commentedon May 21, 2026
@zhjwpku Meanwhile, it might be valuable to create a milestone 0.4.0 to track all issues?
zhjwpku commentedon May 21, 2026
Good suggestion. We haven't used milestones for previous releases, but I think we should start doing that for future releases. Let me try that.
zhjwpku commentedon May 21, 2026
Oh, I don't have permission to create milestones. Let's wait for @wgtmac to handle this. I'm not sure if we should do this after the 0.3.0 release.
wgtmac commentedon May 21, 2026
Created: https://github.com/apache/iceberg-cpp/milestone/1
wgtmac commentedon May 21, 2026
I think we don't need to support
5. Table-Level Encryption Metadataand6. Puffin-Based Statisticsat the moment.zhjwpku commentedon May 21, 2026
Added a comment noting that this is not planned for 0.4.0.
zhjwpku commentedon Jun 6, 2026
I've moved the unfinished items from Roadmap for 0.3.0 (#523) into this issue. Feel free to ping me if I missed anything.
I've also linked the iceberg-go V3 tracking issue [1] here so we can keep track of any V3-related work we might otherwise miss.
[1] apache/iceberg-go#589
[-]Track Iceberg v3 Feature Support (Target: 0.4.0)[/-][+]Track Iceberg v3 Feature Support (Roadmap for 0.4.0)[/+]35 remaining items
feat: add CherryPickOperation and wire SnapshotManager::Cherrypick
✨ feat(arrow): add write schema alignment
✨ feat(data): Apply defaults in data writers
feat: add CherryPickOperation and wire SnapshotManager::Cherrypick
manuzhang commentedon Sep 23, 2026
Remaining items not landing in 0.4.0 (variant, applying column defaults, RewriteManifests, CherryPickOperation, plus the unplanned encryption metadata and Puffin statistics work) are now tracked in #959 for the 0.5.0 milestone.
manuzhang commentedon Sep 23, 2026
@zhjwpku I've moved remaining items to #959 for 0.5.0 and will close this as completed for 0.4.0. Thanks!
feat: add CherryPickOperation and wire SnapshotManager::Cherrypick
shangxinli commentedon Oct 9, 2026
#988 is created for table encryption
feat: add CherryPickOperation and wire SnapshotManager::Cherrypick
feat: add CherryPickOperation and wire SnapshotManager::Cherrypick (#926