Tracking Issue: Integration with Datafusion

[marvinlanhenke]

Motivation:

Once we merge #324 and complete the basic groundwork, the integration crate can be continuously refined. Due to for example more supported features like predicate pushdown, etc.

This list is supposed to evolve over time, so feel free to add missing todos.

Todos:

• proper integration tests for table scan (requires us to setup a table with actual snapshots / data )
• a cache for IcebergCatalogProvider and IcebergSchemaProvider / so data does not become stale
• improve impl ExecutionPlan for IcebergTableScan (once we support filter pushdown, etc.)

[Xuanwo]

https://crates.io/crates/object_store_opendal is available to help integration with object_store.

[github-actions]

This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.

[github-actions]

This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale'