Summary
Hi team, lance is well-known for its dataset management, including lineage for dataset.
So I'm wondering if we could to display dataset lineage in the viewer as well?
For example, when users provide a dataset, the whole lineage of the dataset is shown on the screen (with tag / branching / version aside), so users could click in the a detailed "version" and check the schema, metadata, or data for the selected version.
Use case
In production usage, we use a base lance dataset as the foundation, and branch out different versions for experimentation; having a lineage display helps our user to understand the dataset better.
Proposed approach
No response
Design constraint check
Summary
Hi team, lance is well-known for its dataset management, including lineage for dataset.
So I'm wondering if we could to display dataset lineage in the viewer as well?
For example, when users provide a dataset, the whole lineage of the dataset is shown on the screen (with tag / branching / version aside), so users could click in the a detailed "version" and check the schema, metadata, or data for the selected version.
Use case
In production usage, we use a base lance dataset as the foundation, and branch out different versions for experimentation; having a lineage display helps our user to understand the dataset better.
Proposed approach
No response
Design constraint check