Currently
ds = lance.dataset("s3://test/xxxxx.lance", storage_options=storage_options) ds.cleanup_old_versions( older_than=timedelta(seconds=10), delete_unverified=True, error_if_tagged_old_versions=False )
Could take a long time when thousand billions without any log print. Raise an issue to track any distributed clean way.
Currently
ds = lance.dataset("s3://test/xxxxx.lance", storage_options=storage_options) ds.cleanup_old_versions( older_than=timedelta(seconds=10), delete_unverified=True, error_if_tagged_old_versions=False )Could take a long time when thousand billions without any log print. Raise an issue to track any distributed clean way.