You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
perf: each reference to a path table walks the tree again, and one walk is ~4x find at 400k files #1201
use_case_dossier_test.py (#1200) is red at 17x find on a 400k-file tree. Two separate costs, measured on that tree (launcher included, warm page cache):
SELECT count(*) FROM './planner/internal/notes/*/*.md'
3.27 s
SELECT count(*) FROM (SELECT path FROM './' UNION ALL SELECT path FROM './' UNION ALL SELECT path FROM './')
10.53 s
Every reference to a path table walks the tree again. Three CTEs over ./ cost three walks. One walk per distinct path table per statement would take the article's dossier query from 11 s to under 4 s on this tree.
Bar from #1198: dirsql wall minus launcher startup <= 1.1x native. The test sizes its corpus until native takes a second, so it holds the same ratio on any machine.
Done when
packages/python/tests/e2e/use_case_dossier_test.py passes with its pytest.mark.xfail(strict=True) marker removed in the same PR: identical rows, and dirsql wall time minus launcher startup within 1.1x the native pipeline. Part of epic #1205.
Activity