Skip to content

allocator: add CCO-backed LSA symmetric windows - #618

Draft
yangyuhuiling wants to merge 1 commit into
mainfrom
xiangch/symm_buffer
Draft

allocator: add CCO-backed LSA symmetric windows#618
yangyuhuiling wants to merge 1 commit into
mainfrom
xiangch/symm_buffer

Conversation

@yangyuhuiling

Copy link
Copy Markdown
Contributor

Summary

  • preserve PyTorch's pointer-array contract while deriving peer pointers from a CCO LSA window
  • add LSA-only communicator setup, rank-local window identity, topology introspection, and GC-safe resource lifetimes
  • expose an owning Python LSA handle with divergent-slot, subgroup, teardown, and FlyDSL example coverage

Test plan

  • BUILD_TORCH_SYMM=ON python setup.py build_ext --inplace
  • pytest -v tests/python/allocator (4 passed)
  • CCO host test (8 ranks) and divergent-slot regression (2 ranks)
  • torch-to-CCO import and FlyDSL LSA all-to-all examples (2 ranks)
  • pre-commit checks on all changed files

Made with Cursor

Preserve torch's pointer-array contract while making CCO the source of truth for LSA addressing and independent window lifetimes.

Co-authored-by: Cursor <cursoragent@cursor.com>
@yangyuhuiling
yangyuhuiling marked this pull request as draft August 28, 2026 08:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant