Skip to content

ch4/ofi: add mr cache for FI_HMEM_MR#7864

Merged
hzhou merged 3 commits into
pmodels:mainfrom
hzhou:2606_ofi_mr_cache
Jul 23, 2026
Merged

ch4/ofi: add mr cache for FI_HMEM_MR#7864
hzhou merged 3 commits into
pmodels:mainfrom
hzhou:2606_ofi_mr_cache

Conversation

@hzhou

@hzhou hzhou commented Jul 1, 2026

Copy link
Copy Markdown
Collaborator

Pull Request Description

The provider (e.g. EFA) may not cache internally with mr registration.
Without caching, the overhead of mr registration will hurt performance.

Add MPIDI_OFI_mr_cache facility to cache mrs in MPICH. Use a simple
array-based cache for:
1. simplicity
2. cache size limit and LRU eviction
3. stale cache entry detection (optional)

[skip warnings]

Author Checklist

  • Provide Description
    Particularly focus on why, not what. Reference background, issues, test failures, xfail entries, etc.
  • Commits Follow Good Practice
    Commits are self-contained and do not do two things at once.
    Commit message is of the form: module: short description
    Commit message explains what's in the commit.
  • Passes All Tests
    Whitespace checker. Warnings test. Additional tests via comments.
  • Contribution Agreement
    For non-Argonne authors, check contribution agreement.
    If necessary, request an explicit comment from your companies PR approval manager.

@hzhou

hzhou commented Jul 1, 2026

Copy link
Copy Markdown
Collaborator Author

test:mpich/ch4/ofi

@hzhou
hzhou force-pushed the 2606_ofi_mr_cache branch from e03e828 to bddff57 Compare July 22, 2026 21:23
@hzhou

hzhou commented Jul 22, 2026

Copy link
Copy Markdown
Collaborator Author

test:mpich/ch4/ofi
test:mpich/ch4/ofi/more

✔️

nmnobre and others added 3 commits July 22, 2026 18:54
Expose buffer id so MPICH layer can use buffer id to manage caches.
Add function to retrieve buffer id.
The provider (e.g. EFA) may not cache internally with mr registration.
Without caching, the overhead of mr registration will hurt performance.

Add MPIDI_OFI_mr_cache facility to cache mrs in MPICH. Use a simple
array-based cache for:
    1. simplicity
    2. cache size limit and LRU eviction
    3. stale cache entry detection (optional)
@hzhou
hzhou force-pushed the 2606_ofi_mr_cache branch from bddff57 to dcd3e7b Compare July 22, 2026 23:56
@hzhou
hzhou merged commit 761a2ec into pmodels:main Jul 23, 2026
7 checks passed
@hzhou
hzhou deleted the 2606_ofi_mr_cache branch July 23, 2026 00:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants