Skip to content

ACE: Harden npartitions Check#2282

Open
julianmi wants to merge 1 commit into
NVIDIA:mainfrom
julianmi:ace-npartitions-check
Open

ACE: Harden npartitions Check#2282
julianmi wants to merge 1 commit into
NVIDIA:mainfrom
julianmi:ace-npartitions-check

Conversation

@julianmi

@julianmi julianmi commented Jul 1, 2026

Copy link
Copy Markdown
Contributor

Improve the npartitions handling such that invalid cases are prevented.

Requested npartitions Behavior
0 Valid auto sentinel. Silently resolves to the existing two-partition starting point, then follows the current small-partition and memory heuristics.
1 Warns and resolves to 2, then follows the same heuristics.
2 … n_rows Accepted. The quality heuristic may reduce an excessively high count to avoid tiny partitions.
> n_rows Rejected before planning with cannot exceed dataset size.
Disk-mode memory adjustment raises count above n_rows Rejected afterward with the “configured memory limit is unsatisfiable” error.

@julianmi julianmi requested review from a team as code owners July 1, 2026 06:53
@copy-pr-bot

copy-pr-bot Bot commented Jul 1, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

- 0 means auto.
- 1 is invalid since at least 2 paritions are required. Increase to 2.
- > nrows is invalid and an error is thrown.
@julianmi julianmi force-pushed the ace-npartitions-check branch from a06d1c8 to 5b72ea8 Compare July 1, 2026 09:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant