Skip to content

Agent Spec Evaluation Computer improvements - #240

Merged
dhilloulinoracle merged 4 commits into
mainfrom
evaluation-improvements
Oct 26, 2026
Merged

dhilloulinoracle merged 4 commits into
mainfrom
evaluation-improvements

Conversation

@soufianeamini

Copy link
Copy Markdown
Member
  • Use CapacityLimiter over Semaphore
  • Limit the amount of concurrent tasks that are running at once (the number of tasks spawned would be at most max_concurrency + 1)
  • Producer/worker pattern is not needed anymore as a result

@soufianeamini
soufianeamini requested review from a team and cesarebernardis August 27, 2026 09:07
@oracle-contributor-agreement oracle-contributor-agreement Bot added the OCA Verified All contributors have signed the Oracle Contributor Agreement. label Aug 27, 2026
@soufianeamini
soufianeamini force-pushed the evaluation-improvements branch from 209cbea to 2d5899a Compare September 13, 2026 20:51
@soufianeamini
soufianeamini force-pushed the evaluation-improvements branch from a013a43 to 93e481b Compare October 26, 2026 10:59
@dhilloulinoracle

Copy link
Copy Markdown
Contributor

Internal regression succeeded 🍏: Build ID #587

@dhilloulinoracle

Copy link
Copy Markdown
Contributor

Merge Gate INPROGRESS

@dhilloulinoracle

Copy link
Copy Markdown
Contributor

Internal regression succeeded 🍏: Build ID #528

@dhilloulinoracle
dhilloulinoracle merged commit e4fa33f into main Oct 26, 2026
7 of 8 checks passed
@dhilloulinoracle

Copy link
Copy Markdown
Contributor

Merge Gate succeeded 🍏: Build ID #756

@soufianeamini
soufianeamini deleted the evaluation-improvements branch October 26, 2026 14:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

OCA Verified All contributors have signed the Oracle Contributor Agreement.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants