Skip to content

ref(dynamic-sampling): Run and serve the per-org pipeline by default - #124018

Merged
shellmayr merged 4 commits into
masterfrom
shellmayr/ref/ds-per-org-default
Sep 10, 2026
Merged

ref(dynamic-sampling): Run and serve the per-org pipeline by default#124018
shellmayr merged 4 commits into
masterfrom
shellmayr/ref/ds-per-org-default

Conversation

@shellmayr

@shellmayr shellmayr commented Sep 10, 2026

Copy link
Copy Markdown
Member
  • The per-org pipeline only ran, and rules only read its caches, for organizations selected by dynamic-sampling.per_org.rollout-rate and dynamic-sampling.per_org.serving-rollout-rate. Both defaulted to 0.0, so an install without the options automator, such as self-hosted, never ran it and served every project at the fallback rate.
  • Default both rates to 1.0, which is what SaaS already sets, so the EAP-based pipeline works out of the box.

Contributes to TET-2900

The per-org dynamic sampling pipeline only ran, and rules only read its caches, for
organizations selected by dynamic-sampling.per_org.rollout-rate and
dynamic-sampling.per_org.serving-rollout-rate. Both default to 0.0, so an install
without the options automator, such as self-hosted, never ran it and served every
project at the fallback rate.

Default both rates to 1.0, which is what SaaS already sets, so the EAP-based pipeline
works out of the box. Tests that relied on a missing per-org rate falling back to the
blended rate now store the rate the per-org pass would have written; the legacy
pipeline tests pin the serving rate to 0.0 until they are deleted.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
@linear-code

linear-code Bot commented Sep 10, 2026

Copy link
Copy Markdown

TET-2900

@github-actions github-actions Bot added the Scope: Backend Automatically applied to PRs that change backend components label Sep 10, 2026
shellmayr and others added 2 commits September 10, 2026 14:10
…inning them

The legacy jobs are killswitched and deleted in a separate PR. Deleting their tests here
as well keeps this PR green on its own without pinning the serving rate, and the two
identical deletions merge cleanly in either order.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
…rg pipeline off

Restore the legacy pipeline tests. They run the legacy pipeline end to end, so they
switch the per-org pipeline off through its rollout options instead of relying on the
former defaults.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
@shellmayr
shellmayr marked this pull request as ready for review September 10, 2026 12:17
@shellmayr
shellmayr requested review from a team as code owners September 10, 2026 12:17
@shellmayr
shellmayr merged commit e3fb5fc into master Sep 10, 2026
87 of 88 checks passed
@shellmayr
shellmayr deleted the shellmayr/ref/ds-per-org-default branch September 10, 2026 12:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Scope: Backend Automatically applied to PRs that change backend components

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants