chore(mobula-state): remove redundant overrides from includes.json - #5305
Open
FionnL wants to merge 1 commit into
Open
chore(mobula-state): remove redundant overrides from includes.json#5305FionnL wants to merge 1 commit into
FionnL wants to merge 1 commit into
Conversation
🦋 Changeset detectedLatest commit: 5d35b88 The changes in this PR will be included in the next version bump. This PR includes changesets to release 1 package
Not sure what this means? Click here to learn what changesets are. Click here if you're a maintainer who wants to add another changeset to this PR |
FionnL
force-pushed
the
chore/mobula-state-remove-redundant-overrides
branch
2 times, most recently
from
August 20, 2026 22:09
2fd1200 to
3b7b912
Compare
…feeds Remove 244 of 250 includes.json entries, keeping only the 6 entries that are actively depended on by live feeds/streams with mobula-state as a provider but no jobspec override. The EA transform pipeline runs jobspec overrides first (symbolOverrider), which replaces base before the includes.json lookup runs. This means includes.json entries are only used as fallbacks when no jobspec override exists. Of 118 live feeds/streams with mobula-state: - 113 have a jobspec override (includes.json never reached) - 5 have no override and depend on includes.json fallback The 6 kept entries (4 unique symbols, 2 quote pairs for WBTC): AI16Z/USD -> 102499018 (streams, Arbitrum) BTC.B/USD -> 101650461 (feeds, MEGAETH + ROBINHOOD) USDE/USD -> 137 (feeds, APTOS) USDT0/USD -> 102502522 (streams, Arbitrum) WBTC/ETH -> 100001656 (feeds, POLYGON) WBTC/USD -> 100001656 (feeds, POLYGON) Removed entries fall into three categories: - 112 redundant: same (symbol, mobula_id) already in RDD jobspec overrides - 6 incorrect/dead: wrong mobula ID (DAI, USDM) or dead feeds (AGEUR, PUSD, USD+, XUSD) - 126 no live feeds: symbols with no live feeds/streams using mobula-state, or no live feeds at all Verified against BigQuery v_dim_market_rate_live_feeds (live feed status + jobspec overrides), BigQuery mobula_v2_metadata (ID verification), and RDD reference-data-directory (1,273 files, feed status + overrides).
FionnL
force-pushed
the
chore/mobula-state-remove-redundant-overrides
branch
from
August 20, 2026 22:12
3b7b912 to
5d35b88
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Trim includes.json from 250 entries down to 6 — keeping only the entries that are actively depended on by live feeds/streams with mobula-state as a provider but no jobspec override.
Why this is safe
The EA transform pipeline runs in this order:
symbolOverrider) — replacesbaseif an override exists in the requestbase/quoteif the original symbol matchesSince the jobspec override runs first, it replaces the symbol before the includes.json lookup even runs. The includes.json lookup is keyed by the original symbol name, so once the override changes
baseto a mobula ID, no includes.json entry matches. This means includes.json entries are only used as fallbacks when no jobspec override exists.Of 118 live feeds/streams with mobula-state as a provider:
The 6 kept entries
AI16Z/USD102499018BTC.B/USD101650461USDE/USD137USDT0/USD102502522WBTC/ETH100001656WBTC/USD100001656What was removed (244 entries)
(symbol, mobula_id)already in RDD — includes.json never reached at runtime102502229= bridged DAI, RDD correctly uses100003253= native Dai) and USDM (6038= Mountain Protocol USD, RDD correctly uses63902= MegaUSD)status=deadin RDDVerification methodology
Cross-referenced four data sources:
v_dim_market_rate_live_feeds— all live feeds/streams with mobula-state, includingexternal_adapter_request_paramsfor jobspec override statusmobula_v2_metadata— ID → asset name/symbol verificationreference-data-directory— 1,273 files containing mobula-state overrides, plus feed status verification