test: use inference-testing fakes and add e2e retry, base64, live suites - #11
Merged
TheGreatAxios merged 2 commits intoSep 27, 2026
Conversation
TheGreatAxios
commented
Sep 25, 2026
TheGreatAxios
left a comment
TheGreatAxios
left a comment
Contributor
Author
There was a problem hiding this comment.
Review
Independent review of the stack found: bad base64 replies escaped as a raw DOMException or silently truncated vectors; non-integer indices were accepted; duplicate-index and non-JSON-200 coverage was lost; the live suite failed instead of skipping when the model was absent. All fixed in this stack (strict base64 decode, number.integer index, restored harness tests, model-aware skip).
Remaining notes: peer range >=0.4.0 follows sibling convention. Each commit typechecks, tests, and builds standalone.
TheGreatAxios
force-pushed
the
cl-9107-embedding-replace-hand-rolled-fetchscheduler-fakes-with
branch
2 times, most recently
from
September 25, 2026 13:58
1d88a30 to
968e955
Compare
TheGreatAxios
force-pushed
the
cl-9107-embedding-replace-hand-rolled-fetchscheduler-fakes-with
branch
2 times, most recently
from
September 25, 2026 15:14
cb7e9ae to
bc30dc3
Compare
TheGreatAxios
force-pushed
the
cl-9107-embedding-replace-hand-rolled-fetchscheduler-fakes-with
branch
from
September 25, 2026 17:05
bc30dc3 to
7f8a442
Compare
TheGreatAxios
force-pushed
the
cl-9107-embedding-replace-hand-rolled-fetchscheduler-fakes-with
branch
3 times, most recently
from
September 25, 2026 23:49
8e6bb1f to
aae2e94
Compare
TheGreatAxios
changed the title
Units shrink to index placement, short reply, and base64 decode, driven by @intx/inference-testing instead of hand-rolled fetch/scheduler fakes. tests/ adds a 429-then-200 retry on the harness clock and a 401 that does not retry, plus a base64-vs-float check over a real HTTP stub. live/ adds a /v1/embeddings round trip, run by bun run test:live, that skips unless EMBEDDING_E2E_BASE_URL is set. Also closes CL-9132, CL-9114, CL-9116, CL-9137.
TheGreatAxios
force-pushed
the
cl-9107-embedding-replace-hand-rolled-fetchscheduler-fakes-with
branch
from
September 26, 2026 01:29
aae2e94 to
1787a0a
Compare
TheGreatAxios
changed the title
TheGreatAxios
added this pull request to stack #15
September 26, 2026 01:58
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
src/embed.test.tsusesetupHarnessfrom@intx/inference-testing; hand-rolled fakes andextractRetryAfterMsunits are deleted.tests/retry.test.ts: 429 retried afterRetry-After(seconds, past and future HTTP-date, custom extractor) on the harness clock; 401 rejects withEmbeddingRequestError(credential_failure) without retry; timeout.tests/base64.test.ts:base64andfloatagree within float32 tolerance over a real HTTP stub.live/embeddings.test.ts(bun run test:live, not intestor CI): 3 texts against a real/v1/embeddings; asserts count, width equalsprobeEmbedDims, and order; skips unlessEMBEDDING_E2E_BASE_URLis set and the server lists the model.bun run test(src+tests).Verification
bun run test(16 pass); CI passes.bun run test:livepasses against http://100.113.184.123:11434/v1 (nomic-embed-text).Closes CL-9107
Closes CL-9132
Closes CL-9114
Closes CL-9116
Closes CL-9137