feat(berlinmod): streaming throughput benchmark on the canonical BerlinMOD corpus (stacks on #14) - #15
Merged
Ar-mie merged 2 commits intoJun 19, 2026
Conversation
This was referenced Jun 11, 2026
Closed
Closed
estebanzimanyi
force-pushed
the
consolidate/kafka-meos-integration
branch
from
June 11, 2026 17:57
c6f2016 to
6305403
Compare
estebanzimanyi
force-pushed
the
consolidate/kafka-benchmark
branch
3 times, most recently
from
June 14, 2026 21:10
dd55558 to
dd85dab
Compare
estebanzimanyi
force-pushed
the
consolidate/kafka-benchmark
branch
from
June 19, 2026 10:40
f47609b to
9a5b2e9
Compare
…MEOS 1.4 Route the BerlinMOD-9 × 3-form processors through MEOS (libmeos via the JMEOS 1.4 bridge) — edwithin_tgeo_geo, eintersects_tgeo_geo, geog_distance and the set-set join family — and add the MEOS DSL-tier wirings, the per-family facade smoke tests and the canonical BerlinMOD corpus loader. JMEOS and the native libmeos.so are built from source rather than committed to the repository. build-jmeos.sh clones MobilityDB and JMEOS at the deliverable PRs' immutable head commit SHAs, builds libmeos.so, builds the jar and installs it into the local Maven repository, so the pom resolves JMEOS as an ordinary dependency. It pins MobilityDB #1148 (set-set join, stacked on #1162 clean/geo) and JMEOS MobilityDB#25 (facade) as overridable env vars; both are switched to upstream master/main after those PRs are integrated.
estebanzimanyi
force-pushed
the
consolidate/kafka-benchmark
branch
from
June 19, 2026 11:42
9a5b2e9 to
be69ac8
Compare
Ar-mie
requested changes
Jun 19, 2026
Collaborator
There was a problem hiding this comment.
This file references jar/JMEOS.jar directly but should either use ~/.m2 or reconstruct the classpath via mvn
Member
Author
There was a problem hiding this comment.
Fixed. docs/benchmark.md no longer references jar/JMEOS.jar by path. The run command reconstructs the classpath via mvn dependency:build-classpath — which now resolves JMEOS from the local Maven repo (~/.m2/.../com/mobilitydb/jmeos/1.4.0/jmeos-1.4.0.jar, installed by build-jmeos.sh) — so the -cp is just target/classes:target/test-classes:$CP, and LD_LIBRARY_PATH=lib points at the libmeos.so the script stages. Verified the documented command loads JMEOS and starts the benchmark (no committed jar).
…inMOD corpus Adds the BerlinMOD streaming benchmark harness: BerlinMODBenchmark (TopologyTestDriver throughput per Q-form cell) and EmbeddedBrokerBenchmark (steady-state throughput against an in-process EmbeddedKafkaCluster), plus docs/benchmark.md. Both drivers run on the canonical BerlinMOD corpus only (--csv berlinmod_instants.csv); the invented synthetic fallback is gone. Both live in src/test since they use the test-scoped TopologyTestDriver / EmbeddedKafkaCluster.
estebanzimanyi
force-pushed
the
consolidate/kafka-benchmark
branch
from
June 19, 2026 12:12
be69ac8 to
5ac21a6
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Path-B consolidation — PR 3 of 3 (scaffold #1 · MEOS integration #14 · benchmark).
Adds the BerlinMOD streaming benchmark harness on top of #14:
BerlinMODBenchmark(per-cell TopologyTestDriver throughput) andEmbeddedBrokerBenchmark(steady-state throughput against an in-processEmbeddedKafkaCluster), plusdocs/benchmark.md.Canonical / regularity
--csv berlinmod_instants.csv); the invented synthetic fallback is removed.src/test(they use the test-scopedTopologyTestDriver/EmbeddedKafkaCluster) — same placement fix as the scaffold's test.Dependency
Inherits #14's
build-jmeos.sh— JMEOS andlibmeos.soare built from source (no committed binaries) and pinned to the deliverable PRs (MobilityDB #1148 on #1162; JMEOS #25), not an ecosystem-pin tag. The former "rebuild the bundled jar/libmeos" pin-bump commits are gone.Verification
./build-jmeos.shthenmvn test→ 11 tests, 0 failures; the benchmark drivers aremainentry points (compiled, not run in CI).