Skip to content

Split the Flink app into a binding module and a benchmark module - #48

Merged
estebanzimanyi merged 1 commit into
MobilityDB:mainfrom
estebanzimanyi:split/flink-binding-benchmark-modules
Jul 23, 2026
Merged

Split the Flink app into a binding module and a benchmark module#48
estebanzimanyi merged 1 commit into
MobilityDB:mainfrom
estebanzimanyi:split/flink-binding-benchmark-modules

Conversation

@estebanzimanyi

Copy link
Copy Markdown
Member

The flink-processor module packs the generated MEOS binding surface and four streaming benchmark/demo apps (berlinmod, aisdata, sncbdata, sedona) into one module, so a binding build or test pulls all of them in. This splits it into a Maven reactor:

  • binding/ — the org.mobilitydb.meos.MeosOps* facades generated from the JMEOS catalog + the generic Flink DataStream wiring layer + the surface smoke tests. A pure projection of the MEOS surface; no application code. Its dependencies are only what the wirings and smokes import (flink-streaming/core/clients, jnr, jmeos).
  • benchmark/ — the berlinmod/aisdata/sncbdata/sedona apps + their tests and run scripts, depending on the binding module. It keeps the table API, kafka connector, jts, jackson, log4j, postgresql and the sedona profile, and the flink-kafka2postgres jar name the run scripts and Dockerfiles launch.

The parent pom drives both modules and shares the compiler/surefire config, including LD_LIBRARY_PATH for libmeos from meos.lib.dir. The CI workflow and .gitignore follow the new layout.

The binding module builds and tests on its own, without the benchmarks — the same pure-binding shape MobilitySpark already has. Files move only; the Java is unchanged.

The flink-processor module packed the generated MEOS binding surface and
four streaming benchmark/demo apps (berlinmod, aisdata, sncbdata, sedona)
into one module, so a binding build/test pulled all of them in. Split it
into a Maven reactor:

  binding/   - the org.mobilitydb.meos.MeosOps* facades generated from the
               JMEOS catalog + the generic Flink DataStream wiring layer +
               the surface smoke tests. A pure projection; no application
               code. Its dependencies are only what the wirings and smokes
               import (flink-streaming/core/clients, jnr, jmeos).
  benchmark/ - the berlinmod/aisdata/sncbdata/sedona apps + their tests and
               run scripts, depending on the binding module. It keeps the
               table API, kafka connector, jts, jackson, log4j, postgresql
               and the sedona profile, and the flink-kafka2postgres jar name.

The parent pom drives both modules and shares the compiler/surefire config
(including LD_LIBRARY_PATH for libmeos from meos.lib.dir). The CI workflow
and .gitignore follow the new layout. The binding module now builds and
tests on its own, without the benchmarks.
@estebanzimanyi
estebanzimanyi merged commit 6539de9 into MobilityDB:main Jul 23, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant