Measured 2026-10-28: 425 example models of the Modelica Standard Library 3.2.3, each run through OM.jl's pipeline (flatten, translate, simulate) and validated against the reference trajectories. No-skip run on GitHub Actions (ubuntu-latest, Julia 1.13), 2 shards of 1 workers, 600 s per model.
Commits: OM.jl d63ba7e, Absyn.jl 690c071, ArrayUtil.jl 45ec370, DAE.jl 29da583, DoubleEnded.jl 3955cc5, ImmutableList.jl 132055a, ListUtil.jl 3d2d0c3, MetaModelica.jl 3814d38, OMBackend.jl 16749a5, OMFrontend.jl 5e0634d, OMLibraryTesting.jl 2f0398a, OMParser.jl ea4149f, OMRuntimeExternalC.jl 1983a3d, SCode.jl 86e7838.
Generated by scripts/publish_coverage.jl from the run's results; do not edit by hand.
| Phase reached | Models | Share |
|---|---|---|
| frontend | 422 | 99.3 % |
| backend | 422 | 99.3 % |
| simulate | 404 | 95.1 % |
| validate | 372 | 87.5 % |
| total | 425 |
| Domain | Models | Validate | Simulate only | Backend only | Frontend only | None |
|---|---|---|---|---|---|---|
| Blocks | 25 | 23 | 1 | 0 | 0 | 1 |
| ComplexBlocks | 2 | 2 | 0 | 0 | 0 | 0 |
| Electrical.Analog | 41 | 36 | 4 | 1 | 0 | 0 |
| Electrical.Digital | 23 | 12 | 10 | 1 | 0 | 0 |
| Electrical.Machines | 38 | 36 | 2 | 0 | 0 | 0 |
| Electrical.MultiPhase | 4 | 4 | 0 | 0 | 0 | 0 |
| Electrical.PowerConverters | 42 | 41 | 1 | 0 | 0 | 0 |
| Electrical.QuasiStationary | 10 | 10 | 0 | 0 | 0 | 0 |
| Electrical.Spice3 | 14 | 10 | 0 | 3 | 0 | 1 |
| Fluid | 23 | 16 | 1 | 6 | 0 | 0 |
| Magnetic.FluxTubes | 11 | 6 | 4 | 1 | 0 | 0 |
| Magnetic.FundamentalWave | 26 | 24 | 2 | 0 | 0 | 0 |
| Magnetic.QuasiStatic | 23 | 22 | 1 | 0 | 0 | 0 |
| Math.FastFourierTransform | 2 | 2 | 0 | 0 | 0 | 0 |
| Math.Nonlinear | 1 | 1 | 0 | 0 | 0 | 0 |
| Math.Random | 1 | 1 | 0 | 0 | 0 | 0 |
| Mechanics.MultiBody | 42 | 39 | 2 | 1 | 0 | 0 |
| Mechanics.Rotational | 16 | 13 | 3 | 0 | 0 | 0 |
| Mechanics.Translational | 14 | 13 | 1 | 0 | 0 | 0 |
| Media | 40 | 40 | 0 | 0 | 0 | 0 |
| Media.Incompressible | 1 | 1 | 0 | 0 | 0 | 0 |
| StateGraph | 7 | 7 | 0 | 0 | 0 | 0 |
| Thermal.FluidHeatFlow | 12 | 8 | 0 | 4 | 0 | 0 |
| Thermal.HeatTransfer | 4 | 4 | 0 | 0 | 0 | 0 |
| Utilities | 3 | 1 | 0 | 1 | 0 | 1 |
Grouped by the last phase a model reached and its first error (names and numbers blanked).
| Stops after | Models | First error | Examples |
|---|---|---|---|
| simulate | 8 | Blocks.Examples.Rectifier12pulseFFT, Magnetic.FluxTubes.Examples.Hysteresis.HysteresisModelComparison | |
| backend | 6 | Simulation retcode: Unstable | Electrical.Spice3.Examples.Nand, Fluid.Examples.BranchingDynamicPipes |
| backend | 3 | InterruptException: | Electrical.Spice3.Examples.Nor, Fluid.Examples.AST_BatchPlant.BatchPlant_StandardWater |
| backend | 2 | ModelicaInternal_readLine failed: Not possible to open file "…" for reading: | Electrical.Digital.Examples.RAM, Utilities.Examples.readRealParameterModel |
| backend | 2 | Simulation retcode: InitialFailure | Electrical.Analog.Examples.SimpleTriacCircuit, Electrical.Spice3.Examples.Spice3BenchmarkDifferentialPair |
| simulate | 2 | Validation failed for signals: aimc.stator.zeroInductor.iN | Magnetic.FundamentalWave.Examples.BasicMachines.AIMC_Initialize, Magnetic.FundamentalWave.Examples.BasicMachines.AIMC_withLosses |
| simulate | 2 | Validation failed for signals: opAmp.out.v, opAmp.out.i | Electrical.Analog.Examples.OpAmps.InvertingSchmittTrigger, Electrical.Analog.Examples.OpAmps.SchmittTrigger |
| backend | 1 | IFN medium function gN: the temperature (= -N K) is lower than N K! | Fluid.Examples.HeatExchanger.HeatExchangerSimulation |
| backend | 1 | ModelicaAssertionError: assertion violated at time N: Reversing flow occurs even though al | Fluid.Examples.HeatingSystem |
| backend | 1 | Simulation retcode: Failure | Fluid.Examples.ControlledTankSystem.ControlledTanks |
| backend | 1 | Simulation retcode: MaxIters | Magnetic.FluxTubes.Examples.Hysteresis.ThreePhaseTransformerWithRectifier |
| backend | 1 | UnsupportedLowering: symbolic initialization initial-equation rows not finite at the entry | Mechanics.MultiBody.Examples.Loops.PlanarLoops_analytic |
| none | 1 | Memory N GB after Ns (limit: N GB) [worker killed] | Blocks.Examples.Rectifier6pulseFFT |
| none | 1 | ModelicaIO_readMatrixSizes failed: Not possible to open file "…": No such file or director | Utilities.Examples.ReadRealMatrixFromFile |
| none | 1 | Timeout after Ns (limit: Ns) [worker killed] | Electrical.Spice3.Examples.Spice3BenchmarkFourBitBinaryAdder |
| simulate | 1 | Reference CSV not found: /home/runner/work/OMLibraryTesting.jl/OMLibraryTesting.jl/OM.jl/O | Electrical.Machines.Examples.ControlledDCDrives.SpeedControlledDCPM |
| simulate | 1 | Validation failed for signals: Adder.AND.GN.y, Adder.XOR.GN.y | Electrical.Digital.Examples.HalfAdder |
| simulate | 1 | Validation failed for signals: CN.v, CN.v, L.i | Electrical.Analog.Examples.ChuaCircuit |
| simulate | 1 | Validation failed for signals: aimc.idq_rr[N], aimc.idq_sr[N] | Electrical.Machines.Examples.AsynchronousInductionMachines.AIMC_InverterDrive |
| simulate | 1 | Validation failed for signals: bUFNS.y | Electrical.Digital.Examples.BUF3S |
| simulate | 1 | Validation failed for signals: bearingFriction.mode, bearingFriction.startForward, gear.mo | Mechanics.Rotational.Examples.LossyGearDemo2 |
| simulate | 1 | Validation failed for signals: bodyOfConstraint.v_N[N], bodyOfConstraint.v_N[N], bodyOfCon | Mechanics.MultiBody.Examples.Constraints.PrismaticConstraint |
| simulate | 1 | Validation failed for signals: brake.startForward | Mechanics.Rotational.Examples.HeatLosses |
| simulate | 1 | Validation failed for signals: dFFREG.delay.inertialDelaySensitive[N].x, dFFREG.delay.iner | Electrical.Digital.Examples.DFFREG |
| simulate | 1 | Validation failed for signals: dFFREGL.delay.inertialDelaySensitive[N].x, dFFREGL.delay.in | Electrical.Digital.Examples.DFFREGL |
| simulate | 1 | Validation failed for signals: dFFREGSRH.dataOut[N], dFFREGSRH.dataOut[N] | Electrical.Digital.Examples.DFFREGSRH |
| simulate | 1 | Validation failed for signals: dFFREGSRL.dataOut[N], dFFREGSRL.dataOut[N] | Electrical.Digital.Examples.DFFREGSRL |
| simulate | 1 | Validation failed for signals: filter[N].x[N], filter[N].x[N], harmonic.meanN.x, harmonic. | Electrical.PowerConverters.Examples.DCAC.MultiPhaseTwoLevel.ThreePhaseTwoLevel_PWM |
| simulate | 1 | Validation failed for signals: iNVNS.y | Electrical.Digital.Examples.INV3S |
| simulate | 1 | Validation failed for signals: nRXFERGATE.y | Electrical.Digital.Examples.NRXFER |
| simulate | 1 | Validation failed for signals: nXFERGATE.y | Electrical.Digital.Examples.NXFER |
| simulate | 1 | Validation failed for signals: opAmp.out.i | Electrical.Analog.Examples.OpAmps.Multivibrator |
| simulate | 1 | Validation failed for signals: referenceSystem.pointMassN.w_a[N], referenceSystem.pointMas | Mechanics.MultiBody.Examples.Elementary.PointGravityWithPointMasses2 |
| simulate | 1 | Validation failed for signals: suddenExpansionN.m_flow | Fluid.Examples.Explanatory.MomentumBalanceFittings |
| simulate | 1 | Validation failed for signals: wiredX.y | Electrical.Digital.Examples.WiredX |
- Blocks.Examples.Rectifier12pulseFFT:
- Electrical.Analog.Examples.ChuaCircuit: Validation failed for signals: C1.v, C2.v, L.i
- Electrical.Analog.Examples.OpAmps.InvertingSchmittTrigger: Validation failed for signals: opAmp.out.v, opAmp.out.i
- Electrical.Analog.Examples.OpAmps.Multivibrator: Validation failed for signals: opAmp.out.i
- Electrical.Analog.Examples.OpAmps.SchmittTrigger: Validation failed for signals: opAmp.out.v, opAmp.out.i
- Electrical.Digital.Examples.BUF3S: Validation failed for signals: bUF3S.y
- Electrical.Digital.Examples.DFFREG: Validation failed for signals: dFFREG.delay.inertialDelaySensitive[1].x, dFFREG.delay.inertialDelaySensitive[1
- Electrical.Digital.Examples.DFFREGL: Validation failed for signals: dFFREGL.delay.inertialDelaySensitive[1].x, dFFREGL.delay.inertialDelaySensitive
- Electrical.Digital.Examples.DFFREGSRH: Validation failed for signals: dFFREGSRH.dataOut[1], dFFREGSRH.dataOut[2]
- Electrical.Digital.Examples.DFFREGSRL: Validation failed for signals: dFFREGSRL.dataOut[1], dFFREGSRL.dataOut[2]
- Electrical.Digital.Examples.HalfAdder: Validation failed for signals: Adder.AND.G2.y, Adder.XOR.G2.y
- Electrical.Digital.Examples.INV3S: Validation failed for signals: iNV3S.y
- Electrical.Digital.Examples.NRXFER: Validation failed for signals: nRXFERGATE.y
- Electrical.Digital.Examples.NXFER: Validation failed for signals: nXFERGATE.y
- Electrical.Digital.Examples.WiredX: Validation failed for signals: wiredX.y
- Electrical.Machines.Examples.AsynchronousInductionMachines.AIMC_InverterDrive: Validation failed for signals: aimc.idq_rr[2], aimc.idq_sr[2]
- Electrical.Machines.Examples.ControlledDCDrives.SpeedControlledDCPM: Reference CSV not found: /home/runner/work/OMLibraryTesting.jl/OMLibraryTesting.jl/OM.jl/OMLibraryTesting.jl/l
- Electrical.PowerConverters.Examples.DCAC.MultiPhaseTwoLevel.ThreePhaseTwoLevel_PWM: Validation failed for signals: filter[2].x[1], filter[2].x[2], harmonic.mean1.x, harmonic.mean2.x
- Fluid.Examples.Explanatory.MomentumBalanceFittings: Validation failed for signals: suddenExpansion1.m_flow
- Magnetic.FluxTubes.Examples.Hysteresis.HysteresisModelComparison:
- Magnetic.FluxTubes.Examples.Hysteresis.InductorWithHysteresis:
- Magnetic.FluxTubes.Examples.Hysteresis.SinglePhaseTransformerWithHysteresis1:
- Magnetic.FluxTubes.Examples.Hysteresis.SinglePhaseTransformerWithHysteresis2:
- Magnetic.FundamentalWave.Examples.BasicMachines.AIMC_Initialize: Validation failed for signals: aimc.stator.zeroInductor.i0
- Magnetic.FundamentalWave.Examples.BasicMachines.AIMC_withLosses: Validation failed for signals: aimc.stator.zeroInductor.i0
- Magnetic.QuasiStatic.FluxTubes.Examples.Leakage.GeneralLeakage:
- Mechanics.MultiBody.Examples.Constraints.PrismaticConstraint: Validation failed for signals: bodyOfConstraint.v_0[1], bodyOfConstraint.v_0[2], bodyOfConstraint.v_0[3], cons
- Mechanics.MultiBody.Examples.Elementary.PointGravityWithPointMasses2: Validation failed for signals: referenceSystem.pointMass1.w_a[1], referenceSystem.pointMass1.w_a[3], reference
- Mechanics.Rotational.Examples.EddyCurrentBrake:
- Mechanics.Rotational.Examples.HeatLosses: Validation failed for signals: brake.startForward
- Mechanics.Rotational.Examples.LossyGearDemo2: Validation failed for signals: bearingFriction.mode, bearingFriction.startForward, gear.mode
- Mechanics.Translational.Examples.EddyCurrentBrake: