Skip to content

Use Python to combine verification output - #16

Closed
yrasool wants to merge 335 commits into
lanl:mainfrom
yrasool:codex/hard-bug-fix
Closed

yrasool wants to merge 335 commits into
lanl:mainfrom
yrasool:codex/hard-bug-fix

Conversation

@yrasool

@yrasool yrasool commented Jul 10, 2026 •

Copy link
Copy Markdown
Contributor

Change

find_last_output used cat to merge rank CSV files. This now uses Python file I/O, with the existing output order unchanged.

Checks

  • python tools/test_verify_output.py
  • ruff check tools
  • Python compile checks
  • codespell on changed files
  • local Sphinx build
  • GitHub documentation CI
  • git diff --check

CMake and C++ unit tests were not run locally because CMake and FleCSI are not installed here.

Closes #15

AndresYague and others added 30 commits April 23, 2025 10:21
Also removed bounds_error=False, it is not needed when given
fill_value="extrapolate".
Added acoustic wave verification

See merge request hard/hard!3
1) Added comments so each step is easier to follow
2) Reduced the verbosity of some variables so the code is easier to read
3) Removed unnecessary variables
Fixed bug in Heun's method

See merge request hard/hard!4
Update CI upstream

See merge request hard/hard!9
Calculate fvm l2 error correctly

See merge request hard/hard!10
Typed exactpack_verify.py, added a verify_lib to avoid repeating
functions. Changed CMakeLists so that the convergence test exists.

Removing scaling configurations

Co-authored-by: Julien Loiseau <jloiseau@lanl.gov>
Convergence test

See merge request hard/hard!6
Factored the Riemann solver, using it for radiation as well

See merge request hard/hard!7
Lowering the acoustic amplitude for better convergence

See merge request hard/hard!13
@yrasool yrasool changed the title Make verify output work on Windows Remove Unix-only cat from verify output Jul 10, 2026
@yrasool yrasool changed the title Remove Unix-only cat from verify output Use Python to combine verification output Jul 10, 2026
@yrasool
yrasool marked this pull request as ready for review July 10, 2026 01:21

@AndresYague AndresYague left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Simple MR that makes the code more portable as it does not require that the system has cat. The code will be slower than running cat but not by a significant enough margin.

It may be useful to provide a buffer length of a few MB to shutil.copyfileobj to handle the 3D case output a bit faster.

@yrasool

yrasool commented Jul 16, 2026 •

Copy link
Copy Markdown
Contributor Author

Simple MR that makes the code more portable as it does not require that the system has cat. The code will be slower than running cat but not by a significant enough margin.

It may be useful to provide a buffer length of a few MB to shutil.copyfileobj to handle the 3D case output a bit faster.

Thanks, I added a 1 MiB buffer. In a local 128 MiB 3D-shaped merge, it was 1.34x faster than a 64 KiB buffer. The output test and docs check pass.

@AndresYague

Copy link
Copy Markdown
Contributor

Thanks, I added a 1 MiB buffer. In a local 128 MiB 3D-shaped merge, it was 1.34x faster than a 64 KiB buffer. The output test and docs check pass.

This all looks good to me!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Use Python to combine verification output

10 participants