dspsr broken in spack

[joerivanleeuwen]

Lately dspsr is behaving strange on ARTS.
There has also been on OS upgrade, perhaps there is some problem again a renewed library, etc.
Perhaps a recompile and/or package update would help as a start?

cd ~leeuwen/tmp/spack
source /usr/local/spack/share/spack/setup-env.sh ; spack env activate -p arts
dspsr -v -L 10 -T 30 -O ./B0950+08_test -e ar -E ./0950+08.par  /tank/users/wang/B0950+08/stokes/SAP1/BEAM21/L569329_SAP1_BEAM21_2bit.fits
# gives no output file whatsoever, the dspsr install on snellius does produce one
dspsr -v -L 1 -O ./J1906_test -e ar -E ./J1906_new.par  PSRJ1906+0746_swiftcalibration-M01_0821.fits
# gives an error from what I think is reading the headers in correctly, "Error::InvalidState, Error::message: ndat_per_weight=0"
# A cfitsio problem perhaps? 

[loostrum]

I can confirm something's broken. The first time I ran dspsr on arts041, it did seem to process the entire file and it took a few minutes, but no output file was generated. On each subsequent run I see some output (processing xx seconds) but it disappears very quickly and again no output is generated.

I'm rebuilding the spack env to see if that helps.

[loostrum]

Recompiling did not help. When installing the latest version of psrchive+dspsr, things do look a bit better.
The J1906 example now works and produces 4 .ar files.
The B0950 example still fails. With -T 100 so it runs a bit longer it does look like it is working, but still no output file is generated:

dspsr -v -L 10 -T 100 -O ./B0950_test -e ar -E ./0950+08.par ./L569329_SAP1_BEAM21_2bit.fits 
Pulsar::Archive::set_verbosity level=2
dspsr: Loading ephemeris from ./0950+08.par
dspsr: blocksize=24126 samples or 260.719 MB
Finished 36.2 s (36%) 

What exact version of dspsr/psrchive are you running on Snellius?

[joerivanleeuwen]

Good that there's progress!

The snellius install is/was pretty simple:

# Sep 10, 2024

module load 2023 FFTW/3.3.10-GCC-12.3.0 CFITSIO/4.3.0-GCCcore-12.3.0 CUDA/12.1.1 GSL/2.7-GCCcore-12.3.0 foss/2023a libreadline/8.2-GCCcore-12.3.0

cd $HOME/Pulsar
git clone git://git.code.sf.net/p/psrchive/code psrchive
cd psrchive
./bootstrap
cd ..

git clone git://git.code.sf.net/p/dspsr/code dspsr
cd dspsr
echo "dummy fits" > backends.list
./bootstrap
./configure
make
make install

Note that the backend list is different from the ARTS version.
And libcfitsio probably does some heavy lifting in these examples..

[joerivanleeuwen]

Yuyang finds that the LOFAR B0950 2-bit data has problems on Snellius and in docker too, so perhaps there is actually a different, data issue there.

Now that the J1906 example works for you we should perhaps pause this, there may be two problems, and the reinstall fixed the first one already.

Can you roll out this new dspsr on arts too for those using spack env activate -p arts ?
There I still see the old dspsr I think, with the old errors.

[loostrum]

Thanks for the update, I'll roll out the new install.

Any other packages you want updated while I'm at it anyway? I've already added the latest psrcat.