Hi there,
When I run the code on GitHub after building it on JASMIN, I see there happens to be a floating point precision error when loading the netcdf file. Any help with this?
(conda-py311)[username@sci-vm-03 2016092500]$ . ./oifs-run
This is OpenIFS 48r1
replacing symlink: ifsdata
replacing symlink: 159l_2
replacing symlink: rtables
using existing namelist file: fort.4
### Launching $OIFS_HOME/build/bin/ifsMASTER.SP ###
++ mpirun -np 4 $OIFS_HOME/build/bin/ifsMASTER.SP
--------------------------------------------------------------------------
WARNING: Open MPI will create a shared memory backing file in a
directory that appears to be mounted on a network filesystem.
Creating the shared memory backup file on a network file system, such
as NFS or Lustre is not recommended -- it may cause excessive network
traffic to your file servers and/or cause shared memory traffic in
Open MPI to be much slower than expected.
You may want to check what the typical temporary directory is on your
node. Possible sources of the location of this temporary directory
include the $TEMPDIR, $TEMP, and $TMP environment variables.
Note, too, that system administrators can set a list of filesystems
where Open MPI is disallowed from creating temporary files by setting
the MCA parameter "orte_no_session_dir".
Local host: sci-vm-03.jasmin.ac.uk
Filename: /work/scratch-nopw2/pn341/tmp/ompi.sci-vm-03.7054660/pid.3594640/1/shared_mem_cuda_pool.sci-vm-03
You can set the MCA paramter shmem_mmap_enable_nfs_warning to 0 to
disable this message.
--------------------------------------------------------------------------
MAIN: IREQUIRED, MPI_THREAD_MULTIPLE, MPI_THREAD_SINGLE, IPROVIDED, LTHSAFEMPI, LLMPI1 = 3 3 0 3 T F
MPL_INIT : MPL_COMM=0 (default) , MPL_NUMPROC=4
MPL_INIT : MPL_METHOD=JP_BLOCKING_BUFFERED , MPL_MBX_SIZE=1000000
MPL_INIT : MPL_NCPU_PER_NODE = 1 (CAUTION: could not be inferred from hostname!)
[EC_DRHOOK:hostname:myproc:omltid:pid:unixtid] [YYYYMMDD:HHMMSS:walltime] [function@file:lineno] -- Max OpenMP threads = 4
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213159:0.001] [process_options@drhook.c:2209] fp = 0x7f89c0bfb6c0
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213159:0.003] [process_options@drhook.c:2220] ATP_ENABLED=1
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213159:0.003] [process_options@drhook.c:2221] ATP_MAX_CORES=20
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213159:0.003] [process_options@drhook.c:2222] ATP_MAX_ANALYSIS_TIME=300
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213159:0.003] [process_options@drhook.c:2223] ATP_IGNORE_SIGTERM=0
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213159:0.003] [process_options@drhook.c:2231] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213159:0.003] [process_options@drhook.c:2258] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213159:0.003] [process_options@drhook.c:2264] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213159:0.003] [process_options@drhook.c:2352] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213159:0.003] [process_options@drhook.c:2363] DR_HOOK_HASHBITS=16
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213159:0.003] [process_options@drhook.c:2371] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213159:0.003] [process_options@drhook.c:2379] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213159:0.003] [process_options@drhook.c:2386] DR_HOOK_USE_LOCKFILE=1
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213159:0.003] [process_options@drhook.c:2393] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213159:0.003] [process_options@drhook.c:2400] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213159:0.003] [process_options@drhook.c:2407] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213159:0.003] [process_options@drhook.c:2414] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213159:0.003] [ignore_signals@drhook.c:1365] DR_HOOK_IGNORE_SIGNALS=0
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213159:0.003] [restore_default_signals@drhook.c:1298] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213159:0.003] [signal_drhook_init@drhook.c:2045] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x7f89c11a2573 (next at 0x7f89c0d610a0)
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213159:0.003] [signal_drhook_init@drhook.c:2046] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x7f89c11a2573 (next at 0x7f89c0d610a0)
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213159:0.003] [signal_drhook_init@drhook.c:2047] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x7f89c11a2573 (next at 0x7f89c0d610a0)
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213159:0.003] [signal_drhook_init@drhook.c:2052] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x7f89c11a2573 (next at (nil))
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213159:0.003] [trapfpe_treatment@drhook.c:1248] DR_HOOK enables SIGFPE-related floating point trapping since DR_HOOK_TRAPFPE=1
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213159:0.003] [trapfpe@drhook.c:244] DR_HOOK trapfpe() : Exceptions before = 0xd [13] -- after = 0xd [13]
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213159:0.003] [trapfpe@drhook.c:249] DR_HOOK trapfpe() : with FE_INVALID = 0x1 [1] -- FE_DIVBYZERO = 0x4 [4] -- FE_OVERFLOW = 0x8 [8]
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213159:0.003] [trapfpe@drhook.c:256] DR_HOOK trapfpe() : feenableexcept(0xd [13]) returns rc=13
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213159:0.003] [signal_drhook_init@drhook.c:2054] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x7f89c11a2573 (next at 0x7f89c0d610a0)
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213159:0.003] [signal_drhook_init@drhook.c:2055] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x7f89c11a2573 (next at 0x7f89c0d610a0)
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213159:0.003] [signal_drhook_init@drhook.c:2056] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x7f89c11a2573 (next at 0x7f89c0d610a0)
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213159:0.003] [signal_drhook_init@drhook.c:2057] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x7f89c11a2573 (next at (nil))
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213159:0.003] [signal_drhook_init@drhook.c:2071] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x7f89c11a2573 (next at 0x7f89c0d610a0)
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213159:0.003] [signal_drhook_init@drhook.c:2073] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x7f89c11a2573 (next at 0x7f89c0d610a0)
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213159:0.003] [signal_drhook_init@drhook.c:2078] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x7f89c11a2573 (next at 0x7f89c0d610a0)
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213159:0.003] [catch_signals@drhook.c:1210] DR_HOOK_CATCH_SIGNALS=<undef>
MPL_BUFFER_METHOD: 1 1000000
(I) LOGGER RE-CONFIGURED BY IFS_INIT
[EC_DRHOOK:sci-vm-03:1:4:3594644:3594737] [20260308:213159:0.553] [trapfpe_treatment@drhook.c:1248] DR_HOOK enables SIGFPE-related floating point trapping since DR_HOOK_TRAPFPE=1
[EC_DRHOOK:sci-vm-03:1:4:3594644:3594737] [20260308:213159:0.553] [trapfpe@drhook.c:244] DR_HOOK trapfpe() : Exceptions before = 0xd [13] -- after = 0xd [13]
[EC_DRHOOK:sci-vm-03:1:4:3594644:3594737] [20260308:213159:0.553] [trapfpe@drhook.c:249] DR_HOOK trapfpe() : with FE_INVALID = 0x1 [1] -- FE_DIVBYZERO = 0x4 [4] -- FE_OVERFLOW = 0x8 [8]
[EC_DRHOOK:sci-vm-03:1:4:3594644:3594737] [20260308:213159:0.553] [trapfpe@drhook.c:256] DR_HOOK trapfpe() : feenableexcept(0xd [13]) returns rc=13
Reading $OIFS_HOME/openifs-expt/ab7z/2016092500/ifsdata/RADRRTM
Reading $OIFS_HOME/openifs-expt/ab7z/2016092500/ifsdata/RADSRTM
[EC_DRHOOK:hostname:myproc:omltid:pid:unixtid] [YYYYMMDD:HHMMSS:walltime] [function@file:lineno]
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.106] [signal_drhook@drhook.c:1641] Received signal#8 (SIGFPE) :: 785MB (heap), 190MB (maxrss), 3MB (maxstack), 12130MB (vmpeak), 0 (paging), nsigs = 1
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.106] [signal_drhook@drhook.c:1649] Hardlimit for core file is now 18446744073709551615 (0xffffffffffffffff)
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.106] [signal_drhook@drhook.c:1656] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.121] [signal_drhook@drhook.c:1745] Signal#8 was caused by floating-point invalid operation [memaddr=0x7f89b9d54b72] [excepts=0x0 [0]] : 0x7f89b9d54b72 at /gws/ssde/j25a/ai4er/users/pn341/ifs/conda-py311/lib/././libhdf5.so.310(H5T__init_native_float_types), nsigs = 1
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.121] [signal_drhook@drhook.c:1778] : [00]: <unknown_function> $OIFS_HOME/build/bin/../lib/libfiat.so 0x7f89c118d000 0x7f89c11a2c37 # addr2line
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.121] [signal_drhook@drhook.c:1778] : [01]: <unknown_function> /lib64/libc.so.6 0x7f89c0a00000 0x7f89c0a3fc30 # addr2line
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.121] [signal_drhook@drhook.c:1778] : [02]: H5T__init_native_float_types /gws/ssde/j25a/ai4er/users/pn341/ifs/conda-py311/lib/././libhdf5.so.310 0x7f89b9a79000 0x7f89b9d54b72 # addr2line
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.121] [signal_drhook@drhook.c:1778] : [03]: H5T_init /gws/ssde/j25a/ai4er/users/pn341/ifs/conda-py311/lib/././libhdf5.so.310 0x7f89b9a79000 0x7f89b9ce3cbb # addr2line
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.121] [signal_drhook@drhook.c:1778] : [04]: H5VL_init_phase2 /gws/ssde/j25a/ai4er/users/pn341/ifs/conda-py311/lib/././libhdf5.so.310 0x7f89b9a79000 0x7f89b9d731e3 # addr2line
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.121] [signal_drhook@drhook.c:1778] : [05]: H5_init_library /gws/ssde/j25a/ai4er/users/pn341/ifs/conda-py311/lib/././libhdf5.so.310 0x7f89b9a79000 0x7f89b9acaa23 # addr2line
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.121] [signal_drhook@drhook.c:1778] : [06]: H5Eset_auto2 /gws/ssde/j25a/ai4er/users/pn341/ifs/conda-py311/lib/././libhdf5.so.310 0x7f89b9a79000 0x7f89b9b67386 # addr2line
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.121] [signal_drhook@drhook.c:1778] : [07]: nc4_hdf5_initialize /gws/ssde/j25a/ai4er/users/pn341/ifs/conda-py311/lib/./libnetcdf.so.19 0x7f89bc0ed000 0x7f89bc19aba0 # addr2line
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.121] [signal_drhook@drhook.c:1778] : [08]: NC_HDF5_initialize /gws/ssde/j25a/ai4er/users/pn341/ifs/conda-py311/lib/./libnetcdf.so.19 0x7f89bc0ed000 0x7f89bc1a352e # addr2line
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.121] [signal_drhook@drhook.c:1778] : [09]: nc_initialize /gws/ssde/j25a/ai4er/users/pn341/ifs/conda-py311/lib/./libnetcdf.so.19 0x7f89bc0ed000 0x7f89bc11e214 # addr2line
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.121] [signal_drhook@drhook.c:1778] : [10]: NC_open /gws/ssde/j25a/ai4er/users/pn341/ifs/conda-py311/lib/./libnetcdf.so.19 0x7f89bc0ed000 0x7f89bc12035a # addr2line
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.121] [signal_drhook@drhook.c:1778] : [11]: nc_open /gws/ssde/j25a/ai4er/users/pn341/ifs/conda-py311/lib/./libnetcdf.so.19 0x7f89bc0ed000 0x7f89bc1204d5 # addr2line
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.121] [signal_drhook@drhook.c:1778] : [12]: nf_open_ /gws/ssde/j25a/ai4er/users/pn341/ifs/conda-py311/lib/libnetcdff.so.7 0x7f89bddce000 0x7f89bdde0b1c # addr2line
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.121] [signal_drhook@drhook.c:1778] : [13]: __netcdf_MOD_nf90_open /gws/ssde/j25a/ai4er/users/pn341/ifs/conda-py311/lib/libnetcdff.so.7 0x7f89bddce000 0x7f89bde88668 # addr2line
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.121] [signal_drhook@drhook.c:1778] : [14]: __easy_netcdf_MOD_open_netcdf_file $OIFS_HOME/build/bin/../lib/libarpifs.SP.so 0x7f89c4a21000 0x7f89c58d5f70 # addr2line
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.121] [signal_drhook@drhook.c:1778] : [15]: __easy_netcdf_read_mpi_MOD_open_netcdf_file $OIFS_HOME/build/bin/../lib/libarpifs.SP.so 0x7f89c4a21000 0x7f89c58d7d13 # addr2line
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [signal_drhook@drhook.c:1778] : [16]: __yomsolarirradiance_MOD_read_solar_irradiance $OIFS_HOME/build/bin/../lib/libarpifs.SP.so 0x7f89c4a21000 0x7f89c5229ee6 # addr2line
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [signal_drhook@drhook.c:1778] : [17]: suecrad_ $OIFS_HOME/build/bin/../lib/libarpifs.SP.so 0x7f89c4a21000 0x7f89c55a861f # addr2line
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [signal_drhook@drhook.c:1778] : [18]: suphec_ $OIFS_HOME/build/bin/../lib/libarpifs.SP.so 0x7f89c4a21000 0x7f89c5453df7 # addr2line
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [signal_drhook@drhook.c:1778] : [19]: suphy_ $OIFS_HOME/build/bin/../lib/libarpifs.SP.so 0x7f89c4a21000 0x7f89c57f8dee # addr2line
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [signal_drhook@drhook.c:1778] : [20]: su0yomb_ $OIFS_HOME/build/bin/../lib/libarpifs.SP.so 0x7f89c4a21000 0x7f89c5636c54 # addr2line
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [signal_drhook@drhook.c:1778] : [21]: cnt0_ $OIFS_HOME/build/bin/../lib/libarpifs.SP.so 0x7f89c4a21000 0x7f89c4ce4ae7 # addr2line
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [signal_drhook@drhook.c:1778] : [22]: <unknown_function> $OIFS_HOME/build/bin/ifsMASTER.SP 0x400000 0x4026f7 # addr2line
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [signal_drhook@drhook.c:1778] : [23]: <unknown_function> $OIFS_HOME/build/bin/ifsMASTER.SP 0x400000 0x4022d3 # addr2line
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [signal_drhook@drhook.c:1778] : [24]: <unknown_function> /lib64/libc.so.6 0x7f89c0a00000 0x7f89c0a2a610 # addr2line
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [signal_drhook@drhook.c:1778] : [25]: __libc_start_main /lib64/libc.so.6 0x7f89c0a00000 0x7f89c0a2a6c0 # addr2line
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [signal_drhook@drhook.c:1778] : [26]: <unknown_function> $OIFS_HOME/build/bin/ifsMASTER.SP 0x400000 0x402305 # addr2line
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [signal_drhook@drhook.c:1826] Starting DrHook backtrace for signal#8, nsigs = 1
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [DrHookCallTree] DR_HOOK call tree : 785 MB (maxheap), 191 MB (maxrss), 3 MB (maxstack), 12130 MB (vmpeak)
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [DrHookCallTree] : MASTER
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [DrHookCallTree] : CNT0
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [DrHookCallTree] : SU0YOMB
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [DrHookCallTree] : SUPHY
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [DrHookCallTree] : SUPHEC
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [DrHookCallTree] : SUECRAD
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [DrHookCallTree] : YOMSOLARIRRADIANCE:READ_SOLAR_IRRADIANCE
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [LinuxTraceBack] Backtrace(s) for program '$OIFS_HOME/build/bin/ifsMASTER.SP' : sigcontextptr=0x7ffe8d1e5170
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [LinuxTraceBack] Backtrace (size = 28) with addr2line-cmd
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [LinuxTraceBack] /usr/bin/addr2line -fs -e '$OIFS_HOME/build/bin/ifsMASTER.SP' 0x7f89c11c3018 0x7f89c11c2deb 0x7f89c0a3fc30 0x7f89b9d54b72 0x7f89b9ce3cbb 0x7f89b9d731e3 0x7f89b9acaa23 0x7f89b9b67386 0x7f89bc19aba0 0x7f89bc1a352e 0x7f89bc11e214 0x7f89bc12035a 0x7f89bc1204d5 0x7f89bdde0b1c 0x7f89bde88668 0x7f89c58d5f70 0x7f89c58d7d13 0x7f89c5229ee6 0x7f89c55a861f 0x7f89c5453df7 0x7f89c57f8dee 0x7f89c5636c54 0x7f89c4ce4ae7 0x4026f7 0x4022d3 0x7f89c0a2a610 0x7f89c0a2a6c0 0x402305
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [LinuxTraceBack] [00]: libfiat.so(LinuxTraceBack+0x278) [0x7f89c11c3018] : ??() at ??:0
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [LinuxTraceBack] [01]: libfiat.so(LinuxTraceBack+0x4b) [0x7f89c11c2deb] : ??() at ??:0
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [LinuxTraceBack] [02]: libc.so.6(+0x3fc30) [0x7f89c0a3fc30] : ??() at ??:0
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [LinuxTraceBack] [03]: libhdf5.so.310(H5T__init_native_float_types+0x932) [0x7f89b9d54b72] : ??() at ??:0
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [LinuxTraceBack] [04]: libhdf5.so.310(H5T_init+0x4b) [0x7f89b9ce3cbb] : ??() at ??:0
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [LinuxTraceBack] [05]: libhdf5.so.310(H5VL_init_phase2+0x143) [0x7f89b9d731e3] : ??() at ??:0
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [LinuxTraceBack] [06]: libhdf5.so.310(H5_init_library+0x2b3) [0x7f89b9acaa23] : ??() at ??:0
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [LinuxTraceBack] [07]: libhdf5.so.310(H5Eset_auto2+0x1b6) [0x7f89b9b67386] : ??() at ??:0
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [LinuxTraceBack] [08]: libnetcdf.so.19(nc4_hdf5_initialize+0x10) [0x7f89bc19aba0] : ??() at ??:0
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [LinuxTraceBack] [09]: libnetcdf.so.19(NC_HDF5_initialize+0x3e) [0x7f89bc1a352e] : ??() at ??:0
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [LinuxTraceBack] [10]: libnetcdf.so.19(nc_initialize+0x64) [0x7f89bc11e214] : ??() at ??:0
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [LinuxTraceBack] [11]: libnetcdf.so.19(NC_open+0x22a) [0x7f89bc12035a] : ??() at ??:0
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [LinuxTraceBack] [12]: libnetcdf.so.19(nc_open+0x15) [0x7f89bc1204d5] : ??() at ??:0
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [LinuxTraceBack] [13]: libnetcdff.so.7(nf_open_+0xac) [0x7f89bdde0b1c] : ??() at ??:0
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [LinuxTraceBack] [14]: libnetcdff.so.7(__netcdf_MOD_nf90_open+0x1d8) [0x7f89bde88668] : ??() at ??:0
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [LinuxTraceBack] [15]: libarpifs.SP.so(__easy_netcdf_MOD_open_netcdf_file+0x250) [0x7f89c58d5f70] : ??() at ??:0
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [LinuxTraceBack] [16]: libarpifs.SP.so(__easy_netcdf_read_mpi_MOD_open_netcdf_file+0xb3) [0x7f89c58d7d13] : ??() at ??:0
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [LinuxTraceBack] [17]: libarpifs.SP.so(__yomsolarirradiance_MOD_read_solar_irradiance+0x136) [0x7f89c5229ee6] : ??() at ??:0
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [LinuxTraceBack] [18]: libarpifs.SP.so(suecrad_+0xa4bf) [0x7f89c55a861f] : ??() at ??:0
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [LinuxTraceBack] [19]: libarpifs.SP.so(suphec_+0xc57) [0x7f89c5453df7] : ??() at ??:0
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [LinuxTraceBack] [20]: libarpifs.SP.so(suphy_+0xce) [0x7f89c57f8dee] : ??() at ??:0
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [LinuxTraceBack] [21]: libarpifs.SP.so(su0yomb_+0x169c4) [0x7f89c5636c54] : ??() at ??:0
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [LinuxTraceBack] [22]: libarpifs.SP.so(cnt0_+0x186d7) [0x7f89c4ce4ae7] : ??() at ??:0
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [LinuxTraceBack] [23]: ifsMASTER.SP() [0x4026f7] : MAIN__() at master.F90:253
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [LinuxTraceBack] [24]: ifsMASTER.SP() [0x4022d3] : main() at master.F90:16
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [LinuxTraceBack] [25]: libc.so.6(+0x2a610) [0x7f89c0a2a610] : ??() at ??:0
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [LinuxTraceBack] [26]: libc.so.6(__libc_start_main+0x80) [0x7f89c0a2a6c0] : ??() at ??:0
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [LinuxTraceBack] [27]: ifsMASTER.SP() [0x402305] : _start() at ??:?
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.122] [LinuxTraceBack] End of backtrace(s)
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.264] [signal_drhook@drhook.c:1873] DrHook backtrace done for signal#8, nsigs = 1
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.264] [signal_drhook@drhook.c:1913] Resetting SIGSEGV (11) to default signal handler (SIG_DFL) before calling ATP for signal#8, nsigs = 1
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.264] [set_default_handler@drhook.c:778] Enabled default signal handler (SIG_DFL) for signal#11 -- hardlimit for core file is now 18446744073709551615 (0xffffffffffffffff)
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213200:1.264] [signal_drhook@drhook.c:1925] Calling previous signal handler at 0x7f89c0d610a0 for signal#8, nsigs = 1
Program received signal SIGFPE: Floating-point exception - erroneous arithmetic operation.
Backtrace for this error:
#0 0x7f89c11a3aeb in signal_drhook
at $OIFS_HOME/source/ifs_dp/contrib/fiat/src/fiat/drhook/drhook.c:1929
#1 0x7f89c0a3fc2f in ???
#2 0x7f89b9d54b72 in ???
#3 0x7f89b9ce3cba in ???
#4 0x7f89b9d731e2 in ???
#5 0x7f89b9acaa22 in ???
#6 0x7f89b9b67385 in ???
#7 0x7f89bc19ab9f in ???
#8 0x7f89bc1a352d in ???
#9 0x7f89bc11e213 in ???
#10 0x7f89bc120359 in ???
#11 0x7f89bc1204d4 in ???
#12 0x7f89bdde0b1b in ???
#13 0x7f89bde88667 in ???
#14 0x7f89c58d5f6f in __easy_netcdf_MOD_open_netcdf_file
at $OIFS_HOME/source/ifs_sp/radiation/module/easy_netcdf.F90:133
#15 0x7f89c58d7d12 in __easy_netcdf_read_mpi_MOD_open_netcdf_file
at $OIFS_HOME/source/ifs_sp/radiation/module/easy_netcdf_read_mpi.F90:98
#16 0x7f89c5229ee5 in __yomsolarirradiance_MOD_read_solar_irradiance
at $OIFS_HOME/source/ifs_sp/arpifs/module/yomsolarirradiance.F90:105
#17 0x7f89c55a861e in suecrad_
at $OIFS_HOME/source/ifs_sp/arpifs/phys_radi/suecrad.F90:2533
#18 0x7f89c5453df6 in suphec_
at $OIFS_HOME/source/ifs_sp/arpifs/phys_ec/suphec.F90:287
#19 0x7f89c57f8ded in suphy_
at $OIFS_HOME/source/ifs_sp/arpifs/setup/suphy.F90:94
#20 0x7f89c5636c53 in su0yomb_
at $OIFS_HOME/source/ifs_sp/arpifs/setup/su0yomb.F90:498
#21 0x7f89c4ce4ae6 in cnt0_
at $OIFS_HOME/source/ifs_sp/arpifs/control/cnt0.F90:189
#22 0x4026f6 in master
at $OIFS_HOME/source/ifs_sp/arpifs/programs/master.F90:251
#23 0x4022d2 in main
at $OIFS_HOME/source/ifs_sp/arpifs/programs/master.F90:16
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213202:2.902] [signal_drhook@drhook.c:1936] Returned from previous signal handler (at 0x7f89c0d610a0, signal#8, time taken = 2s), nsigs = 1
[EC_DRHOOK:sci-vm-03:1:1:3594644:3594644] [20260308:213202:2.902] [signal_drhook@drhook.c:1948] Before aborting (signal#8) spin 98s (incl. grace 60s) to give ATP time to write all #20 core file(s), nsigs = 1
[sci-vm-03.jasmin.ac.uk:3594640] 1 more process has sent help message help-opal-shmem-mmap.txt / mmap on nfs
[sci-vm-03.jasmin.ac.uk:3594640] Set MCA parameter "orte_base_help_aggregate" to 0 to see all help / error messages
^C[sci-vm-03.jasmin.ac.uk:3594640] PMIX ERROR: NO-PERMISSIONS in file dstore_base.c at line 237
[sci-vm-03.jasmin.ac.uk:3594640] PMIX ERROR: NO-PERMISSIONS in file dstore_base.c at line 246
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
OPENIFS JOB FAILED
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
Model run completed.
### Begin postprocessing model output...
mkdir: created directory '$OIFS_HOME/openifs-expt/ab7z/2016092500/output_20260308_213208'
Completed postprocessing.