fre-workflow bugs

[singhd789]

In running the post-processing workflow, tasks are failing from little bugs or things that need to be updated. Here's what I'm seeing so far with the ppan site being used:

• stage-history failure: conflicting versions of gcp being loaded
  • In ppan.cylc --> stage-history pre-script --> module load gcp hsm/test can be changed to module load gcp/2.3 hsm/1.3.0
• mask-atmos-plevel failure: ERROR: Unable to locate a modulefile for 'python/3.9' (python/3.9 doesn't exist anymore)
  • In ppan.cylc --> mask-atmos-plevel pre-script --> module load python/3.9 should be changed to module load python/3.10
• regrid-xy failure: EnvironmentLocationNotFound: Not a conda environment: /nbhome/fms/conda/envs/fre-cli
  • In ppan.cylc --> regrid-xy pre-script --> path to environment needs to be updated to conda activate /nbhome/fms/conda/envs/fre-2025.01
  • (also needs to be done for remap-pp-components pre-script)
• rename-split-to-pp: line 204: type: isodatetime: not found
  • install isodate in cylc
• data-catalog: ERROR: Unable to locate a modulefile for 'fre/canopy
  • In site files --> update module load fre/canopy to module load fre/2025.01
  • do this for regrid and remap too
• remap-pp-components: raise Exception(f"Error: Input directory {in_dir} is not a valid directory") (invalid syntax?)

[ceblanton]

Yeah! Thank you very much for testing and identifying these.

The modulefile issue with hsm is easy.

The isodatetime thing we can fix with the Cylc installation.

The regrid-xy failure. I don't like that goes behind fre's back and uses the conda environment underneath. That's bound to be a problem again and again.

The mask-atmos-plevel is the worst.. I created a fre-cli version of that (https://github.com/NOAA-GFDL/fre-cli/blob/main/fre/app/mask_atmos_plevel.py) but never updated fre-workflows to use it. Bad bad bad!

[singhd789]

Yeah, the regrid (and remap) fix felt a bit weird