Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release v16.3.22 optimized point output #3257

Merged
merged 23 commits into from
Jan 30, 2025
Merged

Release v16.3.22 optimized point output #3257

Show file tree
Hide file tree
Changes from 22 commits
Commits
Show all changes
23 commits
Select commit Hold shift + click to select a range
a2ba32b
optimized the ww3_outp, issue #3157
AliS-Noaa Dec 30, 2024
8086f49
cleaned the outp script, issue #3157
AliS-Noaa Jan 3, 2025
84fc8f3
changing the point output script and cleaning it and changing the res…
AliS-Noaa Jan 7, 2025
d2b6b70
concising the exgfs_wave_post_pnt.sh and config files, issue #3157
AliS-Noaa Jan 8, 2025
d122080
fixing tar script for the optimized point output, issue #3157
AliS-Noaa Jan 21, 2025
8e2ad85
retreiving the file counting, issue #3157
AliS-Noaa Jan 21, 2025
0772d72
Merge remote-tracking branch 'origin/devgfs/pointupdate' into release…
AliS-Noaa Jan 24, 2025
1a9b7f9
Revising the checkout.sh
AliS-Noaa Jan 24, 2025
5784053
fixing the links to inputs for wave post script
AliS-Noaa Jan 28, 2025
14059bf
Updatuing the Release_Notes.md for wave point output update
AliS-Noaa Jan 28, 2025
4a2c51b
minor revision in the Release_Notes.md
AliS-Noaa Jan 28, 2025
25f6086
another minor correction to the Release_Notes.md
AliS-Noaa Jan 28, 2025
53f8172
Update docs/Release_Notes.md
AliS-Noaa Jan 28, 2025
61e3577
Update docs/Release_Notes.md
AliS-Noaa Jan 28, 2025
0892513
Update docs/Release_Notes.md
AliS-Noaa Jan 28, 2025
b2220cc
Update docs/Release_Notes.md
AliS-Noaa Jan 28, 2025
52558ac
Update docs/Release_Notes.md
AliS-Noaa Jan 28, 2025
e22af6b
Update docs/Release_Notes.md
AliS-Noaa Jan 28, 2025
aaf1a46
Update docs/Release_Notes.md
AliS-Noaa Jan 28, 2025
de078f6
adding two wave jobs for testing to the Release note
AliS-Noaa Jan 28, 2025
14bb68f
adding sperate log file for each wave post point jobs
AliS-Noaa Jan 29, 2025
9ae2e74
adding the tag to checkout.sh and also some minor revision of the rel…
AliS-Noaa Jan 29, 2025
0c583d8
updating External.cfg with the correct ufs tag
AliS-Noaa Jan 30, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
23 changes: 17 additions & 6 deletions docs/Release_Notes.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,10 +3,10 @@ GFS V16.3.22 RELEASE NOTES
-------
PRELUDE
-------

The upstream OBSPROC package is updated to v1.3. Along with this are the following companion updates:
* workflow and UFS_UTILS package updates to use the new AFWA global snow file due to the hemispheric snow files being phased out
* updated GSI code and convinfo file for saildrone observations
* ww3_outp is improved for the wave point output

IMPLEMENTATION INSTRUCTIONS
---------------------------
Expand All @@ -26,7 +26,7 @@ The checkout script extracts the following GFS components:

| Component | Tag | POC |
| --------- | ----------- | ----------------- |
| MODEL | GFS.v16.3.1 | Jun.Wang@noaa.gov |
| MODEL | GFS.v16.3.22 | Jun.Wang@noaa.gov |
| GLDAS | gldas_gfsv16_release.v.2.1.0 | Helin.Wei@noaa.gov |
| GSI | gfsda.v16.3.22 | Andrew.Collard@noaa.gov |
| UFS_UTILS | ops-gfsv16.3.20 | George.Gayno@noaa.gov |
Expand Down Expand Up @@ -58,6 +58,7 @@ SORC CHANGES

* New UFS_UTILS tag - `emcsfc_snow2mdl` program and associated scripts are updated to process global AFWA snow data
* New GSI tag - `src/gsi/read_prepbufr.f90` code update for new saildrone subtype
* New MODEL tag - WW3 program `ww3_outp` and associated scripts are improved to process the per-time-step point outputs more efficiently.

JOBS CHANGES
------------
Expand All @@ -67,12 +68,15 @@ JOBS CHANGES
PARM/CONFIG CHANGES
-------------------

* No changes from GFS v16.3.21
In `config.resources.emc.dyn` and `config.resources.nco.static` following resources are changed:
* for wavepostbndpnt: npe from 240 to 1; wtime from 1hr to 30min
* for wavepostbndpntbll: npe from 448 to 2; wtime from 1hr to 10min
* for wavepostpnt: npe from 200 to 3; wtime from 1.5hr to 35min

SCRIPT CHANGES
--------------

* No changes from GFS v16.3.21
* `scripts/exgfs_wave_post_pnt.sh` is changed to be compatible with the new `ww3_outp`.

FIX CHANGES
-----------
Expand All @@ -97,14 +101,19 @@ Now ingest:
ENVIRONMENT AND RESOURCE CHANGES
--------------------------------

* Increase ncpus from 50 to 60 for gfs_wave_postpnt job.
NCO provided change to avoid ncpu burst warnings.
Reduce the ncpu and wtime as follow:
* for jobs/JGLOBAL_WAVE_POST_BNDPNT; ncpu from 240 to 1; wtime from 1hr to 30min
* for jobs/JGLOBAL_WAVE_POST_BNDPNTBLL; ncpu from 448 to 2; wtime from 1hr to 10min
* for jobs/JGLOBAL_WAVE_POST_PNT; ncpu from 200 to 3; wtime from 1.5hr to 35min

PRE-IMPLEMENTATION TESTING REQUIREMENTS
---------------------------------------

* Which production jobs should be tested as part of this implementation?
* emcsfc_sfc_prep and analysis
* wave_post_pnt
* wave_post_bndpnt
* wave_post_bndpntbll
* Does this change require a 30-day evaluation?
* No

Expand Down Expand Up @@ -133,3 +142,5 @@ PREPARED BY
Kate.Friedman@noaa.gov
George.Gayno@noaa.gov
Andrew.Collard@noaa.gov
Jessica.Meixner@noaa.gov
Ali.Salimi@noaa.gov
4 changes: 2 additions & 2 deletions ecf/scripts/gfs/wave/post/jgfs_wave_post_bndpnt.ecf
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,8 +3,8 @@
#PBS -j oe
#PBS -q %QUEUE%
#PBS -A %PROJ%-%PROJENVIR%
#PBS -l walltime=01:00:00
#PBS -l select=3:ncpus=80:ompthreads=1
#PBS -l walltime=00:30:00
#PBS -l select=1:ncpus=1:ompthreads=1
#PBS -l place=vscatter:exclhost
#PBS -l debug=true

Expand Down
4 changes: 2 additions & 2 deletions ecf/scripts/gfs/wave/post/jgfs_wave_post_bndpntbll.ecf
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,8 +3,8 @@
#PBS -j oe
#PBS -q %QUEUE%
#PBS -A %PROJ%-%PROJENVIR%
#PBS -l walltime=01:00:00
#PBS -l select=4:ncpus=112:ompthreads=1
#PBS -l walltime=00:10:00
#PBS -l select=1:ncpus=2:ompthreads=1
#PBS -l place=vscatter:exclhost
#PBS -l debug=true

Expand Down
4 changes: 2 additions & 2 deletions ecf/scripts/gfs/wave/post/jgfs_wave_postpnt.ecf
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,8 +3,8 @@
#PBS -j oe
#PBS -q %QUEUE%
#PBS -A %PROJ%-%PROJENVIR%
#PBS -l walltime=01:30:00
#PBS -l select=4:ncpus=60:ompthreads=1
#PBS -l walltime=00:35:00
#PBS -l select=1:ncpus=3:ompthreads=1
#PBS -l place=vscatter:exclhost
#PBS -l debug=true

Expand Down
18 changes: 9 additions & 9 deletions parm/config/config.resources.emc.dyn
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -90,26 +90,26 @@ elif [ $step = "wavepostsbs" ]; then

elif [ $step = "wavepostbndpnt" ]; then

export wtime_wavepostbndpnt="01:00:00"
export npe_wavepostbndpnt=240
export wtime_wavepostbndpnt="00:30:00"
export npe_wavepostbndpnt=1
export nth_wavepostbndpnt=1
export npe_node_wavepostbndpnt=80
export npe_node_wavepostbndpnt=${npe_wavepostbndpnt}
export NTASKS=$npe_wavepostbndpnt

elif [ $step = "wavepostbndpntbll" ]; then

export wtime_wavepostbndpntbll="01:00:00"
export npe_wavepostbndpntbll=448
export wtime_wavepostbndpntbll="00:10:00"
export npe_wavepostbndpntbll=2
export nth_wavepostbndpntbll=1
export npe_node_wavepostbndpntbll=112
export npe_node_wavepostbndpntbll=${npe_wavepostbndpntbll}
export NTASKS=$npe_wavepostbndpntbll

elif [ $step = "wavepostpnt" ]; then

export wtime_wavepostpnt="01:30:00"
export npe_wavepostpnt=200
export wtime_wavepostpnt="00:35:00"
export npe_wavepostpnt=3
export nth_wavepostpnt=1
export npe_node_wavepostpnt=60
export npe_node_wavepostpnt=${npe_wavepostpnt}
export NTASKS=$npe_wavepostpnt

elif [ $step = "wavegempak" ]; then
Expand Down
18 changes: 9 additions & 9 deletions parm/config/config.resources.nco.static
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -74,26 +74,26 @@ elif [ $step = "wavepostsbs" ]; then

elif [ $step = "wavepostbndpnt" ]; then

export wtime_wavepostbndpnt="01:00:00"
export npe_wavepostbndpnt=240
export wtime_wavepostbndpnt="00:30:00"
export npe_wavepostbndpnt=1
export nth_wavepostbndpnt=1
export npe_node_wavepostbndpnt=80
export npe_node_wavepostbndpnt=${npe_wavepostbndpnt}
export NTASKS=$npe_wavepostbndpnt

elif [ $step = "wavepostbndpntbll" ]; then

export wtime_wavepostbndpntbll="01:00:00"
export npe_wavepostbndpntbll=448
export wtime_wavepostbndpntbll="00:10:00"
export npe_wavepostbndpntbll=2
export nth_wavepostbndpntbll=1
export npe_node_wavepostbndpntbll=112
export npe_node_wavepostbndpntbll=${npe_wavepostbndpntbll}
export NTASKS=$npe_wavepostbndpntbll

elif [ $step = "wavepostpnt" ]; then

export wtime_wavepostpnt="01:30:00"
export npe_wavepostpnt=200
export wtime_wavepostpnt="00:35:00"
export npe_wavepostpnt=3
export nth_wavepostpnt=1
export npe_node_wavepostpnt=60
export npe_node_wavepostpnt=${npe_wavepostpnt}
export NTASKS=$npe_wavepostpnt

elif [ $step = "wavegempak" ]; then
Expand Down
Loading