-
Notifications
You must be signed in to change notification settings - Fork 15
Standalone
Everything needed to set up EMC_verif-global to run standalone will be contained in the your clone from GitHub.
The default configuration file for EMC_verif-global is parm/config/config.vrfy. It is recommended that users create a copy or copies of this configuration file for their own verification purposes. The user customized configuration file(s) can live wherever and be named whatever a user desires.
Below is a more in-depth description of the settings in the configuration file.
The first section contains switches for the verification cases that can be run. The setting "YES" will run the verification. The setting "NO" will not run the verification. Switches with "STEP1" at the end (RUN_GRID2GRID_STEP1, RUN_GRID2OBS_STEP1, RUN_PRECIP_STEP1, RUN_SATELLITE_STEP1) are for commuting various statistics, and switches with "STEP2" at the end (RUN_GRID2GRID_STEP2, RUN_GRID2OBS_STEP2, RUN_PRECIP_STEP2, RUN_SATELLITE_STEP2) are for creating plots. In order to run the "STEP2" switches, the corresponding "STEP1" switch will have needed to be run prior.
RUN_GRID2GRID_STEP1: grid-to-grid verification statistics production (default: YES)
RUN_GRID2GRID_STEP2: grid-to-grid verification statistics graphics production (default: NO)
RUN_GRID2OBS_STEP1: grid-to-obs verification statistics production (default: YES)
RUN_GRID2OBS_STEP2: grid-to-obs verification statistics graphics production (default: NO)
RUN_PRECIP_STEP1: precipitation verification statistics production (default: YES)
RUN_PRECIP_STEP2: precipitation verification statistics graphics production (default: NO)
RUN_SATELLITE_STEP1: satellite verification statistics production (default: NO)
RUN_SATELLITE_STEP2: satellite verification statistics graphics production (default: NO)
RUN_TROPCYC: tropical cyclone verification statistics graphics production (default: NO)
RUN_MAPS2D: latitude-longitude and zonal mean graphics comparing variables amongst model forecasts and analyses (default: NO)
RUN_MAPSDA: latitude-longitude and zonal mean graphics comparing variables for increments and ensemble mean and spread amongst models (default: NO)
Then, follows a section of settings that generally apply to running all the verification types. For "list" settings, each entry can be separated by the space, ex. "gfs gfsv16". List variables must contain the same amount of entries as "model_list". The entries match for their index in "model_list", so the first model listed in "model_list" will need its information listed first in "model_dir_list", "model_stat_dir_list", etc.
The "INPUT DATA SETTINGS" section is for settings related to the input data to be used to verify
model_list: list of model names (default: gfs)
model_dir_list: list full paths to the online directory containing the model analysis and forecast files; the code will look for the files in matching indexes in model_list ${model_dir}/${model} (default: /gpfs/dell2/emc/verification/noscrub/emc.verif/global/archive)
model_stat_dir_list: list of full paths to the directory where the archive of METplus .stat files should be; the code look for the files in the matching indexes in ${model_stat_dir}/metplus_data (default: /gpfs/dell2/emc/modeling/noscrub/$USER/archive)
model_file_format_list: list of template of the model forecast files; the template matches the index in model_list (default: pgbf{lead?fmt=%2H}.gfs.{init?fmt=%Y%m%d%H})
model_data_run_hpss: set to "NO" to not retrieve missing model data from HPSS; set to "YES" to retrieve missing model data from HPSS, NOTE: SETTING THIS TO YES WILL POTENTIALLY INCREASE RUN TIME (default: NO)
model_hpss_dir_list: list of full paths to the directory on HPSS; the code will look for the files in matching indexes in model_list ${model_hpss_dir}/${model} (default: /NCEPPROD/hpssprod/runhistory)
hpss_walltime: job submission wall time in minutes for jobs to get data from HPSS (default: 10)
The "OUTPUT DATA SETTINGS" section is for settings related to the output for running the verification cases
OUTPUTROOT: full path to the directory where the temporary output will be (default: /gpfs/dell2/stmp/$USER/verif_global_standalone)
The "DATE SETTINGS" section is for settings related the verification dates and how to use them
start_date: start date of the verification in YYYYMMDD format (default: 20210101)
end_date: end date of the verification in YYYYMMDD format (default: 20210101)
make_met_data_by: set to "VALID" to treat the verification dates as a valid dates; set to "INIT" to treat the verification dates as an initialization dates (default: VALID)
plot_by: set to "VALID" to treat the verification dates as a valid dates; set to "INIT" to treat the verification dates as an initialization dates (default: VALID)
The "WEB SETTINGS" section is for settings related being able to display graphics on a web server
SEND2WEB: set to "YES" to send graphics to the web; set to "NO" to not send graphics to the web (default: NO)
webhost: hostname of the web server (default: emcrzdm.ncep.noaa.gov)
webhostid: user ID on the web server (default: $USER)
webdir: directory on the web server to send the webpage template and graphics to (default: /home/people/emc/www/htdocs/gmb/${webhostid}/METplus/TEST)
The "METPLUS SETTINGS" section is for settings related to the versions and logging output for MET and METplus
MET_version: the version number of MET to use; options: 9.1 (default: 9.1)
METplus_version: the version number of METplus to use; options: 3.1 (default: 3.1)
METplus_verbosity: verbosity of the METplus logging; options, in order from most verbose to least verbose, are: NOTSET, DEBUG, INFO, WARNING, ERROR, CRITICAL (default: INFO)
MET_verbosity: verbosity of the MET logging; options are from 0-10 with 0 the least verbose and 10 the most verbose (default: 2)
log_MET_output_to_METplus: set to "yes" for METplus to capture the MET output in the log; set to "no" for METplus to no capture the MET output in the log (default: yes)
The "DATA DIRECTIVES SETTINGS" section is for settings related to to the data output
SENDARCH: set to "YES" to save data in model_stat_dir_list directories; set to "NO" to not save data in model_stat_dir_list directories (default: YES)
SENDMETVIEWER: set to "YES" to send data to METviewer AWS; set to "NO" to not send data to METviewer AWS (default: NO)
KEEPDATA: set to "YES" to keep all data in OUTPUTROOT after successful run; set to "YES" to remove data, except for logs, in OUTPUTROOT after successful run (default: YES)
SENDECF: KEEP AS NO (default: NO)
SENDCOM: KEEP AS NO (default: NO)
SENDDBN: KEEP AS NO (default: NO)
SENDDBN_NTC: KEEP AS NO (default: NO)
Finally, each verification type/switch has its own section of settings specifically related to it.
To run, from the top directory users will move to the ush directory. Here is the script run_verif_global.sh that runs EMC_verif-global. It takes one run time argument which is the path to the configuration file that the user wishes to run with. If none is given it will default to using config.vrfy. And example run time command may look like below
$ ./run_verif_global.sh ../parm/config/config.vrfy.example