Meeting notes 20230112

Recent Development

1. Issues fixed:

1. issue41: generate MoM outputs multiple times when there is no HWRF data release.
2. issue55: final_alert_pdc function in HWRF_MoM is rewritten, it takes only several seconds to generate the final MoM output.
3. issue50: minor fixes to improve the code quality.

All the fixes are in branch meta_issue50 have been tested at IU server.

1.1 Code delivery:

1. Merge the code into main branch this Friday, and switch IU server to the main branch.
2. Test the main branch on IU server during the weekend.
3. Delivery the code for testing next week, no changes on configuration, "git pull" is sufficient.

2. VIIRS + World Population (new feature)

The new feature aims to improve VIIRS results with the 100m resolution world population data. VIIRS and Population Data demonstrates the basic workflow:

1. Identify the watersheds flagged by VIIRS (Flag = 3 in MoM output).
2. Overly VIIRS images on the pre-generated population image for each watershed.
3. Count the population directly impacted by flood.
4. [optional] add the outputs back to MoM output.

The output is [pfaf_id, Totalpop, VIIRS_impactpop, VIIRS_impactpop_percent]

Sample output for 2022122606:

|pfaf_id|Totalpop|VIIRS_impactpop|VIIRS_impactpop_percent|  
|-------|--------|---------------|-----------------------|  
|172560 |98949   |11156          |11.27                  |  
|172810 |300753  |26023          |8.65                   |  
|172823 |1576    |87             |5.52                   |  
|112111 |1132711 |38868          |3.43                   |  
|115423 |708     |30             |4.24                   |  
|115425 |6864    |597            |8.70                   |  
|117107 |18789   |2889           |15.38                  |  
|172557 |25899   |4536           |17.51                  |  
|172581 |19254   |12004          |62.35                  |  
...

2.1 Computing resource requirement:

• 7GB 100m population images
• Runtime storage requirement is low (<100 Mb)
• It takes several minutes to finish

2.2 Code delivery:

The main computing code has been fully tested in ModelofModel, it is ready to be integrated with MoMProduction. The testing on IU server can be done this month.
This function is not an essential part of MoM, and can be turned off in configuration.

3. What's Next

1. Simplify MoM workflow: most of intermediate MoM outputs are not necessary any more
2. Build the job scheduler with the new workflow: a timetable for each job
3. Improve DFO data processing: finally, the official document MODIS NRT Global Flood Product