-
Notifications
You must be signed in to change notification settings - Fork 3
/
TODO.txt
20 lines (16 loc) · 1.04 KB
/
TODO.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
# Air-quality
# Causes:
0. NO issue. All methods are good for the whole model + configuration.
1. 128 neurons/layer model size is too low (lower ceiling: model capability limitation).
2a. 2002 is an outlier year (upper ceiling: max accuracy given data).
2b. 2000-2001 not enough data to learn a moden (upper ceiling: max accuracy given data).
# TODO Remedies:
OK 1. Remedy for cause 1: 128 neurons -> 256 neuros per layer.
OK 2a. Remedy for cause 2a: change test year for 2002, to 2010. Why? Because we know the max accuracy CEILING for this TEST year (from previous full model runs). It is higher for sure than the one found in 2002.
2b. Remedy for cause 2b: add extra 1 training year (OK) + 1 fold (to 4) NOT done. So from 2 years training (2000-2001) -> 3 years training (2007-2009).
# Extras TODO:
TODO 1. Store best TEST error full models also (both best-so-far min Test MSE as pickle & model weights).
OK 2. Store MASE to CSV also.
3. Try synthetic SysID data generation:
a. Linear Sys Id with additive noise.
b. Linear Sys Id with multiplicative noise.