Could adding iteration's fp as a new system leads to data leakages? #376
Unanswered
dmh1998dmh
asked this question in
Q&A
Replies: 1 comment 1 reply
-
Learning curve not smooth: It's quite common since in a training process, systems are randomly selected and there's no guarantees for the monotonous decrease. |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
When a iteration finished, labelled data will be trained as a seperated system in the next iteration. DPGEN makes only one
set
in02.fp/data.000
folder. Deepmd-kit documents said that deepmd trains mutlisystems one by one and chooses test frames randomly from dataset if there is only oneset
(this case).I am wondering whether there is a data leakage in the new system and models be overfitted to the new system.
A learning lcurve is attached.
The learning lcurve is not smooth, and is it possible sudden changes result from the overfit to addition dataset?
Beta Was this translation helpful? Give feedback.
All reactions