You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We can assume that once a Node has been run and the DVC data is committed, that the data in memory is identical to the data on disk. If we can keep the Node data in memory we get a huge performance increase. We can do so either:
by reusing the Python kernel for the execution of the next Node
use redis / znsocket to store the data accros runs
The text was updated successfully, but these errors were encountered:
We can assume that once a Node has been
run
and the DVC data is committed, that the data in memory is identical to the data on disk. If we can keep the Node data in memory we get a huge performance increase. We can do so either:The text was updated successfully, but these errors were encountered: