FileNotFoundError: [Errno 2] No such file or directory: '/root/csh_nucleation/iter.000000/01.model_devi/graph.001.pb'

[l98y3j26]

Dear developers,

When I run the DPGEN on the Lebesgue, here comes the errors and the param.json and machine.json are attached.
param.txt
machine.txt

Description

2021-08-10 16:12:12,948 - INFO : info:check_all_finished: False
2021-08-10 16:12:21,923 - INFO : job: f11e2ed212f63da8b91d7b8e30e79aaa8c55fadd unsubmitted; submit it
2021-08-10 16:12:21,973 - INFO : job: f11e2ed212f63da8b91d7b8e30e79aaa8c55fadd submit; job_id is 67074
2021-08-10 16:12:21,973 - INFO : job: 7f52bf456664a1b775aa5c5500fc62682660d36e unsubmitted; submit it
2021-08-10 16:12:21,996 - INFO : job: 7f52bf456664a1b775aa5c5500fc62682660d36e submit; job_id is 67075
2021-08-10 16:12:21,996 - INFO : job: e7e85f921028a8fe870064da8bea168c1b846c7a unsubmitted; submit it
2021-08-10 16:12:22,011 - INFO : job: e7e85f921028a8fe870064da8bea168c1b846c7a submit; job_id is 67076
2021-08-10 16:12:22,011 - INFO : job: 1c2d6623c8785cca27cdacd5897ea2d7ebf78c1e unsubmitted; submit it
2021-08-10 16:12:22,035 - INFO : job: 1c2d6623c8785cca27cdacd5897ea2d7ebf78c1e submit; job_id is 67077
INFO:dpgen:-------------------------iter.000000 task 02--------------------------
INFO:dpgen:-------------------------iter.000000 task 03--------------------------
INFO:dpgen:-------------------------iter.000000 task 04--------------------------
2021-08-10 16:16:02,522 - INFO : info:check_all_finished: False
Traceback (most recent call last):
File "/opt/anaconda3/bin/dpgen", line 8, in
sys.exit(main())
File "/opt/anaconda3/lib/python3.8/site-packages/dpgen/main.py", line 175, in main
args.func(args)
File "/opt/anaconda3/lib/python3.8/site-packages/dpgen/generator/run.py", line 2714, in gen_run
run_iter (args.PARAM, args.MACHINE)
File "/opt/anaconda3/lib/python3.8/site-packages/dpgen/generator/run.py", line 2689, in run_iter
run_model_devi (ii, jdata, mdata)
File "/opt/anaconda3/lib/python3.8/site-packages/dpgen/generator/run.py", line 1259, in run_model_devi
submission.run_submission()
File "/opt/anaconda3/lib/python3.8/site-packages/dpdispatcher/submission.py", line 157, in run_submission
self.upload_jobs()
File "/opt/anaconda3/lib/python3.8/site-packages/dpdispatcher/submission.py", line 274, in upload_jobs
self.machine.context.upload(self)
File "/opt/anaconda3/lib/python3.8/site-packages/dpdispatcher/dp_cloud_server_context.py", line 88, in upload
upload_zip = zip_file.zip_file_list(
File "/opt/anaconda3/lib/python3.8/site-packages/dpdispatcher/dpcloudserver/zip_file.py", line 27, in zip_file_list
zip_obj.write(ii, arcname)
File "/opt/anaconda3/lib/python3.8/zipfile.py", line 1741, in write
zinfo = ZipInfo.from_file(filename, arcname,
File "/opt/anaconda3/lib/python3.8/zipfile.py", line 523, in from_file
st = os.stat(filename)
FileNotFoundError: [Errno 2] No such file or directory: '/root/csh_nucleation/iter.000000/01.model_devi/graph.001.pb'

[njzjz]

Can you check if this file exists?

[l98y3j26]

There is no such file. I just use dpgen run parm machine command and later comes this error. Get Outlook for iOS<https://aka.ms/o0ukef>

…

________________________________ From: Jinzhe Zeng ***@***.***> Sent: Wednesday, August 11, 2021 10:40:14 AM To: deepmodeling/deepmd-kit ***@***.***> Cc: l98y3j26 ***@***.***>; Author ***@***.***> Subject: Re: [deepmodeling/deepmd-kit] FileNotFoundError: [Errno 2] No such file or directory: '/root/csh_nucleation/iter.000000/01.model_devi/graph.001.pb' (#947) Can you check if this file exists? — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_deepmodeling_deepmd-2Dkit_discussions_947-23discussioncomment-2D1156718&d=DwMCaQ&c=KXXihdR8fRNGFkKiMQzstu-8MbOxd1NuZkcSBymGmgo&r=8-QNWnBmILXhafCcbdRX058nx-5r9NQfarJlxEbeOh4&m=UgJh8ezsO3zhe7E6E3fHA9Xp5bYzNBwbj46ZVCCyCwk&s=mjDG_qZ6SrdTxEtmDSwEsQqD5k3tuCjyIISvRr768yc&e=>, or unsubscribe<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_notifications_unsubscribe-2Dauth_AUQ4H2BHP2LAW3XV4A5A723T4HPI5ANCNFSM5B5I3ZSQ&d=DwMCaQ&c=KXXihdR8fRNGFkKiMQzstu-8MbOxd1NuZkcSBymGmgo&r=8-QNWnBmILXhafCcbdRX058nx-5r9NQfarJlxEbeOh4&m=UgJh8ezsO3zhe7E6E3fHA9Xp5bYzNBwbj46ZVCCyCwk&s=qQrsgE77We6Bahmvn25fOhVkadYUuDi8jD2HLFG0iGE&e=>. Triage notifications on the go with GitHub Mobile for iOS<https://urldefense.proofpoint.com/v2/url?u=https-3A__apps.apple.com_app_apple-2Dstore_id1477376905-3Fct-3Dnotification-2Demail-26mt-3D8-26pt-3D524675&d=DwMCaQ&c=KXXihdR8fRNGFkKiMQzstu-8MbOxd1NuZkcSBymGmgo&r=8-QNWnBmILXhafCcbdRX058nx-5r9NQfarJlxEbeOh4&m=UgJh8ezsO3zhe7E6E3fHA9Xp5bYzNBwbj46ZVCCyCwk&s=NOR43-xjBoQi-fbd84pGLno4vk-yN7vgQO34zZlpLV4&e=> or Android<https://urldefense.proofpoint.com/v2/url?u=https-3A__play.google.com_store_apps_details-3Fid-3Dcom.github.android-26utm-5Fcampaign-3Dnotification-2Demail&d=DwMCaQ&c=KXXihdR8fRNGFkKiMQzstu-8MbOxd1NuZkcSBymGmgo&r=8-QNWnBmILXhafCcbdRX058nx-5r9NQfarJlxEbeOh4&m=UgJh8ezsO3zhe7E6E3fHA9Xp5bYzNBwbj46ZVCCyCwk&s=SoHrF3TU8WEoW7iwBORWoauVteNJPeHXkOg5js7OZmU&e=>.

[njzjz]

@felix5572 Could you take a look? I think dpdispatcher finishes the submission before the job was finished?

[l98y3j26]

I found the initial data may be incorrect because there is no force information. I use the data from the CP2K. So, what output files should I have to use when i run the dpdata to generate the initial data. There is no introduction about cp2k in dpdata manual. Get Outlook for iOS<https://aka.ms/o0ukef>

…

________________________________ From: Jinzhe Zeng ***@***.***> Sent: Friday, August 13, 2021 7:19:24 AM To: deepmodeling/deepmd-kit ***@***.***> Cc: l98y3j26 ***@***.***>; Author ***@***.***> Subject: Re: [deepmodeling/deepmd-kit] FileNotFoundError: [Errno 2] No such file or directory: '/root/csh_nucleation/iter.000000/01.model_devi/graph.001.pb' (#947) @felix5572<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_felix5572&d=DwMCaQ&c=KXXihdR8fRNGFkKiMQzstu-8MbOxd1NuZkcSBymGmgo&r=8-QNWnBmILXhafCcbdRX058nx-5r9NQfarJlxEbeOh4&m=5TsnTFkqojMMqd2xzpvGS8vdhOkdcrYYVjkOwPmhdKw&s=ku4R7o1P4Z8NJKW_exiAR7GDJohlAKU4pAK8OjRCZAA&e=> Could you take a look? I think dpdispatcher finishes the submission before the job was finished? — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_deepmodeling_deepmd-2Dkit_discussions_947-23discussioncomment-2D1165936&d=DwMCaQ&c=KXXihdR8fRNGFkKiMQzstu-8MbOxd1NuZkcSBymGmgo&r=8-QNWnBmILXhafCcbdRX058nx-5r9NQfarJlxEbeOh4&m=5TsnTFkqojMMqd2xzpvGS8vdhOkdcrYYVjkOwPmhdKw&s=wW_m0kRU35IBmQ_JreTtRAMrz47RuEFGAv4GKB3nb3k&e=>, or unsubscribe<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_notifications_unsubscribe-2Dauth_AUQ4H2GHNUYHEJUPSOAZYELT4RJHZANCNFSM5B5I3ZSQ&d=DwMCaQ&c=KXXihdR8fRNGFkKiMQzstu-8MbOxd1NuZkcSBymGmgo&r=8-QNWnBmILXhafCcbdRX058nx-5r9NQfarJlxEbeOh4&m=5TsnTFkqojMMqd2xzpvGS8vdhOkdcrYYVjkOwPmhdKw&s=Fde9WdDR6X3GsTU-LlwnG-w9R7eMbMJEjMNB2DKUSxE&e=>. Triage notifications on the go with GitHub Mobile for iOS<https://urldefense.proofpoint.com/v2/url?u=https-3A__apps.apple.com_app_apple-2Dstore_id1477376905-3Fct-3Dnotification-2Demail-26mt-3D8-26pt-3D524675&d=DwMCaQ&c=KXXihdR8fRNGFkKiMQzstu-8MbOxd1NuZkcSBymGmgo&r=8-QNWnBmILXhafCcbdRX058nx-5r9NQfarJlxEbeOh4&m=5TsnTFkqojMMqd2xzpvGS8vdhOkdcrYYVjkOwPmhdKw&s=V_oTzmdGkQ2UH9UoJXLUZnfFR8IGpKcKl2et0hUUT84&e=> or Android<https://urldefense.proofpoint.com/v2/url?u=https-3A__play.google.com_store_apps_details-3Fid-3Dcom.github.android-26utm-5Fcampaign-3Dnotification-2Demail&d=DwMCaQ&c=KXXihdR8fRNGFkKiMQzstu-8MbOxd1NuZkcSBymGmgo&r=8-QNWnBmILXhafCcbdRX058nx-5r9NQfarJlxEbeOh4&m=5TsnTFkqojMMqd2xzpvGS8vdhOkdcrYYVjkOwPmhdKw&s=DlHdpgdOEagzJMG8ZBeQWcHN9_hyXrEtcEvcQakLvic&e=>.

[felix5572]

Does the cp2k output files contain force information? @l98y3j26

If they contatin, we could develop on dpata cp2k interface to collect data in these files.
If they don't contain, maybe we could modify cp2k settings to generate output files which contain force information.

[goodluck-xyz]

@l98y3j26 I meet the same question. Can you tell me how to modify the param.json?

[l98y3j26]

The error is there is no such file in that directory. Thus, it may not be attribute to the param.json. 发件人: Wahaha ***@***.***> 发送时间: 2022年8月5日 14:15 收件人: deepmodeling/dpgen ***@***.***> 抄送: l98y3j26 ***@***.***>; Mention ***@***.***> 主题: Re: [deepmodeling/dpgen] FileNotFoundError: [Errno 2] No such file or directory: '/root/csh_nucleation/iter.000000/01.model_devi/graph.001.pb' (Discussion #505) @l98y3j26<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_l98y3j26&d=DwMCaQ&c=KXXihdR8fRNGFkKiMQzstu-8MbOxd1NuZkcSBymGmgo&r=8-QNWnBmILXhafCcbdRX058nx-5r9NQfarJlxEbeOh4&m=qlzfClu8qiG6w1iYF9MZg3OhdbXXY0ElYGL8UKfmEIE&s=0DDpV0BHhPsmnGl6Stt08536wXMlFG55kX4qNKn11_8&e=> I meet the same question. Can you tell me how to modify the param.json? — Reply to this email directly, view it on GitHub<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_deepmodeling_dpgen_discussions_505-23discussioncomment-2D3330728&d=DwMCaQ&c=KXXihdR8fRNGFkKiMQzstu-8MbOxd1NuZkcSBymGmgo&r=8-QNWnBmILXhafCcbdRX058nx-5r9NQfarJlxEbeOh4&m=qlzfClu8qiG6w1iYF9MZg3OhdbXXY0ElYGL8UKfmEIE&s=4v_9Oyn336d6pq1-caT1Fvzs2ysO_FIROyfYna2jIYo&e=>, or unsubscribe<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_notifications_unsubscribe-2Dauth_AUQ4H2D6MP22ADCQVNJQGBTVXSWM7ANCNFSM55U5H2QA&d=DwMCaQ&c=KXXihdR8fRNGFkKiMQzstu-8MbOxd1NuZkcSBymGmgo&r=8-QNWnBmILXhafCcbdRX058nx-5r9NQfarJlxEbeOh4&m=qlzfClu8qiG6w1iYF9MZg3OhdbXXY0ElYGL8UKfmEIE&s=W1exl6JfDDOjM8VQ4Lc5YJxo4CUT2e6xTEPIjJM5ym8&e=>. You are receiving this because you were mentioned.Message ID: ***@***.******@***.***>>