Skip to content

Commit

Permalink
Merge pull request #72 from Ashan-Wimalasiri/main
Browse files Browse the repository at this point in the history
update for Requesting/managing project storage on Peradeniya Servers and Use Jupyter Notebook on Kepler/Turing Servers
  • Loading branch information
Ashan-Wimalasiri authored Nov 11, 2023
2 parents c0db268 + 4000b55 commit 75b7b43
Show file tree
Hide file tree
Showing 3 changed files with 100 additions and 0 deletions.
59 changes: 59 additions & 0 deletions faq/network-n-servers/0_general_questions.html
Original file line number Diff line number Diff line change
Expand Up @@ -244,4 +244,63 @@
</li>
</ol>
</div>
</div>


<!-- 7 -->
<p>
<button class="btn btn-light" type="button" data-bs-toggle="collapse" data-bs-target="#collapse7"
aria-expanded="false" aria-controls="collapseExample">
Requesting/managing project storage on Peradeniya Servers
</button>
</p>
<div class="collapse multi-collapse" id="collapse7">
<div class="card card-body">
<p>
Individual students have their storage as babbage.ce.pdn.ac.lk:/home/e14000 [Not really, but don't worry].
This storage is mounted to the same location to every other server (aiken, tesla, kepler, turing, new HP server) through network interfaces.
However, you can request additional storage for your projects on individual servers. This storage is usually faster than babbage.
</p>
<br>
<p>Make a post on <b>#ask-for-help</b>on <b>#PeraCOM</b>Discord with the following information.</p>

<ol>
<li>Which server do you need this folder to be created on?</li>
<li>Project name (This should follow the cepdnaclk github repo naming convention. E.g. e14-co542-deep-learning, e15-4yp-object-detection, pg-deepselectnet).</li>
<li>E numbers of the project group (this can be one or more students).If you are a postgrad student, your aiken/tesla username is your “e number”.</li>
<li>Endorsing academic staff member (this can be the course coordinator or the project adviser).</li>
</ol>

<p>
We will create a unix group and a folder with chmod 770 permission on the server.
We will update this information on the “Server groups, folders, and datasets” Google sheet on this <a href="https://www.cs.umd.edu/~gihan/resources/pdn-hpc/">web page</a>.
</p>

<p>
Please note that every folder comes with an expiry date.
Check the date on the Google sheet and make sure that your endorsing academic staff member sends a time extension request
(e.g. “extend the expiration date of kepler:/e14-4yp-explainable-ml by 6 months”) to
<a href="webmaster.github.ce@eng.pdn.ac.lk">webmaster.github.ce@eng.pdn.ac.lk</a> when it is close to the expiry date.
</p>

<p>
<b>Note:</b>
<ul>
<li>
We (server admins) are not very strict/stingy about giving project storage.
We won't come and ask you “Why do you need 500GB on a GPU server for a CO222 project?”.
Also, we might not even go and ask the endorsing staff member if they actually endorsed your project.
<br>
We want you to use the resources and learn HPC. Our objective is not to gatekeep resources.
</li>
<li>
If you are not on Discord please ask for an invitation from
<br>
<a href="https://faq.ce.pdn.ac.lk/peracom/discord/">https://faq.ce.pdn.ac.lk/peracom/discord/</a> or email <br>
<a href="https://people.ce.pdn.ac.lk/students/e17/154/">https://people.ce.pdn.ac.lk/students/e17/154/</a> or <br>
<a href="https://people.ce.pdn.ac.lk/students/e16/088/">https://people.ce.pdn.ac.lk/students/e16/088/</a>
</li>
</ul>
</p>
</div>
</div>
40 changes: 40 additions & 0 deletions faq/network-n-servers/6_use_jupyter_notebook.html
Original file line number Diff line number Diff line change
@@ -0,0 +1,40 @@
---
layout: QA_page
permalink: "/network-n-servers/Use-Jupyter-Notebook-on-Kepler-Turing-Servers/"

parent: "Network and Servers"
title: "Use Jupyter Notebook on Kepler/Turing Servers"
index: 6
author: "Ashan"

github: faq/network-n-servers/6_use_jupyter_notebook.html
---

<div class="container py-3">
<p>For this example, we use Turing. You can do the same thing on kepler.</p>

<ol>
<li>SSH to Tesla</li>
<li>SSH to Turing from Tesla</li>
<li>Create a conda environment on Turing and activate it. <br><a href="https://www.cs.umd.edu/~gihan/resources/pdn-hpc/">(https://www.cs.umd.edu/~gihan/resources/pdn-hpc/)</a></li>
<li><b>conda install jupyter</b></li>
<li><b>jupyter notebook --no-browser --port=8889 --ip=0.0.0.0</b></li>
<li>You will see a token. Copy it.</li>
</ol>

<br>

<p>Open WSL on your windows computer (or the Terminal on Linux/Mac)</p>
<ol>
<li><b>ssh -N -f -L localhost:8888:turing.ce.pdn.ac.lk:8889 e14158@tesla.ce.pdn.ac.lk</b></li>
</ol>

<p>Now, open google chrome and go to http://localhost:8888</p>
<br>
<p>
If you have questions about anything, please try to ask them on the <b>PeraCOM Discord #ask-for-help</b> channel.
That is helpful to the community as a whole.
If you are not already on the discord,
please ask for an invitation from (e17154@eng.pdn.ac.lk and e16088@eng.pdn.ac.lk)
</p>
</div>
1 change: 1 addition & 0 deletions faq/network-n-servers/network_n_servers.html
Original file line number Diff line number Diff line change
Expand Up @@ -15,6 +15,7 @@
<li><a href="./connect-to-fpga-license-server/">Connect to FPGA License Server through VPN</a></li>
<li><a href="./connect-to-fpga-license-server-through-ssh-tunnel/">Connect to FPGA License Server through a SSH
Tunnel</a></li>
<li><a href="./Use-Jupyter-Notebook-on-Kepler-Turing-Servers/">Use Jupyter Notebook on Kepler/Turing Servers</a></li>
</ul>

<ul>
Expand Down

0 comments on commit 75b7b43

Please sign in to comment.