{"id":1743,"date":"2017-11-07T07:36:59","date_gmt":"2017-11-07T12:36:59","guid":{"rendered":"http:\/\/titan.chem.uottawa.ca\/?page_id=1743"},"modified":"2017-11-07T07:45:33","modified_gmt":"2017-11-07T12:45:33","slug":"wooki-cluster-quick-start","status":"publish","type":"page","link":"http:\/\/titan.chem.uottawa.ca\/?page_id=1743","title":{"rendered":"Wooki Cluster Quick Start"},"content":{"rendered":"<h1 id=\"Quickstart_Guide\">Quickstart Guide<\/h1>\n<p class=\"line874\">Wooki is a high performance and high throughput computing facility for the research group of Tom Woo. It has over a thousand CPU cores available located in several racks in the uOttawa Research Data Centre. It is shared with several groups in the department and also used for teaching a number of classes.<span id=\"line-5\" class=\"anchor\"><\/span><span id=\"line-6\" class=\"anchor\"><\/span><\/p>\n<p class=\"line862\">The cluster runs the\u00a0<a class=\"http\" href=\"http:\/\/www.rocksclusters.org\/\">Rocks<\/a>\u00a0distribution of\u00a0<a class=\"http\" href=\"http:\/\/www.centos.org\/\">CentOS 6<\/a>\u00a0Linux. There are several software packages managed centrally including up-to-date compilers for working with your own software developments. Running of jobs is managed by the Gridengine software although we provide a number of convenience scripts for submitting jobs to the queue system. Please familiarise yourself with day-to-day operations in Linux to make the most of the cluster. It is assumed here that you know how to run commands and navigate a filesystem.<span id=\"line-7\" class=\"anchor\"><\/span><span id=\"line-8\" class=\"anchor\"><\/span><\/p>\n<h2 id=\"Logging_in\">Logging in<\/h2>\n<p class=\"line862\">You will need an account to access the facilities. Contact one of the system administrators to set up an account for you. Your username will be you first initial followed by your surname, all in lowercase, i.e. Joe Person -&gt; jperson. If you forget your password you must contact an administrator to reset it for you.<span id=\"line-11\" class=\"anchor\"><\/span><span id=\"line-12\" class=\"anchor\"><\/span><\/p>\n<p class=\"line862\">Access to the frontend is via an SSH client. On Windows systems, we suggest that you download the freely available client\u00a0<a class=\"http\" href=\"http:\/\/www.chiark.greenend.org.uk\/~sgtatham\/putty\/\">PuTTY<\/a>. If you are using a Unix-like machine, you can ssh from the command prompt. To access the cluster\u00a0<tt class=\"backtick\">ssh<\/tt>\u00a0to\u00a0<tt class=\"backtick\">wooki.chem.uolocal<\/tt>\u00a0or directly to the IP address\u00a0<tt class=\"backtick\">172.20.64.12<\/tt>. This is only available on campus or through the VPN, otherwise see\u00a0<a href=\"http:\/\/titan.chem.uottawa.ca\/wiki\/OffCampusAccess\">OffCampusAccess<\/a>.<span id=\"line-13\" class=\"anchor\"><\/span><span id=\"line-14\" class=\"anchor\"><\/span><\/p>\n<p class=\"line874\">After connecting to the machine, you will be prompted for your credentials. Once you have logged in you should change your initial password and make sure that it is only known to you. To change your password, type<span id=\"line-15\" class=\"anchor\"><\/span><\/p>\n<ul>\n<li>$ passwd<span id=\"line-16\" class=\"anchor\"><\/span><span id=\"line-17\" class=\"anchor\"><\/span><\/li>\n<\/ul>\n<p class=\"line874\">You will be prompted for your current password and a new password.<span id=\"line-18\" class=\"anchor\"><\/span><span id=\"line-19\" class=\"anchor\"><\/span><\/p>\n<p class=\"line862\">Wooki is set up to allow X forwarding, and also provides complete graphical login desktops with the NX protocol (see\u00a0<a class=\"http\" href=\"http:\/\/opennx.net\/\">OpenNX<\/a>\u00a0for a client).<span id=\"line-20\" class=\"anchor\"><\/span><span id=\"line-21\" class=\"anchor\"><\/span><\/p>\n<h2 id=\"Data_Storage\">Data Storage<\/h2>\n<p class=\"line862\">Wooki has two distinct data storage areas\u00a0<tt class=\"backtick\">home<\/tt>\u00a0and\u00a0<tt class=\"backtick\">scratch<\/tt>.<span id=\"line-24\" class=\"anchor\"><\/span><span id=\"line-25\" class=\"anchor\"><\/span><\/p>\n<ul>\n<li>\n<p class=\"line891\"><strong><tt class=\"backtick\">\/share\/scratch\/username<\/tt><\/strong>\u00a0is the user&#8217;s working space. This is a fast network storage with no limits on use.\u00a0<strong>You are expected to run the majority of your work from here<\/strong>. This is the most efficient place to work and keeps the cluster and frontend responsive. You will find a symbolic link\u00a0<strong><tt class=\"backtick\">scratch<\/tt><\/strong>\u00a0in your home directory, or you can access it directly. In the future, old files may be deleted but an email warning will be sent to alert the user if this will happen. This space is not backed up.<span id=\"line-26\" class=\"anchor\"><\/span><\/p>\n<\/li>\n<li>\n<p class=\"line891\"><strong><tt class=\"backtick\">\/home\/username<\/tt><\/strong>\u00a0should be used as permanent storage, less intensive processing of files and transfer to and from the cluster. This space is rigorously backed up but has quotas on storage space and number of files. Once your calculations are complete you should move your results to this space taking care to exclude the large intermediate and scratch files. You should use this space for data that you will process interactively on the frontend as it will reduce network traffic. If you have large files or many small files, you can help to keep the cluster running smoothly by\u00a0<tt class=\"backtick\">tar<\/tt>ing and\u00a0<tt class=\"backtick\">gzip<\/tt>ing them into fewer compressed files.<span id=\"line-27\" class=\"anchor\"><\/span><span id=\"line-28\" class=\"anchor\"><\/span><\/p>\n<\/li>\n<\/ul>\n<p class=\"line874\">Additional locations that are useful to know are:<span id=\"line-29\" class=\"anchor\"><\/span><\/p>\n<ul>\n<li>\n<p class=\"line891\"><tt class=\"backtick\">\/state\/partition1<\/tt>\u00a0on a node, this is the local drive.\u00a0<strong>Use this if possible<\/strong>\u00a0as it will be the fastest storage and reduce network traffic.<span id=\"line-30\" class=\"anchor\"><\/span><\/p>\n<\/li>\n<li>\n<p class=\"line891\"><tt class=\"backtick\">\/share\/scratch\/shared<\/tt>\u00a0is also provided as an area that can be used to share or transfer files between users. Very old files in here might be deleted without warning.<span id=\"line-31\" class=\"anchor\"><\/span><\/p>\n<\/li>\n<li>\n<p class=\"line891\"><tt class=\"backtick\">\/share\/apps\/<\/tt>\u00a0is where all the centralised software is located.<span id=\"line-32\" class=\"anchor\"><\/span><span id=\"line-33\" class=\"anchor\"><\/span><span id=\"line-34\" class=\"anchor\"><\/span><\/p>\n<\/li>\n<\/ul>\n<h2 id=\"File_Transfer\">File Transfer<\/h2>\n<p class=\"line862\">Windows users can use programs like\u00a0<a class=\"https\" href=\"https:\/\/filezilla-project.org\/\">FileZilla<\/a>, or\u00a0<a class=\"http\" href=\"http:\/\/winscp.net\/\">WinSCP<\/a>\u00a0for graphical file transfer, see\u00a0<a href=\"http:\/\/titan.chem.uottawa.ca\/wiki\/Wooki\/FileTransfers\">Wooki\/FileTransfers<\/a>\u00a0for more information. On the command line you could also use scp or sftp.<span id=\"line-37\" class=\"anchor\"><\/span><span id=\"line-38\" class=\"anchor\"><\/span><\/p>\n<h2 id=\"Interacting_with_Wooki\">Interacting with Wooki<\/h2>\n<p class=\"line874\">The frontend is intended for managing jobs and files, and not for heavy computing since it manages the queue and many other services including the interactive sessions of all the users. It is, however, a very powerful machine, and for tasks that will take less than 15 minutes of CPU time or for testing is is fine to run these interactively anything longer than that is subject to being killed without notice.<span id=\"line-41\" class=\"anchor\"><\/span><span id=\"line-42\" class=\"anchor\"><\/span><\/p>\n<p class=\"line874\">Any longer or &#8220;heavier&#8221; job must be submitted to the compute hosts via the scheduler, which manages the available resources and assigns them to waiting jobs.<span id=\"line-43\" class=\"anchor\"><\/span><span id=\"line-44\" class=\"anchor\"><\/span><\/p>\n<p class=\"line874\">Please refer to the Wooki\/JobSubmission page for information on how to use the queue and mange jobs, including example job scripts, and Wooki\/CheatSheet for a quick reference of commands.<span id=\"line-45\" class=\"anchor\"><\/span><span id=\"line-46\" class=\"anchor\"><\/span><\/p>\n<h2 id=\"Supported_packages\">Supported packages and Submitting Jobs<\/h2>\n<p class=\"line862\">Wooki has a number of supported software packages. The easiest way to see what is available is to run\u00a0<strong><tt class=\"backtick\">module\u00a0avail<\/tt><\/strong>; modules can be further queried for usage instructions using, for example\u00a0<strong><tt class=\"backtick\">module\u00a0help\u00a0vasp<\/tt><\/strong>\u00a0or\u00a0<strong><tt class=\"backtick\">module\u00a0help\u00a0gaussian<\/tt><\/strong>. If your desired package is not available, please raise a ticket in the support system.<span id=\"line-49\" class=\"anchor\"><\/span><span id=\"line-50\" class=\"anchor\"><\/span><\/p>\n<p class=\"line874\">Most packages will provide usage instructions, and will often have a submission script that will construct an SGE script and submit jobs to the queue.<span id=\"line-51\" class=\"anchor\"><\/span><span id=\"line-52\" class=\"anchor\"><\/span><\/p>\n<p>Here is more detailed information on <a href=\"http:\/\/titan.chem.uottawa.ca\/?page_id=1748\">Submitting Jobs on Wooki<\/a><\/p>\n<h2 id=\"Code_development\">Code development<\/h2>\n<p class=\"line874\">The cluster has recent versions of Intel and GCC compilers for programming in Fortran, C and C++, including the Intel MKL. Shared memory (OpenMP) and message-passing (MPI) parallel programming are supported, but due to the highly heterogeneous nature of the cluster, please consult one of the administrators for information on the best way to run your code, or to set up an effective environment for you.<span id=\"line-55\" class=\"anchor\"><\/span><span id=\"line-56\" class=\"anchor\"><\/span><\/p>\n<p class=\"line874\">Other languages that are standard on Linux are available. Python is very well supported, and includes high performance libraries in the Anaconda distribution, others, such as Java, Perl, are the standard CentOS versions.<span id=\"line-57\" class=\"anchor\"><\/span><span id=\"line-58\" class=\"anchor\"><\/span><span id=\"line-59\" class=\"anchor\"><\/span><\/p>\n<h2 id=\"Reporting_issues\">Reporting issues<\/h2>\n<p class=\"line862\">If you notice any issues, please raise a ticket at\u00a0<a class=\"http\" href=\"http:\/\/titan.chem.uottawa.ca\/otrs\/customer.pl\">http:\/\/titan.chem.uottawa.ca\/otrs\/customer.pl<\/a>\u00a0so that you can keep track of the response and action to your queries. If this does not work for you, you can also email any of the administrators at the bottom of the page.<span id=\"line-62\" class=\"anchor\"><\/span><span id=\"line-63\" class=\"anchor\"><\/span><\/p>\n<h2 id=\"Administrator_Roster\">Administrator Roster<\/h2>\n<ul>\n<li>Tom Burns<span id=\"line-66\" class=\"anchor\"><\/span><\/li>\n<li>\n<p class=\"line862\">Tom Woo &lt;<a class=\"mailto\" href=\"mailto:Tom.Woo@uottawa.ca\">Tom.Woo@uottawa.ca<\/a>&gt;<span id=\"line-67\" class=\"anchor\"><\/span><\/p>\n<\/li>\n<li>Sean Collins<span id=\"line-68\" class=\"anchor\"><\/span><span id=\"line-69\" class=\"anchor\"><\/span><\/li>\n<\/ul>\n<h2 id=\"Footnotes\">Footnotes<\/h2>\n","protected":false},"excerpt":{"rendered":"<p>Quickstart Guide Wooki is a high performance and high throughput computing facility for the research group of Tom Woo. It has over a thousand CPU cores available located in several racks in the uOttawa Research Data Centre. It is shared with several groups in the department and also used for teaching a number of classes. [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-1743","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"http:\/\/titan.chem.uottawa.ca\/index.php?rest_route=\/wp\/v2\/pages\/1743","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/titan.chem.uottawa.ca\/index.php?rest_route=\/wp\/v2\/pages"}],"about":[{"href":"http:\/\/titan.chem.uottawa.ca\/index.php?rest_route=\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"http:\/\/titan.chem.uottawa.ca\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/titan.chem.uottawa.ca\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1743"}],"version-history":[{"count":4,"href":"http:\/\/titan.chem.uottawa.ca\/index.php?rest_route=\/wp\/v2\/pages\/1743\/revisions"}],"predecessor-version":[{"id":1751,"href":"http:\/\/titan.chem.uottawa.ca\/index.php?rest_route=\/wp\/v2\/pages\/1743\/revisions\/1751"}],"wp:attachment":[{"href":"http:\/\/titan.chem.uottawa.ca\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1743"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}