Top Banner
Workstations & Thin Clients 1
29

Workstations & Thin Clients · §They run the same environment as the cluster –RHEL6 –Bash, sbatch, and modules are preconfigured §It’s easier to work with large data sets

May 23, 2020

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Workstations & Thin Clients · §They run the same environment as the cluster –RHEL6 –Bash, sbatch, and modules are preconfigured §It’s easier to work with large data sets

Workstations & Thin Clients

1

Page 2: Workstations & Thin Clients · §They run the same environment as the cluster –RHEL6 –Bash, sbatch, and modules are preconfigured §It’s easier to work with large data sets

§Why use a BioHPC computer?

§System Specs

§Network requirements

§OS Tour

§Running Code Locally

§Submitting Jobs to the Cluster

§Run Graphical Jobs on the Cluster

§Use Windows on a BioHPC system

Overview

2

Page 3: Workstations & Thin Clients · §They run the same environment as the cluster –RHEL6 –Bash, sbatch, and modules are preconfigured §It’s easier to work with large data sets

§They run the same environment as the cluster

–RHEL6

–Bash, sbatch, and modules are preconfigured

§ It’s easier to work with large data sets

–Drag-and-Drop files in the GUI

–You don’t have to use an FTP client or the web interface

Why use a BioHPC system?

3

Page 4: Workstations & Thin Clients · §They run the same environment as the cluster –RHEL6 –Bash, sbatch, and modules are preconfigured §It’s easier to work with large data sets

Dell Optiplex T5810 Series

6 Core Processor

16GB RAM

Nvidia GPU

$2400

Workstations

4

Page 5: Workstations & Thin Clients · §They run the same environment as the cluster –RHEL6 –Bash, sbatch, and modules are preconfigured §It’s easier to work with large data sets

Intel NUC

Quad Core Processor

16GB RAM

$700

Thin Clients

5

Page 6: Workstations & Thin Clients · §They run the same environment as the cluster –RHEL6 –Bash, sbatch, and modules are preconfigured §It’s easier to work with large data sets

§ 10GB Network Card

§ Hardware Rendering

§ Test CUDA on the Nvidia GPU

§ Includes a keyboard and mouse

Comparison

6

§ 1GB Network Connection

§ Software Rendering

§ Requires a keyboard and mouse

Page 7: Workstations & Thin Clients · §They run the same environment as the cluster –RHEL6 –Bash, sbatch, and modules are preconfigured §It’s easier to work with large data sets

Standard 24” MonitorDell P2414H

$300

Monitors

7

Premium 27” IPS DisplayASUS PB278Q

$430+

Page 8: Workstations & Thin Clients · §They run the same environment as the cluster –RHEL6 –Bash, sbatch, and modules are preconfigured §It’s easier to work with large data sets

Network Requirements

8

AllBioHPC systemsrequirea10GBnetworkconnection.

Pricevariesforportinstallationoractivation.

TelecomrequestscanbeplacedinPeopleSoft.AskyourAdministrativeAssistantsforassistance.

IPreservationrequestscanbeplacedhere:https://irrequests.swmed.org/SitePages/IP/IPRequests.aspx

Makesureyouputinthenotesthatyouneeda10GB IPaddress!

Page 9: Workstations & Thin Clients · §They run the same environment as the cluster –RHEL6 –Bash, sbatch, and modules are preconfigured §It’s easier to work with large data sets

§ GUI desktop similar to Windows.

§ Your roaming profile maintains your files and settings on all BioHPC workstations.

GUI Interface

9

RedHat

OSX Windows10

Page 10: Workstations & Thin Clients · §They run the same environment as the cluster –RHEL6 –Bash, sbatch, and modules are preconfigured §It’s easier to work with large data sets

§ You must set the proxy configuration in your profile to access the Internet outside of the UTSW firewall.

System>Preferences>Proxy Setting

§ Prevent folders from opening in separate windows

Edit > Preferences > Click on the “Behavior” tab and check “Always open in browser windows”

Basic Settings

10

Page 11: Workstations & Thin Clients · §They run the same environment as the cluster –RHEL6 –Bash, sbatch, and modules are preconfigured §It’s easier to work with large data sets

§ Create Directory Shortcuts

Create bookmarks to quickly access the project and work folders.

Basic Settings

11

Page 12: Workstations & Thin Clients · §They run the same environment as the cluster –RHEL6 –Bash, sbatch, and modules are preconfigured §It’s easier to work with large data sets

Keyboard Shortcuts

12

Print screen – Prt Sc

Launch terminal – Disabled by default but you can change to Ctrl+T

Paste within terminal – Ctrl+Shift+V

You can change shortcuts under System > Preferences > Keyboard Shortcuts

Page 13: Workstations & Thin Clients · §They run the same environment as the cluster –RHEL6 –Bash, sbatch, and modules are preconfigured §It’s easier to work with large data sets

§Disk Usage Analyzer

Applications > System Tools > Disk Usage Analyzer

Shows the status of your storage quotas.

Remember to empty the trash if you need space.

§System Monitor

Applications > System Tools > System Monitor

The Resources tab shows the load on the CPU and memory. This is useful for monitoring system resources when testing code on a workstation.

System Utilities

13

Page 14: Workstations & Thin Clients · §They run the same environment as the cluster –RHEL6 –Bash, sbatch, and modules are preconfigured §It’s easier to work with large data sets

Storage Quotas

14

View storage usage on the command line

$ biohpc_quota

Need More Space?

Ask your department chair to place a request with BioHPC and include the PI’s name, directory paths and amount of space needed.

Page 15: Workstations & Thin Clients · §They run the same environment as the cluster –RHEL6 –Bash, sbatch, and modules are preconfigured §It’s easier to work with large data sets

Storage Continued

15

Storage Limits

/home2 – 50GB/project and /work – varies depending on department

Hard vs Soft Limit

Soft – Users are notified that they are nearing the limit

Hard – Write requests are denied

Directory Backups

/home2 – Backed up twice (mirror)

/work – Backed up twice (mirror)

/project – Incremental backups

Page 16: Workstations & Thin Clients · §They run the same environment as the cluster –RHEL6 –Bash, sbatch, and modules are preconfigured §It’s easier to work with large data sets

Modules

16

Modules are used to deploy multiple versions of different software tools.

See what modules are available

$ module avail

View loaded modules

$ module list

Load a module

$ module load <name>

Remove a module

$ module rm <name>

Page 17: Workstations & Thin Clients · §They run the same environment as the cluster –RHEL6 –Bash, sbatch, and modules are preconfigured §It’s easier to work with large data sets

Create Your Own Module

17

Working with David.

Page 18: Workstations & Thin Clients · §They run the same environment as the cluster –RHEL6 –Bash, sbatch, and modules are preconfigured §It’s easier to work with large data sets

§ You can not install RPM packages, but you can email [email protected] to request an installation

§ You can install binaries in your home2 directory.

–For example: ./configure –prefix=/home2/username/folder

Applications

18

Page 19: Workstations & Thin Clients · §They run the same environment as the cluster –RHEL6 –Bash, sbatch, and modules are preconfigured §It’s easier to work with large data sets

Script creator on the portal website: https://portal.biohpc.swmed.edu/sbatch/#/script

§ This provides a GUI interface for writing scripts.

§ The same script can be run locally and on the cluster.

Bash vs Sbatch

Scripting

19

Bash Sbatch• RunsLocally• Goodfor testing• Youdon’thavetowaitin

theSLURMqueue

• RunsontheCluster• More powerfulresources• MultipleNodes

Page 20: Workstations & Thin Clients · §They run the same environment as the cluster –RHEL6 –Bash, sbatch, and modules are preconfigured §It’s easier to work with large data sets

Workstations and thin clients come with Bash preconfigured to test scripts before submitting them to the cluster.

§ Run a script on a workstation with bash

§ Check the Output Folder

Run a Job Locally

20

Page 21: Workstations & Thin Clients · §They run the same environment as the cluster –RHEL6 –Bash, sbatch, and modules are preconfigured §It’s easier to work with large data sets

Submit a Job to the Cluster

21

§ Run sbatch

§ Check the queue with the squeue command

§ Check the output folder

Page 22: Workstations & Thin Clients · §They run the same environment as the cluster –RHEL6 –Bash, sbatch, and modules are preconfigured §It’s easier to work with large data sets

§Run a Graphical User Interface on a single HPC cluster node.$ remoteGUI

§Connect to the GUI session with the VNC client.

$ cat remoteGUI.txt

§Run a GUI session that utilizes one of the Nvidia GPUs. Requires SSH.

$ remoteGPU

Remote GUI and GPU

22

Page 23: Workstations & Thin Clients · §They run the same environment as the cluster –RHEL6 –Bash, sbatch, and modules are preconfigured §It’s easier to work with large data sets

Virtual Machines

23

TheBioHPC VirtualBox ImageManagerlet’syoucopyVMstoyourlocalmachine.Workstationshavea384GB limitandThinClientshavea50GB limit.

Page 24: Workstations & Thin Clients · §They run the same environment as the cluster –RHEL6 –Bash, sbatch, and modules are preconfigured §It’s easier to work with large data sets

Windows

24

2013

MountBioHPC Storage

Page 25: Workstations & Thin Clients · §They run the same environment as the cluster –RHEL6 –Bash, sbatch, and modules are preconfigured §It’s easier to work with large data sets

Access BioHPC Storage in Windows

25

Project Home

Page 26: Workstations & Thin Clients · §They run the same environment as the cluster –RHEL6 –Bash, sbatch, and modules are preconfigured §It’s easier to work with large data sets

Virtual Box Settings

26

AdjusttheamountofRAMandnumberofcorestheVMcanutilize.

4GBorRAMand2coresworkswellformostapplications.

Page 27: Workstations & Thin Clients · §They run the same environment as the cluster –RHEL6 –Bash, sbatch, and modules are preconfigured §It’s easier to work with large data sets

Increase Virtual Drive

27

IncreasetheSizeoftheDrive$VBoxManage modifyhd <absolutepathtofile>--resize<sizeinMB>

ExampleIhavea40GBdrivethatIwanttobe45GBthecommandwouldbe.

$VBoxManage modifyhd <absolutepathincludingthenameandextension>--resize46080

YoucannotshrinkaguestdrivewithVirtualBox duetotheinherentdangerofloosingdataormakingtheguestnon-bootable.

Page 28: Workstations & Thin Clients · §They run the same environment as the cluster –RHEL6 –Bash, sbatch, and modules are preconfigured §It’s easier to work with large data sets

Downtime

Downtime for system upgrades will be announced two weeks in advance.

You will not be able to login to workstations or thin clients.

Incompatible Applications

OpenMPI, RDMA, GPU Direct will only work on the cluster

Connect to Nucleus with SSH to submit these jobs.

Power

Leave BioHPC systems powered on at all times, unless instructed otherwise.

Limitations

28

Page 29: Workstations & Thin Clients · §They run the same environment as the cluster –RHEL6 –Bash, sbatch, and modules are preconfigured §It’s easier to work with large data sets

§ https://portal.biohpc.swmed.edu

§ Email the ticket system: [email protected]

For More Information

29