Transfer to Cluster#
Several methods are available for transferring data to/from the HPC Cluster. These include Open OnDemand, command-line, and desktop client software. RCC recommends Open OnDemand for all users, especially for remote work.
Open OnDemand#
Open OnDemand is a web portal for using HPC and includes a file management app. For more information, see Open OnDemand Files App.
Command-line utilities#
Several command-line options are available for secure data transfer.
scp#
Secure copy (scp) is a tool for secure data transfer between UNIX-like systems using your MCW username and password. Available on Linux and Mac OS X. All commands should be run from the command-line in a terminal app on your computer.
Copy a file to the HPC Cluster:
scp local_file user@login-hpc.rcc.mcw.edu:/path/to/remote/target-directory
Copy a directory to the HPC Cluster:
scp -r local_directory user@login-hpc.rcc.mcw.edu:/path/to/remote/target-directory
Copy a file from the HPC Cluster:
scp user@login-hpc.rcc.mcw.edu:/path/to/remote_file /path/to/local/target-directory
Copy a directory from the HPC Cluster:
scp -r user@login-hpc.rcc.mcw.edu:/path/to/remote_directory /path/to/local/target-directory
rsync#
Remote sync (rsync) is a fast and secure data transfer tool. Available on Linux and Mac OS X. All commands should be run from the command-line in a terminal app on your computer.
Copy a file to the HPC Cluster:
rsync -avz local_file user@login-hpc.rcc.mcw.edu:/path/to/target-directory
Copy a directory to the HPC Cluster:
rsync -avz local_directory user@login-hpc.rcc.mcw.edu:/path/to/target-directory
Copy a file from the HPC Cluster:
rsync -avz user@login-hpc.rcc.mcw.edu:/path/to/remote_file /path/to/local/target-directory
Copy a directory from the HPC Cluster:
rsync -avz user@login-hpc.rcc.mcw.edu:/path/to/remote_directory /path/to/local/target-directory
Desktop clients#
Several software packages are available for data transfer using the secure file transfer protocol (SFTP).