Skip to content

File Transfer#

Several methods are available for transferring data to/from the HPC Cluster. These include Open OnDemand, command-line, and desktop client software. RCC recommends Open OnDemand for all users, especially for remote work.

Open OnDemand#

Open OnDemand is a web portal for using HPC and includes a file management app. For more information, see Open OnDemand Files App.

Command-line#

Several command-line options are available for secure data transfer.

scp#

Secure copy (scp) is a tool for secure data transfer between UNIX-like systems using your MCW username and password. Available on Linux and Mac OS X. All commands should be run from the command-line in a terminal app on your computer.

File to HPC Cluster:

scp local_file user@login-hpc.rcc.mcw.edu:/path/to/remote/target-directory

Directory to HPC Cluster:

scp -r local_directory user@login-hpc.rcc.mcw.edu:/path/to/remote/target-directory

File from HPC Cluster:

scp user@login-hpc.rcc.mcw.edu:/path/to/remote_file /path/to/local/target-directory

Directory from HPC Cluster:

scp -r user@login-hpc.rcc.mcw.edu:/path/to/remote_directory /path/to/local/target-directory

rsync#

Remote sync (rsync) is a fast and secure data transfer tool. Available on Linux and Mac OS X. All commands should be run from the command-line in a terminal app on your computer.

File to HPC Cluster:

rsync -avz local_file user@login-hpc.rcc.mcw.edu:/path/to/target-directory

Directory to HPC Cluster:

rsync -avz local_directory user@login-hpc.rcc.mcw.edu:/path/to/target-directory

File from HPC Cluster:

rsync -avz  user@login-hpc.rcc.mcw.edu:/path/to/remote_file /path/to/local/target-directory

Directory from HPC Cluster:

rsync -avz  user@login-hpc.rcc.mcw.edu:/path/to/remote_directory /path/to/local/target-directory

Desktop Clients#

Several software packages are available for data transfer using the secure file transfer protocol (SFTP).

  • CoreFTP is recommended and licensed by MCW-IS. Use the link to login and search for CoreFTP in the Software section.
  • MobaXterm has a built-in SFTP client.
  • WinSCP is a popular SFTP client for Windows.
  • Cyberduck is a secure data transfer client available for Windows and Mac OS X users.