Data transfer and Research Data Storage with High Performance Computing: Glossary

Key Points

Data transfer and RDS for HPC
  • Recall the difference between Classic and RCOS and nextgen RDS

  • Recall how to connect to Artemis HPC

Transfer from LOCAL to Artemis HPC
  • Use scp

  • Use GUI like Filezilla

Transfer from WEB to Artemis HPC
  • Use wget

  • Recall batch submission on Artemis

  • Use the dedicated data transfer queue, dtq

Transfer between remote RDS and Artemis HPC
  • Use cp, mv, rsync

  • Use dt-scripts

  • Use -W depend flags

  • Connect from local to RDS

Mounting RDS on your system
  • Map a local network mount

Summary and other Data Storage options
  • Lots of tools and ways to interface HPC/RDS

  • Use whatever works for you!

BONUS: transfer with SMB to the Classic RDS
  • Use smbclient to move to windows-based protocols.

Glossary

FIXME