Using scp/rsync/sftp with Unix/Linux

Summary

This article describes the basics of using scp/rsync/sftp to access QRIScloud storage from the Unix or Linux command line.

These protocols are one way of accessing data collections.

Requirements

Unix or Linux command line.
The hostname for the collection.
A user name and password for accessing the collection.

Details

These programs have many features and options. Please read their manual pages for more information.

scp

The secure copy program can be used to transfer files. For example, transferring a local file to QRIScloud storage:

scp test.dat Q99-RW@theCollectionName.qriscloud.qcif.edu.au:test.dat

To recursively copy entire directories, use the "-r" option. For example:

scp sourceDir Q99-RW@theCollectionName.qriscloud.qcif.edu.au:

rsync

Rsync is a versatile file transfer tool. It can determine which files have changed and only transfer the data that has changed without transferring the data that has not changed. It can also be used to list the source files when no destination is supplied.

rsync sourceDir Q99-RW@theCollectionName.qcloud.qcif.edu.au:ris

sftp

sftp is an interactive program for performing file transfers.

To run it in interactive mode:

sftp theCollectionName.qriscloud.qcif.edu.au

Tips

Compression

Use the "-C" option to enable compression. This can speed up transfers involving highly compressible data (e.g. text or CSV files), but can slow down transfers of incompressible data (e.g. video).