This guide provides step-by-step instructions for users migrating their data from the Bonna to Marvin.
⚠️ Please read carefully to ensure a smooth transition.
The cluster Bonna will remain accessible until December 31, 2025.
After this date, access will be discontinued.
We therefore strongly recommend that you begin the migration process as soon as possible.
There is no automatic migration of user accounts or data between the two clusters. Therefore, you will need to apply for access to Marvin.
After your Marvin account has been created, you can begin transferring your data. There are several methods available depending on the size and amount of your data.
scp (Secure Copy)The scp command allows you to securely copy files between the two clusters via SSH.
Example:
# Copy a single file
scp username@bonna.hpc.uni-bonn.de:/path/to/file.txt username@marvin.hpc.uni-bonn.de:/path/to/destination/
# Copy an entire directory (recursively)
scp -r username@bonna.hpc.uni-bonn.de:/path/to/directory/ username@marvin.hpc.uni-bonn.de:/path/to/destination/
rsync (Remote Synchronization)rsync is recommended for larger transfers or when you need to resume interrupted transfers. It efficiently synchronizes directories between clusters by copying only changed or missing files.
Example:
# Basic rsync usage
rsync -avz username@bonna.hpc.uni-bonn.de:/path/to/data/ username@marvin.hpc.uni-bonn.de:/path/to/destination/
# Resume or update an existing transfer
rsync -avz --progress --partial username@bonna.hpc.uni-bonn.de:/path/to/data/ username@marvin.hpc.uni-bonn.de:/path/to/destination/
Tip:
Add the--dry-runflag to preview the files that would be transferred without actually copying them.
sftp (Secure File Transfer Protocol)sftp provides an interactive command-line interface for file transfers. It’s useful when you want to browse directories and transfer files manually.
Example:
# Connect to the old cluster
sftp username@bonna.hpc.uni-bonn.de
# Inside the SFTP prompt:
sftp> cd /path/to/source/
sftp> get file.txt
sftp> lcd /path/to/local/destination/
sftp> put file.txt
sftp> exit
Tip:
You need to script SFTP commands using a slurm job script file for repetitive transfers.
FileZilla or any SFTP client offers a graphical interface for transferring files between clusters. This method is user-friendly and suitable for users who prefer not to use the command line.
Steps:
Open FileZilla.
Connect to the Bonna cluster using your username, password (or SSH key), and hostname.
Connect to the Marvin cluster in another tab or window.
Drag and drop files or directories from the old cluster to the new one.
For very large data, we offer a workspace storage system on Marvin.
Important Note:
All options mentioned above apply when working within your own workspace.