4. Data migration from TSUBAME3.0¶
The following is an example of copying data on TSUBAME3 to TSUBAME4.
All commands below are to be executed on TSUBAME3.
In the example, ux00000 should be read as your TSUBAME4 login name.
- Create SSH key pair on TSUBAME3
$ ssh-keygen -t ecdsa
- Register the created SSH public key to TSUBAME4 portal(Registration)
$ cat ~/.ssh/id_ecdsa.pub
- Confirm that you can SSH from TSUBAME3 to TSUBAME4
$ ssh ux00000@t4-login1 /home/1/ux00000
Note
There are two login nodes for TSUBAME4, which can be accessed from TSUBAME3 by t4-login1 and t4-login2.
-
To move files from TSUBAME3 to TSUBAME4 home directory
$ rsync -az ./dir-to-send ux00000@t4-login1:/home/1/ux00000/dir-to-store
-
When moving files from TSUBAME3 to TSUBAME4 group disk
$ rsync -az ./dir-to-send ux00000@t4-login1:/gs/bs/tgz-XXXXX/dir-to-store
Tips
TSUBAME4.0 group disk includes the high-speed storage area (SSD) and the large-scale (big) storage area. Details are described here.
Tips
If you want to use a non-default SSH key pair, specify the location as below.
$ rsync -az -e 'ssh -i /path/to/key' ./dir-to-send ux00000@t4-login1:/home/1/ux00000/dir-to-store