diff --git a/content/handling_data/data_transfer/using_rclone_with_hcc.md b/content/handling_data/data_transfer/using_rclone_with_hcc.md index 745021ab80dfb58bf3c793479770f6bfaab242d3..54777dd456d552da1309fb8900d5dbce89903ff3 100644 --- a/content/handling_data/data_transfer/using_rclone_with_hcc.md +++ b/content/handling_data/data_transfer/using_rclone_with_hcc.md @@ -10,7 +10,7 @@ This tool can be used to transfer files between HCC clusters and outside cloud p --- ### Setup RClone -1. You must be able to access your [UNL Box.com](https://unl.box.com/), [UNK Box.com](https://unk.account.box.com/), [UNO Box.com](https://unomaha.account.box.com/), or [UNMC Box.com](https://unmc.account.box.com/) before beginning this process. Contact your local campus support if you need help with initial account setup. +1. You must be able to access your [UNL Box.com](https://unl.box.com/), [UNK Box.com](https://unk.account.box.com/), [UNO Box.com](https://unomaha.account.box.com/), or [UNMC Box.com](https://unmc.account.box.com/) account before beginning this process. Contact your local campus support if you need help with initial account setup. 2. Due to the clusters being remote machines, **Rclone will need to be installed on your [local machine](https://rclone.org/downloads/) in order to authorize Box**. Some services, such as Google Drive, do not require Rclone to be installed on your local machine. @@ -28,7 +28,7 @@ This tool can be used to transfer files between HCC clusters and outside cloud p {{< /highlight >}} {{% /panel %}} -5. In a new configuration, you will see no remotes found. Enter `n` to make a new remote and name it a name you will know. In our example, we will use "MyBox". Select box by entering in the corresponding number, in our case `6`. Hit Enter for the client_id and client_secret and `y` for Edit advanced config. Due to the file size limit with Box, set the upload_cutoff to `15G` and press enter, also leaving the commit_retries as the default by pressing Enter. **When you are prompted for auto config, select `N`**. +5. In a new configuration, you will see no remotes found. Enter `n` to make a new remote and name it a name you will know. In our example, we will use "MyBox". Select box by entering in the corresponding number, in our case `6`. Hit Enter for the client_id and client_secret and `y` for Edit advanced config. Due to the file size limit with Box, set the upload_cutoff to `15G` and press enter, also leaving the commit_retries as the default by pressing Enter. **When you are prompted for auto config, select `N`**. The terminal will stop at a `result>` prompt. Proceed to the next step. {{% panel theme="info" header="Configure box" %}} {{< highlight bash >}} [demo2@login.crane ~]$ rclone config @@ -87,20 +87,52 @@ result> {{< /highlight >}} {{% /panel %}} {{< figure src="/images/BoxSSO.png" height="500" class="img-border">}} -{{% panel theme="info" header="Local Authorization" %}} +{{% panel theme="info" header="Local Authorization after logging in with browser" %}} {{< highlight script >}} [myaccount@local.machine ~]$ rclone authorize "box" If your browser doesn't open automatically go to the following link: http://127.0.0.1:53682/auth Log in and authorize Rclone for access Waiting for code... +Got code +Paste the following into your remote machine ---> +{"access_token":"XXXX","token_type":"bearer","refresh_token":"XXXX","expiry":"XXXX"} +<---End paste {{< /highlight >}} {{% /panel %}} For other services, please refer to the [rclone documentation](https://rclone.org/). - - - -7. **Returning to the cluster**, test the connection by running the `ls` command. You should see a listing of your Box files. +7. **Returning to the cluster**, now paste the code into the waiting `result` prompt, then press `y` to confirm and `q` to exit. +{{% panel theme="info" header="Authorize Box on cluster" %}} +{{< highlight bash >}} +result> {"access_token":"XXXX","token_type":"bearer","refresh_token":"XXXX","expiry":"XXXX"} +-------------------- +[Box] +type = box +box_sub_type = user +upload_cutoff = 15G +token = {"access_token":"XXXX","token_type":"bearer","refresh_token":"XXXX","expiry":"XXXX"} +-------------------- +y) Yes this is OK +e) Edit this remote +d) Delete this remote +y/e/d> y +Current remotes: + +Name Type +==== ==== +Box box + +e) Edit existing remote +n) New remote +d) Delete remote +r) Rename remote +c) Copy remote +s) Set configuration password +q) Quit config +e/n/d/r/c/s/q> q +{{< /highlight >}} +{{% /panel %}} +Now test the connection by running the `ls` command. You should see a listing of your Box files. {{% panel theme="info" header="List contents of Box" %}} {{< highlight bash >}} [demo2@login.crane ~]$ rclone ls MyBox:/