Skip to content
Snippets Groups Projects
Commit f1857029 authored by Adam Caprez's avatar Adam Caprez
Browse files

Merge branch 'rclone' into 'master'

More fixes.

See merge request !214
parents b266fbee 56f79669
No related branches found
No related tags found
1 merge request!214More fixes.
...@@ -10,7 +10,7 @@ This tool can be used to transfer files between HCC clusters and outside cloud p ...@@ -10,7 +10,7 @@ This tool can be used to transfer files between HCC clusters and outside cloud p
--- ---
### Setup RClone ### Setup RClone
1. You must be able to access your [UNL Box.com](https://unl.box.com/), [UNK Box.com](https://unk.account.box.com/), [UNO Box.com](https://unomaha.account.box.com/), or [UNMC Box.com](https://unmc.account.box.com/) before beginning this process. Contact your local campus support if you need help with initial account setup. 1. You must be able to access your [UNL Box.com](https://unl.box.com/), [UNK Box.com](https://unk.account.box.com/), [UNO Box.com](https://unomaha.account.box.com/), or [UNMC Box.com](https://unmc.account.box.com/) account before beginning this process. Contact your local campus support if you need help with initial account setup.
2. Due to the clusters being remote machines, **Rclone will need to be installed on your [local machine](https://rclone.org/downloads/) in order to authorize Box**. Some services, such as Google Drive, do not require Rclone to be installed on your local machine. 2. Due to the clusters being remote machines, **Rclone will need to be installed on your [local machine](https://rclone.org/downloads/) in order to authorize Box**. Some services, such as Google Drive, do not require Rclone to be installed on your local machine.
...@@ -28,7 +28,7 @@ This tool can be used to transfer files between HCC clusters and outside cloud p ...@@ -28,7 +28,7 @@ This tool can be used to transfer files between HCC clusters and outside cloud p
{{< /highlight >}} {{< /highlight >}}
{{% /panel %}} {{% /panel %}}
5. In a new configuration, you will see no remotes found. Enter `n` to make a new remote and name it a name you will know. In our example, we will use "MyBox". Select box by entering in the corresponding number, in our case `6`. Hit Enter for the client_id and client_secret and `y` for Edit advanced config. Due to the file size limit with Box, set the upload_cutoff to `15G` and press enter, also leaving the commit_retries as the default by pressing Enter. **When you are prompted for auto config, select `N`**. 5. In a new configuration, you will see no remotes found. Enter `n` to make a new remote and name it a name you will know. In our example, we will use "MyBox". Select box by entering in the corresponding number, in our case `6`. Hit Enter for the client_id and client_secret and `y` for Edit advanced config. Due to the file size limit with Box, set the upload_cutoff to `15G` and press enter, also leaving the commit_retries as the default by pressing Enter. **When you are prompted for auto config, select `N`**. The terminal will stop at a `result>` prompt. Proceed to the next step.
{{% panel theme="info" header="Configure box" %}} {{% panel theme="info" header="Configure box" %}}
{{< highlight bash >}} {{< highlight bash >}}
[demo2@login.crane ~]$ rclone config [demo2@login.crane ~]$ rclone config
...@@ -87,20 +87,52 @@ result> ...@@ -87,20 +87,52 @@ result>
{{< /highlight >}} {{< /highlight >}}
{{% /panel %}} {{% /panel %}}
{{< figure src="/images/BoxSSO.png" height="500" class="img-border">}} {{< figure src="/images/BoxSSO.png" height="500" class="img-border">}}
{{% panel theme="info" header="Local Authorization" %}} {{% panel theme="info" header="Local Authorization after logging in with browser" %}}
{{< highlight script >}} {{< highlight script >}}
[myaccount@local.machine ~]$ rclone authorize "box" [myaccount@local.machine ~]$ rclone authorize "box"
If your browser doesn't open automatically go to the following link: http://127.0.0.1:53682/auth If your browser doesn't open automatically go to the following link: http://127.0.0.1:53682/auth
Log in and authorize Rclone for access Log in and authorize Rclone for access
Waiting for code... Waiting for code...
Got code
Paste the following into your remote machine --->
{"access_token":"XXXX","token_type":"bearer","refresh_token":"XXXX","expiry":"XXXX"}
<---End paste
{{< /highlight >}} {{< /highlight >}}
{{% /panel %}} {{% /panel %}}
For other services, please refer to the [rclone documentation](https://rclone.org/). For other services, please refer to the [rclone documentation](https://rclone.org/).
7. **Returning to the cluster**, now paste the code into the waiting `result` prompt, then press `y` to confirm and `q` to exit.
{{% panel theme="info" header="Authorize Box on cluster" %}}
{{< highlight bash >}}
7. **Returning to the cluster**, test the connection by running the `ls` command. You should see a listing of your Box files. result> {"access_token":"XXXX","token_type":"bearer","refresh_token":"XXXX","expiry":"XXXX"}
--------------------
[Box]
type = box
box_sub_type = user
upload_cutoff = 15G
token = {"access_token":"XXXX","token_type":"bearer","refresh_token":"XXXX","expiry":"XXXX"}
--------------------
y) Yes this is OK
e) Edit this remote
d) Delete this remote
y/e/d> y
Current remotes:
Name Type
==== ====
Box box
e) Edit existing remote
n) New remote
d) Delete remote
r) Rename remote
c) Copy remote
s) Set configuration password
q) Quit config
e/n/d/r/c/s/q> q
{{< /highlight >}}
{{% /panel %}}
Now test the connection by running the `ls` command. You should see a listing of your Box files.
{{% panel theme="info" header="List contents of Box" %}} {{% panel theme="info" header="List contents of Box" %}}
{{< highlight bash >}} {{< highlight bash >}}
[demo2@login.crane ~]$ rclone ls MyBox:/ [demo2@login.crane ~]$ rclone ls MyBox:/
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Please register or to comment