Merge pull request #74 from andrewdelman/cloud_s3_tutorial

Updates to AWS Cloud tutorial

Author: andrewdelman

ECCO-ACCESS/Cloud_access_to_ECCO_datasets/Tutorial_AWS_Cloud_getting_started.ipynb

@@ -65,7 +65,21 @@
     "sudo dnf update -y && sudo dnf install git -y && cd ~ && git clone https://github.com/ECCO-GROUP/ECCO-v4-Python-Tutorial.git\n",
     "```\n",
     "\n",
-    "Now we will execute a shell script that will set up a conda environment called `jupyter`, and allow the user to input their NASA Earthdata username and password (which are written to the `~/.netrc` file on the instance). Copy, paste, and execute the following two commands on the instance:\n",
+    "Now we will execute a shell script in the Github repository we just cloned, `jupyter_env_setup.sh`. This script handles most of our environment setup, by doing the following:\n",
+    "\n",
+    "1. Installing `wget` (which allows us to download from internet websites)\n",
+    "\n",
+    "1. Installing `tmux` (which allows us to persist tasks on a remote machine even when disconnected).\n",
+    "\n",
+    "1. Downloading `Miniforge.sh` from *conda-forge* which enables us to install `conda` and `mamba` (a faster, C-based `conda`) in the `/tmp` directory.\n",
+    "\n",
+    "1. Creating a new conda environment called `jupyter` that will contain the packages we need to run the notebooks.\n",
+    "\n",
+    "1. Installing Python packages using a combination of `mamba` and `pip` (the latter works better when memory is limited).\n",
+    "\n",
+    "1. Querying the user for their NASA Earthdata username and password (if these are already archived in a `~/.netrc` file this step is skipped).\n",
+    "\n",
+    "To run `jupyter_env_setup.sh`, copy, paste, and execute the following two commands on the instance:\n",
     "\n",
     "```\n",
     "sudo chmod 755 ~/ECCO-v4-Python-Tutorial/Cloud_Setup/jupyter_env_setup.sh && ~/ECCO-v4-Python-Tutorial/Cloud_Setup/jupyter_env_setup.sh\n",
@@ -81,7 +95,7 @@
     "~/jupyter_lab_start.sh\n",
     "```\n",
     "\n",
-    "You will get a prompt for a password (optional), or you can leave it blank and press enter. After this is done (and while still connected to your instance through port 9889), open up a window in your local machine's web browser and put ``http://127.0.0.1:9889/`` or ``http://localhost:9889/`` in the URL field. If you set a password for your session, enter it when prompted. A Jupyter lab should open up in the ECCOv4 tutorial notebook directory, with notebooks ready to run!\n",
+    "You will get a prompt for a password (optional), or you can leave it blank and press enter. After this is done (and while still connected to your instance through port 9889), open up a window in your local machine's web browser and put ``http://127.0.0.1:9889/`` or ``http://localhost:9889/`` in the URL field. If you set a password for your session, enter it when prompted. A Jupyter lab should open up in the ECCOv4 tutorial Github repository on your instance. Go to the **Tutorials_as_Jupyter_Notebooks** directory, and you will see a number of notebooks ready to run! For example, you can access this one at *AWS_Cloud_getting_started.ipynb*.\n",
     "\n",
     "## Reconnecting to your instance and Jupyter lab\n",
     "\n",

Tutorials_as_Jupyter_Notebooks/AWS_Cloud_getting_started.ipynb

@@ -0,0 +1 @@
+../ECCO-ACCESS/Cloud_access_to_ECCO_datasets/Tutorial_AWS_Cloud_getting_started.ipynb

Tutorials_as_Jupyter_Notebooks/Downloading_ECCO_Datasets_from_PODAAC.ipynb

@@ -0,0 +1 @@
+../ECCO-ACCESS/Downloading_ECCO_datasets_from_PODAAC/Tutorial_Python3_Jupyter_Notebook_Downloading_ECCO_Datasets_from_PODAAC.ipynb

Tutorials_as_Jupyter_Notebooks/Downloading_ECCO_Subsets.ipynb

@@ -0,0 +1 @@
+../ECCO-ACCESS/Downloading_ECCO_datasets_from_PODAAC/Tutorial_Python3_Downloading_ECCO_Subsets.ipynb