Skip to content

Commit

Permalink
GCP runthrough edits.
Browse files Browse the repository at this point in the history
  • Loading branch information
tmiddelkoop committed Jan 10, 2022
1 parent e08b9b4 commit 92694ba
Show file tree
Hide file tree
Showing 4 changed files with 19 additions and 22 deletions.
16 changes: 8 additions & 8 deletions content/GCP/02_intro_to_compute.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -75,9 +75,8 @@
" * For **Machine type** select *e2-medium* (default). Note that it shows the size of the VM in parentheses. \n",
" * In the **Identity and API access** section note that for the **Service Accounts** -> **Service account** option that the **Compute Engine default service account** is selected. This allows the *VM Instance* to access resources in the project. Note: the *\"Allow full access to all Cloud APIs\"* allows *everyone* on the VM to *access and edit all resources in the project*.\n",
" * Leave the remaining options as default.\n",
" * Note the **Monthly estimate** in the right side panel. This is only for running the *VM instance* and does not include other storage, networking, compute, and other charges that may occur by running software. Click **Details** show a breakdown of the *VM instance* only costs.\n",
" * Finally, click **Create** to create the *VM Instance* (allocate the resource).\n",
" "
" * Note the **Monthly estimate** in the right side panel. This is only for running the *VM instance* and does not include other storage, networking, compute, and other charges that may occur by running software. Click **Details** show a breakdown of the *VM instance* only costs. **Exercise:** Find the most expensive VM.\n",
" * Finally, click **Create** to create the *VM Instance* (allocate the resource).\n"
]
},
{
Expand Down Expand Up @@ -114,9 +113,10 @@
" * Navigate to the project **Dashboard** by clicking on \"Google Cloud Platform\" on the left side of the top blue bar.\n",
" * Select **Activity** tab just below the top blue bar.\n",
" * Look for the row with **Create VM** on the top of the table. This shows that the *VM Instance* was created.\n",
" * Expand the detail by clicking the **down arrow** on the right side of the row. You can see what identity created the bucket and the name. The rest of the information details the initial settings that you configured when creating the bucket. The details are not really important at this time, just know they exist.\n",
" * Expand the detail by clicking the **down arrow** on the right side of the row. You can see what identity created the bucket and the name. The rest of the information details the initial settings that you configured when creating the virtual machine. The details are not really important at this time, just know they exist.\n",
" * By default, this information cannot be deleted for security and auditing reasons.\n",
"\n",
"Note that the activity is on the project, not the account.\n"
"Note: that the activity is on the project, not on your account.\n"
]
},
{
Expand All @@ -128,12 +128,12 @@
"source": [
"## Enumerate the VM Instances\n",
"\n",
"To see an overview of resources in the project navigate to the **dashboard** and you will now see at least **1 instance** in the *resources* card under *Compute Engine*.\n",
"\n",
"Now lets find and connect to the *VM Instance*.\n",
" * Navigate to the Google Compute Engine page by clicking **Navigation Menu** -> **Compute Engine** (under Compute) -> **Instances**.\n",
" * **Find** the *VM instance* you just created. You can use the filter to find a bucket if there are a lot of them.\n",
" * Click on the *VM instance* name to open the **VM instance details** (it will display as a hyperlink when you hover over the *VM instance* name)."
" * Click on the *VM instance* name to open the **VM instance details** (it will display as a hyperlink when you hover over the *VM instance* name).\n",
"\n",
"Navigate to the **dashboard** and you will see **Compute Engine** in the *resources* card. You can click on this to quickly navigate to the compute engine page.\n"
]
},
{
Expand Down
19 changes: 8 additions & 11 deletions content/GCP/03_intro_to_cloud_storage.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -33,8 +33,6 @@
"id": "9897048a-6aa8-4d85-a557-d85b802f3f1d",
"metadata": {},
"source": [
"Drew, after working with a Research Computing and Data (RCD) facilitator, has decided to start their cloud journey with storage. Data is usually the center of a research project and it makes sense to start here.\n",
"\n",
"One of the most common and economic ways to store data in the cloud is to use object storage. In GCP object storage is called *Google Cloud Storage*, which is similar to the Simple Storage Service, also known as S3, on Amazon Web Services (AWS). For object storage, information is stored as a collection of key-value pairs."
]
},
Expand All @@ -47,8 +45,6 @@
"source": [
"## Google Cloud Storage\n",
"\n",
"To learn more about the Google Cloud Storage service we will use the web console to create, explore, and destroy a Bucket. The ability to quickly create, explore, and then discard resources in the web-console is a powerful tool to explore a service. After an initial exploration with the web-console, programmatic access using scripts and programming languages should be used.\n",
"\n",
"Unfortunately, the terminology used for object storage differs from one commercial cloud provider to another. Google Cloud Storage uses the terms Bucket and Object. Data is stored in Objects and Objects are stored in Buckets. Objects (data) are stored as a key-value pair, which is similar to a Python dictionary but persistent. Values are stored and retrieved using a unique key and the value can contain any information (more on this later).\n",
"\n",
"We now take Drew through the process of creating a Google Cloud Storage bucket."
Expand All @@ -69,7 +65,7 @@
"\n",
"*Note: There is a powerful filter box to limit the permissions shown.*\n",
"\n",
"You should see a row with your account shown in the Principal column. Here you should see the \"Owner\" Role in the Role column. A *role* is a collection of permissions managed by Google or someone else. The **Owner** or the **Storage Admin** role for a project will *allow* *you* to create, access, and delete Buckets *in* the project.\n",
"You should see a row with your account shown in the Principal column. Here you should see the \"Editor\" Role in the Role column. A *role* is a collection of permissions managed by Google or someone else. The **Editor**, **Owner**, or the **Storage Admin** role for a project will *allow* *you* to create, access, and delete Buckets *in* the project.\n",
"\n",
"There are three important pieces of information that work together to form the **IAM policy**. The permission (role), the identity (principal or member), and the resource (project)."
]
Expand Down Expand Up @@ -102,7 +98,7 @@
" * Under *Access Control* Select **Uniform** (default). *Uniform* permissions are on the entire Bucket. *Fine-grained* permissions are on the objects.\n",
" * Select **Continue**\n",
" * Note the **monthly cost estimate** in the right side panel. This is only for reading, writing, and storing data and does not include networking, compute, and other charges that may occur by using the data.\n",
" * *Storage size* is the total amount of data stored.\n",
" * *Storage size* is the total amount of data stored. **Exercise:** Enter 1000 in the storage size box to see how much a TB costs per month.\n",
" * *Data Retrieval* is only used for for long-term, non *standard*, storage.\n",
" * *Operations* is the number of \"operations\" performed on an object, for example reading and writing an object. Storing and accessing many objects require many operations.\n",
" * Finally, click **Create** to create the bucket (allocate the resource).\n",
Expand All @@ -118,7 +114,7 @@
"source": [
"## Follow the Storage Allocation\n",
"\n",
"Just as with security, we will audit (follow) the bucket creation by examining at the project *activity*.\n",
"Just as with compute, we will audit (follow) the bucket creation by examining at the project *activity*.\n",
"\n",
"To view the project activity we do the following:\n",
"\n",
Expand All @@ -145,7 +141,7 @@
" * **Find** the bucket you just created. You can use the filter to find a bucket if there are a lot of them.\n",
" * Click on the bucket name to open the **bucket details** (it will display as a hyperlink when you hover over the bucket name).\n",
"\n",
"Navigate to the **dashboard** and you will now see at least **1 bucket** in the *resources* card under storage."
"Navigate to the **dashboard** and you will now see \"Storage\" in the *resources* card under. You can click on this to quickly navigate to the storage page."
]
},
{
Expand Down Expand Up @@ -189,16 +185,17 @@
"source": [
"## Discussion\n",
"\n",
"* What does the words \"Secure\", \"Allocate\", \"Follow\", and \"Enumerate\" Spell?\n",
"* Why do you think we use this framework?"
"* What does the words \"Secure\", \"Allocate\", \"Follow\", and \"Enumerate\" spell?\n",
"* What happens when you add the \"R\" in \"Review?\"\n",
"* Is this useful?"
]
},
{
"cell_type": "markdown",
"id": "97d7ebc5-4a81-4f1a-aaf3-517adf70640a",
"metadata": {},
"source": [
"## Resources in Google Cloud Platform - Optional\n",
"## Resources in Google Cloud Platform - Review\n",
"\n",
"Even though we only covered the Google Cloud Storage service in this episode, this process can be used for other *resources* allocated in the cloud. The term *resource* is used for the \"things\" that live in a Project, such as compute, storage, and networking and other services. Resources have the following characteristics:\n",
"\n",
Expand Down
2 changes: 1 addition & 1 deletion content/GCP/07_monitoring_costs.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@
"* Find where to set Billing Alerts.\n",
"* List all resources in a Project\n",
"* List resources in a service\n",
"* Understand how labels are used\n",
"* Optional: Understand how labels are used\n",
" \n",
"```"
]
Expand Down
4 changes: 2 additions & 2 deletions content/intro_to_cloud.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -70,7 +70,7 @@
],
"metadata": {
"kernelspec": {
"display_name": "Python 3",
"display_name": "Python 3 (ipykernel)",
"language": "python",
"name": "python3"
},
Expand All @@ -84,7 +84,7 @@
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.9.5"
"version": "3.7.3"
}
},
"nbformat": 4,
Expand Down

0 comments on commit 92694ba

Please sign in to comment.