Skip to content
Permalink
Browse files
Added more notebooks
  • Loading branch information
Amanda Tan committed Sep 24, 2021
1 parent 9bd449e commit d3a720ae3df63e2f668d9d68849093f4814c1356
Showing with 3,245 additions and 439 deletions.
  1. +33 −0 .ipynb_checkpoints/intro-checkpoint.md
  2. BIN _build/.doctrees/content/01_intro_to_cloud.doctree
  3. BIN _build/.doctrees/content/{05_best_practices.doctree → best_practices.doctree}
  4. BIN _build/.doctrees/content/{02_is_the_cloud_right.doctree → class_program.doctree}
  5. BIN _build/.doctrees/content/{03_cost_analysis.doctree → cost_analysis.doctree}
  6. BIN _build/.doctrees/content/data_management_plan.doctree
  7. BIN _build/.doctrees/content/example_workflows.doctree
  8. BIN _build/.doctrees/content/intro_to_cloud.doctree
  9. BIN _build/.doctrees/content/is_the_cloud_right.doctree
  10. BIN _build/.doctrees/content/{04_openscience.doctree → openscience.doctree}
  11. BIN _build/.doctrees/content/where_to_find_funds.doctree
  12. BIN _build/.doctrees/content/which_cloud.doctree
  13. BIN _build/.doctrees/environment.pickle
  14. BIN _build/.doctrees/intro.doctree
  15. +1 −1 _build/html/.buildinfo
  16. +0 −50 _build/html/_sources/content/01_intro_to_cloud.ipynb
  17. 0 _build/html/_sources/content/{05_best_practices.ipynb → best_practices.ipynb}
  18. +6 −6 _build/html/_sources/content/{02_is_the_cloud_right.ipynb → class_program.ipynb}
  19. 0 _build/html/_sources/content/{03_cost_analysis.ipynb → cost_analysis.ipynb}
  20. +6 −6 content/02_is_the_cloud_right.ipynb → _build/html/_sources/content/data_management_plan.ipynb
  21. +7 −7 ...yter_execute/content/02_is_the_cloud_right.ipynb → html/_sources/content/example_workflows.ipynb}
  22. +46 −0 _build/html/_sources/content/intro_to_cloud.ipynb
  23. +49 −0 _build/html/_sources/content/is_the_cloud_right.ipynb
  24. 0 _build/html/_sources/content/{04_openscience.ipynb → openscience.ipynb}
  25. +41 −0 _build/html/_sources/content/where_to_find_funds.ipynb
  26. +41 −0 _build/html/_sources/content/which_cloud.ipynb
  27. +21 −8 _build/html/_sources/intro.md
  28. +48 −21 _build/html/content/{05_best_practices.html → best_practices.html}
  29. +52 −30 _build/html/content/{02_is_the_cloud_right.html → class_program.html}
  30. +48 −23 _build/html/content/{03_cost_analysis.html → cost_analysis.html}
  31. +327 −0 _build/html/content/data_management_plan.html
  32. +327 −0 _build/html/content/example_workflows.html
  33. +56 −28 _build/html/content/{01_intro_to_cloud.html → intro_to_cloud.html}
  34. +337 −0 _build/html/content/is_the_cloud_right.html
  35. +52 −27 _build/html/content/{04_openscience.html → openscience.html}
  36. +327 −0 _build/html/content/where_to_find_funds.html
  37. +327 −0 _build/html/content/which_cloud.html
  38. +42 −17 _build/html/genindex.html
  39. +65 −33 _build/html/intro.html
  40. +43 −18 _build/html/markdown.html
  41. BIN _build/html/objects.inv
  42. +42 −17 _build/html/search.html
  43. +1 −1 _build/html/searchindex.js
  44. +0 −50 _build/jupyter_execute/content/01_intro_to_cloud.ipynb
  45. +0 −20 _build/jupyter_execute/content/01_intro_to_cloud.py
  46. +0 −8 _build/jupyter_execute/content/02_is_the_cloud_right.py
  47. 0 _build/jupyter_execute/content/{05_best_practices.ipynb → best_practices.ipynb}
  48. 0 _build/jupyter_execute/content/{05_best_practices.py → best_practices.py}
  49. +41 −0 _build/jupyter_execute/content/class_program.ipynb
  50. +10 −0 _build/jupyter_execute/content/class_program.py
  51. 0 _build/jupyter_execute/content/{03_cost_analysis.ipynb → cost_analysis.ipynb}
  52. 0 _build/jupyter_execute/content/{03_cost_analysis.py → cost_analysis.py}
  53. +41 −0 _build/jupyter_execute/content/data_management_plan.ipynb
  54. +10 −0 _build/jupyter_execute/content/data_management_plan.py
  55. +41 −0 _build/jupyter_execute/content/example_workflows.ipynb
  56. +10 −0 _build/jupyter_execute/content/example_workflows.py
  57. +46 −0 _build/jupyter_execute/content/intro_to_cloud.ipynb
  58. +17 −0 _build/jupyter_execute/content/intro_to_cloud.py
  59. +49 −0 _build/jupyter_execute/content/is_the_cloud_right.ipynb
  60. +20 −0 _build/jupyter_execute/content/is_the_cloud_right.py
  61. 0 _build/jupyter_execute/content/{04_openscience.ipynb → openscience.ipynb}
  62. 0 _build/jupyter_execute/content/{04_openscience.py → openscience.py}
  63. +41 −0 _build/jupyter_execute/content/where_to_find_funds.ipynb
  64. +10 −0 _build/jupyter_execute/content/where_to_find_funds.py
  65. +41 −0 _build/jupyter_execute/content/which_cloud.ipynb
  66. +10 −0 _build/jupyter_execute/content/which_cloud.py
  67. +2 −1 _config.yml
  68. +15 −9 _toc.yml
  69. 0 content/.ipynb_checkpoints/{05_best_practices-checkpoint.ipynb → best_practices-checkpoint.ipynb}
  70. +41 −0 content/.ipynb_checkpoints/class_program-checkpoint.ipynb
  71. 0 content/.ipynb_checkpoints/{03_cost_analysis-checkpoint.ipynb → cost_analysis-checkpoint.ipynb}
  72. 0 ...t/.ipynb_checkpoints/{01_intro_to_cloud-checkpoint.ipynb → data_management_plan-checkpoint.ipynb}
  73. +41 −0 content/.ipynb_checkpoints/example_workflows-checkpoint.ipynb
  74. +46 −0 content/.ipynb_checkpoints/intro_to_cloud-checkpoint.ipynb
  75. 0 ....ipynb_checkpoints/{02_is_the_cloud_right-checkpoint.ipynb → is_the_cloud_right-checkpoint.ipynb}
  76. 0 content/.ipynb_checkpoints/{04_openscience-checkpoint.ipynb → openscience-checkpoint.ipynb}
  77. +6 −0 content/.ipynb_checkpoints/where_to_find_funds-checkpoint.ipynb
  78. +41 −0 content/.ipynb_checkpoints/which_cloud-checkpoint.ipynb
  79. +0 −50 content/01_intro_to_cloud.ipynb
  80. 0 content/{05_best_practices.ipynb → best_practices.ipynb}
  81. +41 −0 content/class_program.ipynb
  82. 0 content/{03_cost_analysis.ipynb → cost_analysis.ipynb}
  83. +41 −0 content/data_management_plan.ipynb
  84. +41 −0 content/example_workflows.ipynb
  85. +46 −0 content/intro_to_cloud.ipynb
  86. +49 −0 content/is_the_cloud_right.ipynb
  87. 0 content/{04_openscience.ipynb → openscience.ipynb}
  88. +41 −0 content/where_to_find_funds.ipynb
  89. +41 −0 content/which_cloud.ipynb
  90. +21 −8 intro.md
@@ -0,0 +1,33 @@
<!-- #region -->
# A Primer to Cloud Computing for Research

This online "book" aims to enable pathways to adoption of cloud computing for research. You will discover how the public cloud can foster innovation, accelerate scientific discovery and learn about best practices for leveraging the cloud.

As a researcher or research facilitator, there are three main considerations in utilizing the cloud for scientific workflows:

**(1) How do I know if my research belongs in the cloud?**

**(2) Which cloud provider and which services should I utilize?**

**(3) How do I estimate costs and resources needed for porting my work to the cloud?**

Whether you are new to the cloud journey or are a seasoned cyberinfrastructure professional looking to communicate and address common concerns faced by researchers, this guide is intended to help you make an informed decision on whether a research workflow belongs in the public cloud, and to demystify some of the more obscure features around cloud adoption.


## Cloud Adoption Framework

```{attention}
Cloud computing is a utility. You pay for the resources that you use!
```

The CLASS Cloud Adoption Framework is a series of documentation, best practices, tutorials, workflows and cloud adoption pathways built by researchers and research and data (RCD) professionals ***for*** researchers and RCD professionals.

## Issues
Please contact class@internet2.edu with issues or questions


Content for this site was put together by the Research Engagement team at Internet2. [Find out more here](https://internet2.edu/community/research-engagement/internet2-research-engagement-team/)!


<!-- #endregion -->
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
BIN +5.01 KB (190%) _build/.doctrees/intro.doctree
Binary file not shown.
@@ -1,4 +1,4 @@
# Sphinx build info version 1
# This file hashes the configuration used when building these files. When it is not found, a full rebuild will be done.
config: 04c13d88eea40c9fbb10e7c5003b91b1
config: 6526d3c866653ffeb0150924af4e4d0d
tags: 645f666f9bcd5a90fca523b33c5a78b7

This file was deleted.

@@ -2,18 +2,18 @@
"cells": [
{
"cell_type": "markdown",
"id": "1b6fcbc0",
"id": "6bf4ef2d",
"metadata": {},
"source": [
"### Is the cloud right for me?\n",
"\n",
"<img src=\"./images/acceleratescience.svg\" width=500>"
"# CLASS Program"
]
},
{
"cell_type": "markdown",
"id": "5e11c0b5",
"cell_type": "code",
"execution_count": null,
"id": "523e395b",
"metadata": {},
"outputs": [],
"source": []
}
],
@@ -2,18 +2,18 @@
"cells": [
{
"cell_type": "markdown",
"id": "1b6fcbc0",
"id": "3070d4d2",
"metadata": {},
"source": [
"### Is the cloud right for me?\n",
"\n",
"<img src=\"./images/acceleratescience.svg\" width=500>"
"# Data Management Considerations"
]
},
{
"cell_type": "markdown",
"id": "5e11c0b5",
"cell_type": "code",
"execution_count": null,
"id": "8dde2cb9",
"metadata": {},
"outputs": [],
"source": []
}
],
@@ -2,18 +2,18 @@
"cells": [
{
"cell_type": "markdown",
"id": "1b6fcbc0",
"id": "da5b9cad",
"metadata": {},
"source": [
"### Is the cloud right for me?\n",
"\n",
"<img src=\"./images/acceleratescience.svg\" width=500>"
"# Cloud Journey Workflows"
]
},
{
"cell_type": "markdown",
"id": "5e11c0b5",
"cell_type": "code",
"execution_count": null,
"id": "7ac2d50e",
"metadata": {},
"outputs": [],
"source": []
}
],
@@ -38,4 +38,4 @@
},
"nbformat": 4,
"nbformat_minor": 5
}
}
@@ -0,0 +1,46 @@
{
"cells": [
{
"cell_type": "markdown",
"id": "90e130db",
"metadata": {},
"source": [
"# Cloud Computing for Research\n",
"\n",
"Cloud computing is an on-demand computing resource that is scalable and follows a pay-as-you-go model. Instead of a singular data center or super-computing center, large cloud providers have data centers spanning multiple locations. The largest cloud computing providers are [Microsoft (Azure)](https://azure.microsoft.com/), [Amazon (Amazon Web Services, AWS)](https://aws.amazon.com/) and [Google (Google Cloud Platform, GCP)](https://cloud.google.com/). Together, they are often referred to as **\"public\"** or **\"commercial\"** cloud providers. \n",
"\n",
"\n",
"For researchers, it is often helpful to be aware of these five key components related to cloud computing infrastructure: \n",
"\n",
"<img src=\"./images/cloudcomponents.svg\" width=600 align=\"center\"><br/> \n",
"\n",
"In contrast to buying your own desktop or laptop computer, a cluster of machines, or with buying external storage devices (such as a RAID, redundant array of independent disks), cloud computing allows you to provision computing and storage on machines that only available to you through an intermediated interface (such as a web-browser or through ssh). \n",
"\n",
"In some sense, cloud computing is akin to computing resources that would you obtain through institutional high-perfomance computing clusters or the National Science Foundation (NSF)-funded platforms such as [XSEDE](https://www.xsede.org/). However, the fundamental difference is that the commercial cloud follows a pay-as-you-go model as opposed to a funding allocation model which you need to apply and be approved for. Commercial cloud providers are also frequently inventing, updating and improving their catalog of services; some researchers may find that the services offered on the commercial cloud can help accelerate their scientific workflows especially when dealing with big data. \n",
"\n",
"We will explore more about the services offered by the public cloud vendors in the next few chapters. "
]
}
],
"metadata": {
"kernelspec": {
"display_name": "Python 3",
"language": "python",
"name": "python3"
},
"language_info": {
"codemirror_mode": {
"name": "ipython",
"version": 3
},
"file_extension": ".py",
"mimetype": "text/x-python",
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.9.5"
}
},
"nbformat": 4,
"nbformat_minor": 5
}
@@ -0,0 +1,49 @@
{
"cells": [
{
"cell_type": "markdown",
"id": "1b6fcbc0",
"metadata": {},
"source": [
"### Is the Cloud Right for Me?\n",
"\n",
"Now that you have an idea of what cloud computing is, the question that is most pertinent to researchers is whether or not you ***should*** move your work to the cloud. The following chart outlines some questions to ask: \n",
"\n",
"<img src=\"./images/acceleratescience.svg\" width=500 align=\"center\"><br/> \n",
"\n",
"Many researchers move to the commercial cloud simply because their local compute resources (local HPC clusters, or departmental clusters) are insufficient to deal with the volume of data and type of computation. With the cloud, there is no wait time to obtain the computing resources you need. With sufficient funds, you may be able to obtain a near infinite number of CPUs, RAM and GPUs. \n",
"\n",
"```{note}\n",
"Scalable computing is the ability to obtain more computers(horizontal scaling) and/or to obtain more powerful computers(vertical scaling)\n",
"```\n",
"\n",
"Other factors that will play in your decision to move to the cloud include knowing where common large datasets are hosted. The core idea in working on the cloud involves a paradigm shift: researchers should no longer bring their data to the compute (i.e. downloading data) but should instead bring their compute to the data! If you think about it, why spend hours on end to download data and find a place to store it when you can work directly with the data? \n",
"\n",
"If your collaborators are already working in the cloud i.e. hosting data on the cloud or building cloud-based workflows, it would also make sense for you to bring your work to the cloud. Go here for more on Open Science and Collaboration. \n",
"\n",
"In the next chapter, we will discuss the million dollar question: \"But which cloud provider should I choose?!\""
]
}
],
"metadata": {
"kernelspec": {
"display_name": "Python 3",
"language": "python",
"name": "python3"
},
"language_info": {
"codemirror_mode": {
"name": "ipython",
"version": 3
},
"file_extension": ".py",
"mimetype": "text/x-python",
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.9.5"
}
},
"nbformat": 4,
"nbformat_minor": 5
}
@@ -0,0 +1,41 @@
{
"cells": [
{
"cell_type": "markdown",
"id": "a71a9499",
"metadata": {},
"source": [
"# Funding Your Cloud Journey"
]
},
{
"cell_type": "code",
"execution_count": null,
"id": "57bc18a6",
"metadata": {},
"outputs": [],
"source": []
}
],
"metadata": {
"kernelspec": {
"display_name": "Python 3",
"language": "python",
"name": "python3"
},
"language_info": {
"codemirror_mode": {
"name": "ipython",
"version": 3
},
"file_extension": ".py",
"mimetype": "text/x-python",
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.9.5"
}
},
"nbformat": 4,
"nbformat_minor": 5
}
@@ -0,0 +1,41 @@
{
"cells": [
{
"cell_type": "markdown",
"id": "dbc2e7e6",
"metadata": {},
"source": [
"# Choosing Cloud Providers"
]
},
{
"cell_type": "code",
"execution_count": null,
"id": "7ff14b2c",
"metadata": {},
"outputs": [],
"source": []
}
],
"metadata": {
"kernelspec": {
"display_name": "Python 3",
"language": "python",
"name": "python3"
},
"language_info": {
"codemirror_mode": {
"name": "ipython",
"version": 3
},
"file_extension": ".py",
"mimetype": "text/x-python",
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.9.5"
}
},
"nbformat": 4,
"nbformat_minor": 5
}
@@ -1,20 +1,33 @@
<!-- #region -->
#### Overview
# A Primer to Cloud Computing for Research

This online "book" aims to enable pathways to adoption of cloud computing for research. You will discover how the public cloud can foster innovation, accelerate scientific discovery and learn about best practices for leveraging the cloud.

As a researcher or research facilitator, there are three main considerations in utilizing the cloud for scientific workflows:

#### Issues
Please contact class@internet2.edu with issues or questions
**(1) How do I know if my research belongs in the cloud?**

Content for this site was put together by the Research Engagement team at Internet2. [Find out more here](https://internet2.edu/community/research-engagement/internet2-research-engagement-team/)!
**(2) Which cloud provider and which services should I utilize?**

**(3) How do I estimate costs and resources needed for porting my work to the cloud?**

<!-- #endregion -->
Whether you are new to the cloud journey or are a seasoned cyberinfrastructure professional looking to communicate and address common concerns faced by researchers, this guide is intended to help you make an informed decision on whether a research workflow belongs in the public cloud, and to demystify some of the more obscure features around cloud adoption.

```python

```
## Cloud Adoption Framework

```python
```{attention}
Cloud computing is a utility. You pay for the resources that you use!
```

The CLASS Cloud Adoption Framework is a series of documentation, best practices, tutorials, workflows and cloud adoption pathways built by researchers and research and data (RCD) professionals ***for*** researchers and RCD professionals.

## Issues
Please contact class@internet2.edu with issues or questions


Content for this site was put together by the Research Engagement team at Internet2. [Find out more here](https://internet2.edu/community/research-engagement/internet2-research-engagement-team/)!


<!-- #endregion -->

0 comments on commit d3a720a

Please sign in to comment.