LandSat tutorial for Essentials

General data mananagement for landsat using native GCP tools.

https://cloud.google.com/storage/docs/public-datasets/landsat

Modeling after the Drew use-case.

https://www.pnas.org/content/118/15/e2021219118#sec-6

Stage Zero

Drew has identified the products by hand and manually downloaded the data files.

Stage One

Access data via command line tools. Get the index and view.

mkdir -v data
gsutil ls gs://gcp-public-data-landsat
gsutil cp gs://gcp-public-data-landsat/index.csv.gz data/
gzip -d data/index.csv.gz

Stage Three

Automate (2m to download and decompress)

gcloud compute ssh instance-1
sudo apt install --yes git
git clone https://github.internet2.edu/CLASS/CLASS-Examples.git
cd CLASS-Examples/landsat/
bash get-index.sh
cat data/index.csv | python3 search.py | bash download.sh

Analysis

sudo apt-get install python3-rasterio
install -dv output/
python3 process_sat.py