Notes on Google Cloud Platform

This post mainly lists example commands related to working on Google Cloud Platform (GCP)

Install the Google Cloud SDK

Follow instructions on https://cloud.google.com/sdk/

gcloud login

Google Cloud Strage (GCS)

List a bucket

gsutil ls gs://my-bucket/path/to/some/dir

Renaming a file

gsutil mv gs://my-bucket/dir1/file.txt \
          gs://another-bucket/dir2/anothername.txt

Copy files below localhost and GCS bucket

# GCS to local (-r means recursively)
gsutil -m cp -r gs://gs://my-bucket/dir1 .
# local to GCS
gsutil -m cp local_file.txt gs://gs://my-bucket/remote-dir/

Sync directories between localhost and GCS bucket

# -n means dry-run, handy for testing
# -R & -r are synonymous, means synchronising recursively
# argument to -x should be a regular expression used to match the full
# path of files inthe bucket
gsutil rsync \
    -n -R \
    -x '.*\.log$|.*\.html|.*pass2.*' \
    gs://ccle-results .

Google Compute Engine (GCE)

Create an instance

gcloud compute instances create dev \
    --zone "us-central1-a" \
    --boot-disk-size 100GB \
    --image container-vm \
    --scopes cloud-platform,storage-rw,bigquery

Create an instance from snapshot

I have only done it on console, but this seems unrecommended. Based on this page,, Snapshots are more for backup. Use Image instead.

ssh to an instance, assuming the
```
gcloud compute ssh "dev"
```

or ssh to an instance of a specific project in a specific zone

gcloud compute --project "myproject" ssh --zone "us-central1-a" "dev"

Copy files between localhost and an instance

gcloud compute copy-files some_local_file.txt dev:/path/to/target/dir

Google Container Engine (GKE)

Create a container cluster

# machine of type n1-standard-2 has 2 CPUs & 7.5 GB MEM
# --disk-size is in GB
gcloud container clusters create mycluster \
    --num-nodes 3 --machine-type n1-standard-2 --disk-size 200

See here for all machine types

List clusters you’ve created
```
gcloud container clusters list
```

See the detailed description

gcloud container clusters describe mycluster

Passing cluster credentials to kubectl from Kubernetes
```
gcloud container clusters get-credentials mycluster
```

Delete the cluster with CAUTION

gcloud container clusters delete mycluster

Kubernetes

Create a pod/secret/job/service/replication controller/load balancer
```
kubectl create -f config.{yaml, json}
```

Check logs of a pod

# content within $() just extracts the pod name.
kubectl logs $(kubectl get pods  --output=jsonpath={.items..metadata.name})

Accessing Kubernetes UI

Find the server IP, username, password first
```
kubectl config view | grep 'server\|password\|username'
```
Then go the the server IP address in a browser and follow the instruction. More information about UI is available here.

Docker

To see the file size of your containers, you can use the -s argument of docker ps:
```
docker ps -s
```