Deleting a Greenplum Cluster

Deleting Greenplum Pods and Resources
Deleting Greenplum Persistent Volume Claims
Deleting Greenplum Operator

This section describes how to delete the pods and other resources that are created when you deploy a Greenplum cluster to Kubernetes. Note that deleting these cluster resources does not automatically delete the Persistenv Volume Claims (PVCs) that the cluster used to stored data. This enables you to re-deploy the same cluster at a later time, to pick up where you left off. You can optionally delete the PVCs if you to create an entirely new (empty) cluster at a later time.

Deleting Greenplum Pods and Resources

Follow these steps to delete the Greenplum pods, services, and other objects, leaving the Persistent Volumes intact:

Navigate to the workspace directory of the Pivotal Greenplum distribution (or to the location of the Kubernetes manifest that you used to deploy the cluster). For example:
```
$ cd ./greenplum-for-kubernetes-*/workspace
```
Execute the kubectl delete command, specifying the manifest that you used to deploy the cluster. For example:
```
$ kubectl delete -f ./my-gp-instance.yaml --wait=false
```
kubectl stops the Pivotal Greenplum instance and deletes the Kubernetes resources for the Greenplum deployment.

Note: Use the optional --wait=false flag to return immediately without waiting for the deletion to complete.

Use kubectl to describe the Greenplum cluster to verify Status.Phase and Events:

$ kubectl describe greenplumcluster my-greenplum
 [...]
 Status:
   Instance Image:    greenplum-for-kubernetes:latest
   Operator Version:  greenplum-operator:latest
   Phase:             Deleting
 Events:
   Type    Reason                    Age   From               Message
   ----    ------                    ----  ----               -------
   Normal  CreatingGreenplumCluster  3m    greenplumOperator  Creating Greenplum cluster my-greenplum in default
   Normal  CreatedGreenplumCluster   1m    greenplumOperator  Successfully created Greenplum cluster my-greenplum in default
   Normal  DeletingGreenplumCluster  6s    greenplumOperator  Deleting Greenplum cluster my-greenplum in default

If for any reason stopping the Greenplum instance fails, you should see a warning message in the greenplum-operator logs as shown below:

$ kubectl logs -l app=greenplum-operator
[...]
{"level":"INFO","ts":"2020-01-24T19:03:22.874Z","logger":"controllers.GreenplumCluster","msg":"DeletingGreenplumCluster","name":"my-greenplum","namespace":"default"}
{"level":"INFO","ts":"2020-01-24T19:03:23.068Z","logger":"controllers.GreenplumCluster","msg":"initiating shutdown of the greenplum cluster"}
{"level":"INFO","ts":"2020-01-24T19:03:31.971Z","logger":"controllers.GreenplumCluster","msg":"gpstop did not stop cleanly. Please check gpAdminLogs for more info."}
[...]
{"level":"INFO","ts":"2020-01-24T19:03:32.252Z","logger":"controllers.GreenplumCluster","msg":"DeletedGreenplumCluster","name":"my-greenplum","namespace":"default"}

However, the Greenplum instance still gets deleted and all associated resources get cleaned up.

Use kubectl to monitor the progress of terminating Greenplum resources in your cluster. For example, if your cluster deployment was named my-greenplum:

$ kubectl get all -l greenplum-cluster=my-greenplum

NAME                                     READY     STATUS        RESTARTS   AGE
pod/greenplum-operator-7b5ddcb79-vnwvc   1/1       Running       0          9m
pod/master-0                             0/1       Terminating   0          5m
pod/segment-a-0                          0/1       Terminating   0          5m
pod/segment-a-1                          0/1       Terminating   0          5m
pod/segment-b-0                          0/1       Terminating   0          5m

NAME                 TYPE        CLUSTER-IP   EXTERNAL-IP   PORT(S)   AGE
service/kubernetes   ClusterIP   10.96.0.1    <none>        443/TCP   26m

NAME                                 DESIRED   CURRENT   UP-TO-DATE   AVAILABLE   AGE
deployment.apps/greenplum-operator   1         1         1            1           9m

NAME                                           DESIRED   CURRENT   READY     AGE
replicaset.apps/greenplum-operator-7b5ddcb79   1         1         1         9m

The deletion process is complete when the segment pods are no longer available (and no resources remain):

$ kubectl get all -l greenplum-cluster=my-greenplum

No resources found in default namespace.

If the Kubernetes resources remain and do not enter the “Terminating” status after 5 minutes, check the operator logs for error messages. bash $ kubectl logs -l app=greenplum-operator

The Greenplum Operator should remain for future deployments:

$ kubectl get all

NAME                                      READY   STATUS    RESTARTS   AGE
pod/greenplum-operator-6ff95b6b79-kq9vr   1/1     Running   0          68m

NAME                                                            TYPE        CLUSTER-IP      EXTERNAL-IP   PORT(S)   AGE
service/greenplum-validating-webhook-service-6ff95b6b79-kq9vr   ClusterIP   10.106.60.103   <none>        443/TCP   68m
service/kubernetes                                              ClusterIP   10.96.0.1       <none>        443/TCP   72m

NAME                                 READY   UP-TO-DATE   AVAILABLE   AGE
deployment.apps/greenplum-operator   1/1     1            1           68m

NAME                                            DESIRED   CURRENT   READY   AGE
replicaset.apps/greenplum-operator-6ff95b6b79   1         1         1       68m

Deleting Greenplum Persistent Volume Claims

Deleting the Greenplum pods and other resources does not delete the associated persistent volume claims that were created for it. This is expected behavior for a Kubernetes cluster, as it gives you the opportunity to access or back up the data. If you no longer have any use for the Greenplum volumes (for example, if you want to install a brand new cluster), then follow this procedure to delete the Persistent Volume Claims (PVCs) and Persistent Volumes (PVs).

You may also need to delete Greenplum PVCs if you want to change the storage size or deploy an existing cluster to a different storage class; the Greenplum Operator maintains an association between the cluster name and its PVCs, so you cannot redeploy a cluster to a different storage class or change the storage size without first deleting both the cluster deployment and its PVCs.

Caution: If the Persistent Volumes were created using dynamic provisioning, then deleting the PVCs will also delete the associated PVs. In this case, do not delete the PVCs unless you are certain that you no longer need the data.

Verify that the PVCs are present for your cluster. For example, to show the Persistent Volume Claims created for a cluster named my-greenplum:

$ kubectl get pvc -l greenplum-cluster=my-greenplum

NAME                              STATUS   VOLUME                                     CAPACITY   ACCESS MODES   STORAGECLASS   AGE
my-greenplum-pgdata-master-0      Bound    pvc-5f7efa56-671b-470c-8a96-9b876e5c6207   1G         RWO            standard       51m
my-greenplum-pgdata-segment-a-0   Bound    pvc-7611d47e-e125-4a43-b017-631721c63cec   2G         RWO            standard       51m
my-greenplum-pgdata-segment-a-1   Bound    pvc-0ef8c1cc-3d23-4e56-9a07-892d9878f758   2G         RWO            standard       8m52s
my-greenplum-pgdata-segment-a-2   Bound    pvc-9a793fd7-8e00-4180-b377-3aaefffbeed3   2G         RWO            standard       8m52s
my-greenplum-pgdata-segment-a-3   Bound    pvc-131cb849-5d2e-4a08-a906-4eebc34de8ea   2G         RWO            standard       8m52s
my-greenplum-pgdata-segment-a-4   Bound    pvc-9a2c4772-4af1-49b1-956e-919e939ffb7c   2G         RWO            standard       8m52s
my-greenplum-pgdata-segment-a-5   Bound    pvc-7dd51842-b1bc-4eb8-9e25-7ba75da1836a   2G         RWO            standard       8m52s

Use kubectl to delete the PVCs associated with the cluster. For example, to delete all PersistentVolume Claims created for a cluster named my-greenplum:

$ kubectl delete pvc -l greenplum-cluster=my-greenplum

persistentvolumeclaim "my-greenplum-pgdata-master-0" deleted
persistentvolumeclaim "my-greenplum-pgdata-segment-a-0" deleted
persistentvolumeclaim "my-greenplum-pgdata-segment-a-1" deleted
persistentvolumeclaim "my-greenplum-pgdata-segment-a-2" deleted
persistentvolumeclaim "my-greenplum-pgdata-segment-a-3" deleted
persistentvolumeclaim "my-greenplum-pgdata-segment-a-4" deleted
persistentvolumeclaim "my-greenplum-pgdata-segment-a-5" deleted

If the Persistent Volumes were provisioned manually, then deleting the PVCs does not delete the associated PVs. (You can check for the PVs using kubectl get pv.) To delete any remaining Persistent Volumes, execute the command:
```
$ kubectl delete pv -l greenplum-cluster=my-greenplum
```

See Persistent Volumes in the Kubernetes documentation for more information.

Deleting Greenplum Operator

If you also want to remove the Greenplum Operator, follow the instructions in Uninstalling Pivotal Greenplum for Kubernetes.