From 3cc043a179ea87f0b73c985d915d13f9b5569cc8 Mon Sep 17 00:00:00 2001 From: SteNicholas Date: Mon, 23 Sep 2024 10:06:06 +0800 Subject: [PATCH] [MINOR] Delete DEPLOY_ON_K8S.md ### What changes were proposed in this pull request? Delete `DEPLOY_ON_K8S.md`. ### Why are the changes needed? `DEPLOY_ON_K8S.md` is replaced with `deploy_on_k8s.md`, which could be deleted. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? No. Closes #2752 from SteNicholas/delete-deploy-on-k8s. Authored-by: SteNicholas Signed-off-by: mingji --- docker/DEPLOY_ON_K8S.md | 62 ----------------------------------------- 1 file changed, 62 deletions(-) delete mode 100644 docker/DEPLOY_ON_K8S.md diff --git a/docker/DEPLOY_ON_K8S.md b/docker/DEPLOY_ON_K8S.md deleted file mode 100644 index 6976301d7..000000000 --- a/docker/DEPLOY_ON_K8S.md +++ /dev/null @@ -1,62 +0,0 @@ -# How to Deploy Celeborn on Kubernetes - -## Prerequisite -Celeborn is recommended to be deployed on nodes with local disk. Before starting, please make sure -local disks on nodes are mounted to specific path. - -## [Optional] Build Celeborn docker image -We have provided a docker image for Celeborn in helm chart. If you want to build your own Celeborn -image, run docker build with our Dockerfile. - -You should download or build your binary package first, then decompress it, cd decompress directory, -use following command to build docker image. - -``` -docker build . \ - --file docker/Dockerfile \ - --build-arg celeborn_uid=10006 \ - --build-arg celeborn_gid=10006 \ - --tag ${your-repo}:${tag} -``` - -## Deploy Celeborn with helm - -#### Install kubectl and Helm - -Please install and config kubectl and Helm first. See [Installing kubectl](https://kubernetes.io/docs/tasks/tools/#kubectl) -and [Installing Helm](https://helm.sh/docs/intro/install/). - -#### Create namespace on Kubernetes -``` -kubectl create namespace celeborn -``` - -#### [Optional] Modify helm values file values.yaml -You can modify helm values file and set up customized deployment configuration. -``` -vim ${CELEBORN_HOME}/charts/celeborn/values.yaml -``` -These values are suggested to be checked before deploy: -- masterReplicas (number of Celeborn Master) -- workerReplicas (number of Celeborn Worker) -- celebornVersion (Celeborn release version) -- celeborn.worker.storage.dirs (local disk mount path on k8s node) - -For more information of Celeborn configurations, see [CONFIGURATIONS](../CONFIGURATION_GUIDE.md) - -#### Install Celeborn -``` -helm install celeborn ${CELEBORN_HOME}/charts/celeborn -n ${celeborn namespace} -``` - -#### Connect to Celeborn in K8s pod -After installation, you can connect to Celeborn master through headless service. For example, -this is the spark configuration for 3-master Celeborn: -``` -spark.celeborn.master.endpoints=celeborn-master-0.celeborn-master-svc.${celeborn namespace},celeborn-master-1.celeborn-master-svc.${celeborn namespace},celeborn-master-2.celeborn-master-svc.${celeborn namespace} -``` - -#### Uninstall Celeborn -``` -helm uninstall celeborn -n ${celeborn namespace} -``` \ No newline at end of file