apache/celeborn
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

[MINOR] Delete DEPLOY_ON_K8S.md

Browse Source 
### What changes were proposed in this pull request?

Delete `DEPLOY_ON_K8S.md`.

### Why are the changes needed?

`DEPLOY_ON_K8S.md` is replaced with `deploy_on_k8s.md`, which could be deleted.

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

No.

Closes #2752 from SteNicholas/delete-deploy-on-k8s.

Authored-by: SteNicholas <programgeek@163.com>
Signed-off-by: mingji <fengmingxiao.fmx@alibaba-inc.com>
This commit is contained in:
SteNicholas 2024-09-23 10:06:06 +08:00 committed by mingji
parent 8734d16638
commit 3cc043a179
1 changed files with 0 additions and 62 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

62
docker/DEPLOY_ON_K8S.md
View File

@ -1,62 +0,0 @@
# How to Deploy Celeborn on Kubernetes
## Prerequisite
Celeborn is recommended to be deployed on nodes with local disk. Before starting, please make sure
local disks on nodes are mounted to specific path.
## [Optional] Build Celeborn docker image
We have provided a docker image for Celeborn in helm chart. If you want to build your own Celeborn
image, run docker build with our Dockerfile.
You should download or build your binary package first, then decompress it, cd decompress directory,
use following command to build docker image.
```
docker build . \
--file docker/Dockerfile \
--build-arg celeborn_uid=10006 \
--build-arg celeborn_gid=10006 \
--tag ${your-repo}:${tag}
```
## Deploy Celeborn with helm
#### Install kubectl and Helm
Please install and config kubectl and Helm first. See [Installing kubectl](https://kubernetes.io/docs/tasks/tools/#kubectl)
and [Installing Helm](https://helm.sh/docs/intro/install/).
#### Create namespace on Kubernetes
```
kubectl create namespace celeborn
```
#### [Optional] Modify helm values file values.yaml
You can modify helm values file and set up customized deployment configuration.
```
vim ${CELEBORN_HOME}/charts/celeborn/values.yaml
```
These values are suggested to be checked before deploy:
- masterReplicas (number of Celeborn Master)
- workerReplicas (number of Celeborn Worker)
- celebornVersion (Celeborn release version)
- celeborn.worker.storage.dirs (local disk mount path on k8s node)
For more information of Celeborn configurations, see [CONFIGURATIONS](../CONFIGURATION_GUIDE.md)
#### Install Celeborn
```
helm install celeborn ${CELEBORN_HOME}/charts/celeborn -n ${celeborn namespace}
```
#### Connect to Celeborn in K8s pod
After installation, you can connect to Celeborn master through headless service. For example,
this is the spark configuration for 3-master Celeborn:
```
spark.celeborn.master.endpoints=celeborn-master-0.celeborn-master-svc.${celeborn namespace},celeborn-master-1.celeborn-master-svc.${celeborn namespace},celeborn-master-2.celeborn-master-svc.${celeborn namespace}
```
#### Uninstall Celeborn
```
helm uninstall celeborn -n ${celeborn namespace}
```