apache/celeborn
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

[MINOR][DOC] Correct configuration values ​​in slotsallocation

Browse Source 
### What changes were proposed in this pull request?

### Why are the changes needed?
Config `celeborn.master.slot.assign.loadAware.fetchTimeWeight` default value is 1, and slotsallocation document is configured as 0.

### Does this PR introduce _any_ user-facing change?
No

### How was this patch tested?
GA

Closes #3287 from cxzl25/minor_doc_slot.

Authored-by: sychen <sychen@ctrip.com>
Signed-off-by: Wang, Fei <fwang12@ebay.com>
This commit is contained in:
sychen 2025-05-26 23:45:34 -07:00 committed by Wang, Fei
parent 0dffcf6c9d
commit 14d721212c
1 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
docs/developers/slotsallocation.md
View File

@ -32,7 +32,7 @@ celeborn.master.slot.assign.policy LOADAWARE
celeborn.master.slot.assign.loadAware.numDiskGroups 5
celeborn.master.slot.assign.loadAware.diskGroupGradient 0.1
celeborn.master.slot.assign.loadAware.flushTimeWeight 0
celeborn.master.slot.assign.loadAware.fetchTimeWeight 0
celeborn.master.slot.assign.loadAware.fetchTimeWeight 1
[spark.client.]celeborn.storage.availableTypes HDD,SSD
```
### Detail
@ -73,4 +73,4 @@ If a worker has multiple disks, the chosen disk index is `(monotone increasing d
## Celeborn Worker's Behavior
1. When reserve slots Celeborn worker will decide a slot be placed in local disks or HDFS when reserve slots.
2. If a partition is evicted from memory, the partition might be placed in HDFS.
3. If a slot is explicitly assigned to HDFS, worker will put the slot in HDFS.
3. If a slot is explicitly assigned to HDFS, worker will put the slot in HDFS.