From 14d721212c0649941b3f1b7e1cff731cd295ff63 Mon Sep 17 00:00:00 2001 From: sychen Date: Mon, 26 May 2025 23:45:34 -0700 Subject: [PATCH] =?UTF-8?q?[MINOR][DOC]=20Correct=20configuration=20values?= =?UTF-8?q?=20=E2=80=8B=E2=80=8Bin=20slotsallocation?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit ### What changes were proposed in this pull request? ### Why are the changes needed? Config `celeborn.master.slot.assign.loadAware.fetchTimeWeight` default value is 1, and slotsallocation document is configured as 0. ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? GA Closes #3287 from cxzl25/minor_doc_slot. Authored-by: sychen Signed-off-by: Wang, Fei --- docs/developers/slotsallocation.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/docs/developers/slotsallocation.md b/docs/developers/slotsallocation.md index a8d744915..71060bba1 100644 --- a/docs/developers/slotsallocation.md +++ b/docs/developers/slotsallocation.md @@ -32,7 +32,7 @@ celeborn.master.slot.assign.policy LOADAWARE celeborn.master.slot.assign.loadAware.numDiskGroups 5 celeborn.master.slot.assign.loadAware.diskGroupGradient 0.1 celeborn.master.slot.assign.loadAware.flushTimeWeight 0 -celeborn.master.slot.assign.loadAware.fetchTimeWeight 0 +celeborn.master.slot.assign.loadAware.fetchTimeWeight 1 [spark.client.]celeborn.storage.availableTypes HDD,SSD ``` ### Detail @@ -73,4 +73,4 @@ If a worker has multiple disks, the chosen disk index is `(monotone increasing d ## Celeborn Worker's Behavior 1. When reserve slots Celeborn worker will decide a slot be placed in local disks or HDFS when reserve slots. 2. If a partition is evicted from memory, the partition might be placed in HDFS. -3. If a slot is explicitly assigned to HDFS, worker will put the slot in HDFS. \ No newline at end of file +3. If a slot is explicitly assigned to HDFS, worker will put the slot in HDFS.