apache/celeborn
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

[CELEBORN-2082] Add the log of excluded workers with high workloads

Browse Source 
### What changes were proposed in this pull request?

### Why are the changes needed?
When workers with higher workloads are excluded, the master does not have a clear log.

### Does this PR introduce _any_ user-facing change?
No

### How was this patch tested?
GA

Closes #3391 from cxzl25/CELEBORN-2082.

Authored-by: sychen <sychen@ctrip.com>
Signed-off-by: SteNicholas <programgeek@163.com>
This commit is contained in:
sychen 2025-07-25 20:56:18 +08:00 committed by SteNicholas
parent abd6233a50
commit df0def6701
1 changed files with 4 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java
View File

@ -294,7 +294,10 @@ public abstract class AbstractMetaManager implements IMetadataHandler {
&& !conf.hasOssStorage())
|| highWorkload)) {
LOG.warn(
"Worker {} (unhealthy disks num: {}) adds to excluded workers", worker, unhealthyDiskNum);
"Worker {} (unhealthy disks num: {}, high workload: {}) adds to excluded workers",
worker,
unhealthyDiskNum,
highWorkload);
excludedWorkers.add(worker);
} else if ((availableSlots.get() > 0
|| conf.hasHDFSStorage()