celeborn/master
Wang, Fei e2f640ce3b [CELEBORN-1660] Using map for workers to find worker fast
### What changes were proposed in this pull request?

Using map for workers so that we can find a worker by uniqueId fast.

### Why are the changes needed?

For large celeborn cluster, it might be slow.

- updateWorkerHeartbeatMeta
1e77f01cd3/master/src/main/java/org/apache/celeborn/service/deploy/master/clustermeta/AbstractMetaManager.java (L222)

- handleWorkerLost
1e77f01cd3/master/src/main/scala/org/apache/celeborn/service/deploy/master/Master.scala (L762-L765)
### Does this PR introduce _any_ user-facing change?
No.

### How was this patch tested?
Existing UT.

Closes #2870 from turboFei/worksMap.

Lead-authored-by: Wang, Fei <fwang12@ebay.com>
Co-authored-by: Fei Wang <cn.feiwang@gmail.com>
Signed-off-by: mingji <fengmingxiao.fmx@alibaba-inc.com>
2024-11-01 15:58:53 +08:00
..
src [CELEBORN-1660] Using map for workers to find worker fast 2024-11-01 15:58:53 +08:00
pom.xml [CELEBORN-1589] Ensure master is leader for some POST request APIs 2024-09-12 15:31:43 +08:00