celeborn/tests
szt 64f201dd83 [CELEBORN-1636][FOLLOWUP] Dynamic resources will only be utilized in case of candidates shortages
### What changes were proposed in this pull request?
Follow up of [https://github.com/apache/celeborn/pull/2835]
Only use dynamic resources when candidates are not enough.
And change the way geting availableWorkers form heartbeat to requestSlots RPC to avoid the burden of heartbeat.

### Why are the changes needed?
No

### Does this PR introduce _any_ user-facing change?
Add another configuration.

### How was this patch tested?
UT

Closes #2852 from zaynt4606/clb1636-flu2.

Authored-by: szt <zaynt4606@163.com>
Signed-off-by: Shuang <lvshuang.xjs@alibaba-inc.com>
2024-11-05 18:10:01 +08:00
..
flink-it [CELEBORN-1490][CIP-6] Support process large buffer in flink hybrid shuffle 2024-11-04 16:57:43 +08:00
kubernetes-it [CELEBORN-1565] Introduce warn-unused-import in Scala 2024-08-29 13:43:17 +08:00
mr-it [CELEBORN-1434] Support MRAppMasterWithCeleborn to disable job recovery and job reduce slow start by default 2024-05-22 15:32:41 +08:00
spark-it [CELEBORN-1636][FOLLOWUP] Dynamic resources will only be utilized in case of candidates shortages 2024-11-05 18:10:01 +08:00