SteNicholas 4625484d2c [CELEBORN-830] Check available workers in CelebornShuffleFallbackPolicyRunner ... ### What changes were proposed in this pull request? `CelebornShuffleFallbackPolicyRunner` could not only check quota, but also check whether cluster has available workers. If there is no available workers, fallback to external shuffle. ### Why are the changes needed? `CelebornShuffleFallbackPolicyRunner` adds a check for available workers. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? - `SparkShuffleManagerSuite#testClusterNotAvailableWithAvailableWorkers` Closes #1814 from SteNicholas/CELEBORN-830. Authored-by: SteNicholas <programgeek@163.com> Signed-off-by: zky.zhoukeyong <zky.zhoukeyong@alibaba-inc.com>		2023-08-29 16:56:56 +08:00
..
main	[CELEBORN-830] Check available workers in CelebornShuffleFallbackPolicyRunner	2023-08-29 16:56:56 +08:00
test	[CELEBORN-920] Worker sends its load to Master through heartbeat	2023-08-26 13:58:37 +08:00