celeborn/client-spark
SteNicholas 14d9cd130d [CELEBORN-1685][FOLLOWUP] CelebornShuffleFallbackPolicyRunner should compute shuffleFallbackCounts via class name of ShuffleFallbackPolicy implementation
### What changes were proposed in this pull request?

`CelebornShuffleFallbackPolicyRunner` should compute `shuffleFallbackCounts` via class name of `ShuffleFallbackPolicy` implementation.

Follow up #2891.

### Why are the changes needed?

`CelebornShuffleFallbackPolicyRunner` computes `shuffleFallbackCounts` via class name of `Option` instead of class name of `ShuffleFallbackPolicy` implementation at present.

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

CI.

Closes #2909 from SteNicholas/CELEBORN-1685.

Authored-by: SteNicholas <programgeek@163.com>
Signed-off-by: Shuang <lvshuang.xjs@alibaba-inc.com>
2024-11-12 20:56:27 +08:00
..
common [CELEBORN-1686] Avoid return the same pushTaskQueue 2024-11-11 10:35:02 +08:00
spark-2 [CELEBORN-1685][FOLLOWUP] CelebornShuffleFallbackPolicyRunner should compute shuffleFallbackCounts via class name of ShuffleFallbackPolicy implementation 2024-11-12 20:56:27 +08:00
spark-2-shaded [INFRA] Remove incubator/incubating for graduation 2024-03-27 13:54:47 +08:00
spark-3 [CELEBORN-1685][FOLLOWUP] CelebornShuffleFallbackPolicyRunner should compute shuffleFallbackCounts via class name of ShuffleFallbackPolicy implementation 2024-11-12 20:56:27 +08:00
spark-3-columnar-common [CELEBORN-912][FOLLOWUP] Support columnar shuffle for Spark 3.5 2024-09-05 14:26:54 +08:00
spark-3-columnar-shuffle [CELEBORN-912][FOLLOWUP] Support columnar shuffle for Spark 3.5 2024-09-05 14:26:54 +08:00
spark-3-shaded [CELEBORN-1616] Shade com.google.thirdparty to prevent dependency conflicts 2024-09-27 17:50:23 +08:00
spark-3.5-columnar-shuffle [CELEBORN-912][FOLLOWUP] Support columnar shuffle for Spark 3.5 2024-09-05 16:52:47 +08:00