celeborn/client-spark
Sanskar Modi 1e77f01cd3
[CELEBORN-1663][FOLLOWUP] Only register appShuffleDeterminate if stage using celeborn for shuffle
### What changes were proposed in this pull request?

Making the same changes for Spark2 codebase

### Why are the changes needed?

Followup for https://github.com/apache/celeborn/pull/2832

### Does this PR introduce _any_ user-facing change?

NA

### How was this patch tested?

Existing UTs

Closes #2837 from s0nskar/fix_register_spark2.

Authored-by: Sanskar Modi <sanskarmodi97@gmail.com>
Signed-off-by: SteNicholas <programgeek@163.com>
2024-10-22 14:28:12 +08:00
..
common [CELEBORN-1645] Introduce ShuffleFallbackPolicy to support custom implementation of shuffle fallback policy for CelebornShuffleFallbackPolicyRunner 2024-10-15 21:57:04 +08:00
spark-2 [CELEBORN-1663][FOLLOWUP] Only register appShuffleDeterminate if stage using celeborn for shuffle 2024-10-22 14:28:12 +08:00
spark-2-shaded [INFRA] Remove incubator/incubating for graduation 2024-03-27 13:54:47 +08:00
spark-3 [CELEBORN-1663] Only register appShuffleDeterminate if stage using celeborn for shuffle 2024-10-22 11:40:06 +08:00
spark-3-columnar-common [CELEBORN-912][FOLLOWUP] Support columnar shuffle for Spark 3.5 2024-09-05 14:26:54 +08:00
spark-3-columnar-shuffle [CELEBORN-912][FOLLOWUP] Support columnar shuffle for Spark 3.5 2024-09-05 14:26:54 +08:00
spark-3-shaded [CELEBORN-1616] Shade com.google.thirdparty to prevent dependency conflicts 2024-09-27 17:50:23 +08:00
spark-3.5-columnar-shuffle [CELEBORN-912][FOLLOWUP] Support columnar shuffle for Spark 3.5 2024-09-05 16:52:47 +08:00