cfc3f1b13a
### What changes were proposed in this pull request? Support celeborn optimize skew partitions patch for Spark v3.5.6 and v4.0.0. ### Why are the changes needed? There is no patch of celeborn optimize skew partitions for Spark v4.0.0. Meanwhile, Spark v3.5.6 could not apply `Celeborn-Optimize-Skew-Partitions-spark3_5.patch` because of https://github.com/apache/spark/pull/50946. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? ``` $ git checkout v3.5.6 Previous HEAD position was fa33ea000a0 Preparing Spark release v4.0.0-rc7 HEAD is now at 303c18c7466 Preparing Spark release v3.5.6-rc1 $ git apply --check /celeborn/assets/spark-patch/Celeborn-Optimize-Skew-Partitions-spark3_5_6.patch $ git checkout v4.0.0 Previous HEAD position was 303c18c7466 Preparing Spark release v3.5.6-rc1 HEAD is now at fa33ea000a0 Preparing Spark release v4.0.0-rc7 $ git apply --check /celeborn/assets/spark-patch/Celeborn-Optimize-Skew-Partitions-spark4_0.patch ``` Closes #3329 from SteNicholas/CELEBORN-1319. Authored-by: SteNicholas <programgeek@163.com> Signed-off-by: Wang, Fei <fwang12@ebay.com> |
||
|---|---|---|
| .. | ||
| diagram | ||
| grafana | ||
| spark-patch | ||