apache/celeborn
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
4ccb0c7fce
celeborn/assets/spark-patch
History
Luke Yan c7c2f6a35a [CELEBORN-858] Generate patch to each Spark 3.x minor version 
### What changes were proposed in this pull request?

Add the following patch files in directory `incubator-celeborn/tree/spark3-patch/assets/spark-patch` :

1. Celeborn_Dynamic_Allocation_spark3_0.patch
2. Celeborn_Dynamic_Allocation_spark3_1.patch
3. Celeborn_Dynamic_Allocation_spark3_2.patch
4. Celeborn_Dynamic_Allocation_spark3_3.patch

Delete a patch at the same time：

1. Celeborn_Dynamic_Allocation_spark3.patch

Modified `Support Spark Dynamic Allocation` in incubator-celeborn/README.md ：

![image](https://github.com/apache/incubator-celeborn/assets/108530647/61e2e69b-d3f5-4d11-a20b-374622936443)

### Why are the changes needed?

Convenient for customers to apply patches in Spark 3.X for `Support Spark Dynamic Allocation`

### Does this PR introduce _any_ user-facing change?

no

### How was this patch tested?

yes. All patch files can be applied to the corresponding version of spark source code through `git apply`  without any code conflicts.

Closes #2085 from lukeyan2023/spark3-patch.

Authored-by: Luke Yan <108530647+lukeyan2023@users.noreply.github.com>
Signed-off-by: zky.zhoukeyong <zky.zhoukeyong@alibaba-inc.com>
2023-11-10 15:35:54 +08:00
..
Celeborn_Columnar_Shuffle_spark3.patch [CELEBORN-753] Rename spark patch file name to make it more clear 2023-06-30 11:41:12 +08:00
Celeborn_Dynamic_Allocation_spark2.patch [CELEBORN-754][IMPORTANT] Provide a new SparkShuffleManager to replace RssShuffleManager in the future 2023-06-30 17:27:33 +08:00
Celeborn_Dynamic_Allocation_spark3_0.patch [CELEBORN-858] Generate patch to each Spark 3.x minor version 2023-11-10 15:35:54 +08:00
Celeborn_Dynamic_Allocation_spark3_1.patch [CELEBORN-858] Generate patch to each Spark 3.x minor version 2023-11-10 15:35:54 +08:00
Celeborn_Dynamic_Allocation_spark3_2.patch [CELEBORN-858] Generate patch to each Spark 3.x minor version 2023-11-10 15:35:54 +08:00
Celeborn_Dynamic_Allocation_spark3_3.patch [CELEBORN-858] Generate patch to each Spark 3.x minor version 2023-11-10 15:35:54 +08:00
Celeborn_Dynamic_Allocation_spark3_4.patch [CELEBORN-753] Rename spark patch file name to make it more clear 2023-06-30 11:41:12 +08:00