celeborn/client-spark
Cheng Pan df809159d1 [CELEBORN-1898] SparkOutOfMemoryError compatible with Spark 4.0 and 4.1
### What changes were proposed in this pull request?

SPARK-49946 (4.0.0) removes single String constructor of class `SparkOutOfMemoryError` and introduces `_LEGACY_ERROR_TEMP_3301` error condition, SPARK-51386 (4.1.0) renames the error condition to `POINTER_ARRAY_OUT_OF_MEMORY`.

### Why are the changes needed?

To be compatible with Spark 4.0 and 4.1

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

GHA checks Spark 2.4 to Spark 3.5, I manually tested with Spark 4.0.0 RC2

Closes #3141 from pan3793/CELEBORN-1898.

Authored-by: Cheng Pan <chengpan@apache.org>
Signed-off-by: mingji <fengmingxiao.fmx@alibaba-inc.com>
2025-03-10 15:19:50 +08:00
..
common [CELEBORN-1898] SparkOutOfMemoryError compatible with Spark 4.0 and 4.1 2025-03-10 15:19:50 +08:00
spark-2 [MINOR] Refine the log for fetch failure and rpc metrics dump 2025-03-10 10:56:53 +08:00
spark-2-shaded [INFRA] Remove incubator/incubating for graduation 2024-03-27 13:54:47 +08:00
spark-3 [CELEBORN-1413][FOLLOWUP] Rename celeborn-client-spark-3-4 back to celeborn-client-spark-3 2025-03-04 22:25:10 +08:00
spark-3-columnar-common [CELEBORN-1413][FOLLOWUP] Rename celeborn-client-spark-3-4 back to celeborn-client-spark-3 2025-03-04 22:25:10 +08:00
spark-3-columnar-shuffle [CELEBORN-1413][FOLLOWUP] Rename celeborn-client-spark-3-4 back to celeborn-client-spark-3 2025-03-04 22:25:10 +08:00
spark-3-shaded [CELEBORN-1413][FOLLOWUP] Rename celeborn-client-spark-3-4 back to celeborn-client-spark-3 2025-03-04 22:25:10 +08:00
spark-3.5-columnar-shuffle [CELEBORN-912][FOLLOWUP] Support columnar shuffle for Spark 3.5 2024-09-05 16:52:47 +08:00
spark-4-columnar-shuffle [CELEBORN-1413] Support Spark 4.0 2024-12-24 18:12:27 +08:00
spark-4-shaded [CELEBORN-1413][FOLLOWUP] Rename celeborn-client-spark-3-4 back to celeborn-client-spark-3 2025-03-04 22:25:10 +08:00