Cheng Pan 0636e3ca40 [CELEBORN-654][SPARK] SortBasedShuffleWriter does not require mapStatusRecords in Spark 3 ... ### What changes were proposed in this pull request? `mapStatusRecords` is required in Spark 2 for constructing `MapStatus` when AQE is enabled, but not in Spark 3, so remove it to save memory and compute resources. This PR also simplifies the `for loop` code. ### Why are the changes needed? Remove unnecessary variables to save resources and clean up code. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Pass GA. Closes #1564 from pan3793/CELEBORN-654. Authored-by: Cheng Pan <chengpan@apache.org> Signed-off-by: Cheng Pan <chengpan@apache.org>		2023-06-09 09:43:08 +08:00
..
common	[CLEBORN-595] Refine code frame of CelebornConf (#1525)	2023-06-01 10:37:58 +08:00
spark-2	[CELEBORN-654][SPARK] SortBasedShuffleWriter does not require mapStatusRecords in Spark 3	2023-06-09 09:43:08 +08:00
spark-2-shaded	[Feature] Shade netty native libraries (#908)	2022-11-02 19:02:03 +08:00
spark-3	[CELEBORN-654][SPARK] SortBasedShuffleWriter does not require mapStatusRecords in Spark 3	2023-06-09 09:43:08 +08:00
spark-3-shaded	Exclude unused files from Spark shaded client (#942)	2022-11-09 11:20:33 +08:00