### What changes were proposed in this pull request? After discussion, we make sure that `shuffleManager.unregisterShuffle()` will be triggered by Spark both in driver and executor. In this pr: 1. Add shuffle client both in driver and executor side in ShuffleManager 2. ShuffleClient call cleanupShuffle() when trigger `unregisterShuffle`. This replaced https://github.com/apache/incubator-celeborn/pull/1719 ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? Closes #1726 from AngersZhuuuu/CELEBORN-804. Authored-by: Angerszhuuuu <angers.zhu@gmail.com> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|---|---|---|
| .. | ||
| common | ||
| flink-1.14 | ||
| flink-1.14-shaded | ||
| flink-1.15 | ||
| flink-1.15-shaded | ||
| flink-1.17 | ||
| flink-1.17-shaded | ||