6ad02f14a9
### What changes were proposed in this pull request? Support interrupt shuffle on client side. I will develop the following functions in order 1. Client supports interrupt shuffle 2. Master supports calculating app-level shuffle usage ### Why are the changes needed? The current storage quota logic can only limit new shuffles, and cannot limit the writing of existing shuffles. In our production environment, there is such an scenario: the cluster is small, but the user's app single shuffle is large which occupied disk resources, we want to interrupt those shuffle. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Unable to test this part independently, Additional tests will be added after completing the second part. Closes #2801 from leixm/CELEBORN-1577-1. Authored-by: Xianming Lei <31424839+leixm@users.noreply.github.com> Signed-off-by: Shuang <lvshuang.xjs@alibaba-inc.com> |
||
|---|---|---|
| .. | ||
| src | ||
| pom.xml | ||