### What changes were proposed in this pull request? Add metrics about active shuffle data size in every worker and update Grafana dashboard. The metric value will decrease when shuffle is expired. ### Why are the changes needed? Ditto. ### Does this PR introduce _any_ user-facing change? NO. ### How was this patch tested? Cluster. <img width="733" alt="截屏2023-08-30 17 00 11" src="https://github.com/apache/incubator-celeborn/assets/4150993/48e28c1c-2b49-45d7-b3ba-358674ff3f3d"> Closes #1867 from FMX/CELEBORN-933. Authored-by: mingji <fengmingxiao.fmx@alibaba-inc.com> Signed-off-by: zky.zhoukeyong <zky.zhoukeyong@alibaba-inc.com> |
||
|---|---|---|
| .. | ||
| diagram | ||
| grafana | ||
| img | ||
| spark-patch | ||