### What changes were proposed in this pull request? To support memory file storage. ### Why are the changes needed? To improve shuffle performance for small shuffle files. Design doc: https://docs.google.com/document/d/1SM-oOM0JHEIoRHTYhE9PYH60_1D3NMxDR50LZIM7uW0/edit?usp=sharing ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Pass GA and manually test on a cluster. Closes #2300 from FMX/B914. Authored-by: mingji <fengmingxiao.fmx@alibaba-inc.com> Signed-off-by: mingji <fengmingxiao.fmx@alibaba-inc.com> |
||
|---|---|---|
| .. | ||
| diagram | ||
| grafana | ||
| img | ||
| spark-patch | ||