celeborn/worker/src/test
mingji 89d56c9bbc
[CELEBORN-914] Support memory file storage
### What changes were proposed in this pull request?
To support memory file storage.

### Why are the changes needed?
To improve shuffle performance for small shuffle files.

Design doc: https://docs.google.com/document/d/1SM-oOM0JHEIoRHTYhE9PYH60_1D3NMxDR50LZIM7uW0/edit?usp=sharing

### Does this PR introduce _any_ user-facing change?
No.

### How was this patch tested?
Pass GA and manually test on a cluster.

Closes #2300 from FMX/B914.

Authored-by: mingji <fengmingxiao.fmx@alibaba-inc.com>
Signed-off-by: mingji <fengmingxiao.fmx@alibaba-inc.com>
2024-05-23 21:05:52 +08:00
..
java/org/apache/celeborn/service/deploy/worker [CELEBORN-914] Support memory file storage 2024-05-23 21:05:52 +08:00
resources [CELEBORN-1022][TEST] Update log level from FATAL to ERROR for console output in unit tests 2023-10-09 15:56:05 +08:00
scala/org/apache/celeborn/service/deploy [CELEBORN-914] Support memory file storage 2024-05-23 21:05:52 +08:00