celeborn

History

mingji 11a4007965 [CELEBORN-1718] Fix memory storage file won't hard split when memory file is full and worker has no disks ### What changes were proposed in this pull request? Return hard split if a memory storage file is full and the worker has no disks. ### Why are the changes needed? In current implementation, a task might be hang because the worker rejected the shuffle data and returned nothing. ### Does this PR introduce _any_ user-facing change? NO. ### How was this patch tested? GA. Closes #2918 from FMX/b1718. Authored-by: mingji <fengmingxiao.fmx@alibaba-inc.com> Signed-off-by: SteNicholas <programgeek@163.com>	2024-11-15 19:24:25 +08:00
..
src	[CELEBORN-1718] Fix memory storage file won't hard split when memory file is full and worker has no disks	2024-11-15 19:24:25 +08:00
pom.xml	[CELEBORN-1477] Using openapi-generator `apache-httpclient` library instead of `jersey2`	2024-07-31 15:02:41 +08:00

[CELEBORN-1718] Fix memory storage file won't hard split when memory file is full and worker has no disks

### What changes were proposed in this pull request?
Return hard split if a memory storage file is full and the worker has no disks.

### Why are the changes needed?
In current implementation, a task might be hang because the worker rejected the shuffle data and returned nothing.

### Does this PR introduce _any_ user-facing change?
NO.

### How was this patch tested?
GA.

Closes #2918 from FMX/b1718.

Authored-by: mingji <fengmingxiao.fmx@alibaba-inc.com>
Signed-off-by: SteNicholas <programgeek@163.com>

2024-11-15 19:24:25 +08:00

src [CELEBORN-1718] Fix memory storage file won't hard split when memory file is full and worker has no disks 2024-11-15 19:24:25 +08:00

pom.xml [CELEBORN-1477] Using openapi-generator apache-httpclient library instead of jersey2 2024-07-31 15:02:41 +08:00