celeborn/tests
Wang, Fei ec62d924c5 [CELEBORN-2000] Ignore the getReducerFileGroup timeout before shuffle stage end
### What changes were proposed in this pull request?

Ignore the getReducerFileGroup timeout before shuffle stage end.
### Why are the changes needed?

1. if the getReducerFileGroup timeout is caused by lifecycle manager commitFiles timeout(stage not ended)
2. maybe many tasks failed and would not report fetch failure
3. then it cause the spark application failed eventually.

The shuffle client should ignore the getReducerFileGroup timeout before LifeCycleManager commitFiles complete.

### Does this PR introduce _any_ user-facing change?
No.

### How was this patch tested?

UT

Closes #3263 from turboFei/is_stage_end.

Lead-authored-by: Wang, Fei <fwang12@ebay.com>
Co-authored-by: Fei Wang <cn.feiwang@gmail.com>
Signed-off-by: mingji <fengmingxiao.fmx@alibaba-inc.com>
2025-05-20 14:16:46 +08:00
..
flink-it [CELEBORN-1912] Client should send heartbeat to worker for processing heartbeat to avoid reading idleness of worker which enables heartbeat 2025-05-08 10:09:50 +08:00
kubernetes-it [CELEBORN-1565] Introduce warn-unused-import in Scala 2024-08-29 13:43:17 +08:00
mr-it [CELEBORN-1434] Support MRAppMasterWithCeleborn to disable job recovery and job reduce slow start by default 2024-05-22 15:32:41 +08:00
spark-it [CELEBORN-2000] Ignore the getReducerFileGroup timeout before shuffle stage end 2025-05-20 14:16:46 +08:00
tez-it [CELEBORN-1737] Support build tez client package 2024-12-30 11:01:19 +08:00