d692e49089
### What changes were proposed in this pull request? https://github.com/apache/celeborn/pull/2348 avoids fetching first chunk in the constructor of `CelebornInputStreamImpl`, but in some cases, i.e. coalescing 3000 partitions into one in Spark, it can be beneficial to do so for performance. This PR adds back prefetching with knobs default to false. ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change? Yes, two configs are added. ### How was this patch tested? Extended `MemorySkewJoinSuite` and `ReusedExchangeSuite`, and manual test. Closes #2549 from waitinfuture/1446. Authored-by: zky.zhoukeyong <zky.zhoukeyong@alibaba-inc.com> Signed-off-by: Shuang <lvshuang.xjs@alibaba-inc.com> |
||
|---|---|---|
| .. | ||
| flink-it | ||
| kubernetes-it | ||
| mr-it | ||
| spark-it | ||