f590fb275d
…dexes in DfsPartitionReader ### What changes were proposed in this pull request? Avoiding multiple accesses to HDFS when retrieving indexes in DfsPartitionReader ### Why are the changes needed? This optimization method improves read performance by reducing the number of interactions with HDFS, merging multiple small I/O operations into a single large I/O operation. Especially when index files are small, the strategy of reading the entire file at once can significantly reduce the number of I/O operations. ### Does this PR introduce _any_ user-facing change? NO ### How was this patch tested? CI Closes #3443 from xy2953396112/CELEBORN-2122. Authored-by: xxx <953396112@qq.com> Signed-off-by: mingji <fengmingxiao.fmx@alibaba-inc.com> |
||
|---|---|---|
| .. | ||
| src | ||
| pom.xml | ||