celeborn/worker
daowu.hzy 3efc60cc9f
Some checks failed
Celeborn Cpp Integration Test / celeborn_cpp_check_lint (push) Has been cancelled
Celeborn Cpp Integration Test / celeborn_cpp_unit_test (push) Has been cancelled
Celeborn Cpp Integration Test / celeborn_cpp_integration_test (push) Has been cancelled
Grafana Dashboard CI / lint (push) Has been cancelled
Integration Test / celeborn_integration_test (push) Has been cancelled
Celeborn CI / service (11) (push) Has been cancelled
Celeborn CI / service (17) (push) Has been cancelled
Celeborn CI / service (8) (push) Has been cancelled
Celeborn CI / spark2 (8, 2.4) (push) Has been cancelled
Celeborn CI / spark3 (11, org.apache.spark.shuffle.celeborn.CelebornShuffleDataIO, 3.5) (push) Has been cancelled
Celeborn CI / spark3 (11, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO, 3.0) (push) Has been cancelled
Celeborn CI / spark3 (11, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO, 3.1) (push) Has been cancelled
Celeborn CI / spark3 (11, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO, 3.2) (push) Has been cancelled
Celeborn CI / spark3 (11, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO, 3.3) (push) Has been cancelled
Celeborn CI / spark3 (11, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO, 3.4) (push) Has been cancelled
Celeborn CI / spark3 (11, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO, 3.5) (push) Has been cancelled
Celeborn CI / spark3 (17, org.apache.spark.shuffle.celeborn.CelebornShuffleDataIO, 3.5) (push) Has been cancelled
Celeborn CI / spark3 (17, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO, 3.3) (push) Has been cancelled
Celeborn CI / spark3 (17, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO, 3.4) (push) Has been cancelled
Celeborn CI / spark3 (17, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO, 3.5) (push) Has been cancelled
Celeborn CI / spark3 (8, org.apache.spark.shuffle.celeborn.CelebornShuffleDataIO, 3.5) (push) Has been cancelled
Celeborn CI / spark3 (8, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO, 3.0) (push) Has been cancelled
Celeborn CI / spark3 (8, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO, 3.1) (push) Has been cancelled
Celeborn CI / spark3 (8, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO, 3.2) (push) Has been cancelled
Celeborn CI / spark3 (8, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO, 3.3) (push) Has been cancelled
Celeborn CI / spark3 (8, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO, 3.4) (push) Has been cancelled
Celeborn CI / spark3 (8, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO, 3.5) (push) Has been cancelled
Celeborn CI / spark4 (17, org.apache.spark.shuffle.celeborn.CelebornShuffleDataIO, 4.0) (push) Has been cancelled
Celeborn CI / flink1 (1.16, 11) (push) Has been cancelled
Celeborn CI / flink1 (1.16, 8) (push) Has been cancelled
Celeborn CI / flink1 (1.17, 11) (push) Has been cancelled
Celeborn CI / flink1 (1.17, 8) (push) Has been cancelled
Celeborn CI / flink1 (1.18, 11) (push) Has been cancelled
Celeborn CI / flink1 (1.18, 8) (push) Has been cancelled
Celeborn CI / flink1 (1.19, 11) (push) Has been cancelled
Celeborn CI / flink1 (1.19, 8) (push) Has been cancelled
Celeborn CI / flink1 (1.20, 11) (push) Has been cancelled
Celeborn CI / flink1 (1.20, 8) (push) Has been cancelled
Celeborn CI / flink2 (2.0, 11) (push) Has been cancelled
Celeborn CI / flink2 (2.0, 17) (push) Has been cancelled
Celeborn CI / flink2 (2.1, 11) (push) Has been cancelled
Celeborn CI / flink2 (2.1, 17) (push) Has been cancelled
Celeborn CI / mr (11) (push) Has been cancelled
Celeborn CI / mr (8) (push) Has been cancelled
Celeborn SBT CI / service (11, 2.12.15) (push) Has been cancelled
Celeborn SBT CI / service (11, 2.13.5) (push) Has been cancelled
Celeborn SBT CI / service (17, 2.12.15) (push) Has been cancelled
Celeborn SBT CI / service (17, 2.13.5) (push) Has been cancelled
Celeborn SBT CI / service (8, 2.12.15) (push) Has been cancelled
Celeborn SBT CI / service (8, 2.13.5) (push) Has been cancelled
Celeborn SBT CI / spark2 (8, 2.11.12, 2.4) (push) Has been cancelled
Celeborn SBT CI / spark2 (8, 2.12.10, 2.4) (push) Has been cancelled
Celeborn SBT CI / spark3 (11, 2.12.10, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO, 3.0) (push) Has been cancelled
Celeborn SBT CI / spark3 (11, 2.12.10, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO, 3.1) (push) Has been cancelled
Celeborn SBT CI / spark3 (11, 2.12.15, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO, 3.2) (push) Has been cancelled
Celeborn SBT CI / spark3 (11, 2.12.15, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO, 3.3) (push) Has been cancelled
Celeborn SBT CI / spark3 (11, 2.12.17, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO, 3.4) (push) Has been cancelled
Celeborn SBT CI / spark3 (11, 2.12.18, 2.12, org.apache.spark.shuffle.celeborn.CelebornShuffleDataIO, 3.5) (push) Has been cancelled
Celeborn SBT CI / spark3 (11, 2.12.18, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO, 3.5) (push) Has been cancelled
Celeborn SBT CI / spark3 (11, 2.13.5, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO, 3.2) (push) Has been cancelled
Celeborn SBT CI / spark3 (11, 2.13.8, 2.13, org.apache.spark.shuffle.celeborn.CelebornShuffleDataIO, 3.5) (push) Has been cancelled
Celeborn SBT CI / spark3 (11, 2.13.8, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO, 3.3) (push) Has been cancelled
Celeborn SBT CI / spark3 (11, 2.13.8, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO, 3.4) (push) Has been cancelled
Celeborn SBT CI / spark3 (11, 2.13.8, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO, 3.5) (push) Has been cancelled
Celeborn SBT CI / spark3 (17, 2.12.15, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO, 3.3) (push) Has been cancelled
Celeborn SBT CI / spark3 (17, 2.12.17, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO, 3.4) (push) Has been cancelled
Celeborn SBT CI / spark3 (17, 2.12.18, 2.12, org.apache.spark.shuffle.celeborn.CelebornShuffleDataIO, 3.5) (push) Has been cancelled
Celeborn SBT CI / spark3 (17, 2.12.18, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO, 3.5) (push) Has been cancelled
Celeborn SBT CI / spark3 (17, 2.13.8, 2.13, org.apache.spark.shuffle.celeborn.CelebornShuffleDataIO, 3.5) (push) Has been cancelled
Celeborn SBT CI / spark3 (17, 2.13.8, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO, 3.3) (push) Has been cancelled
Celeborn SBT CI / spark3 (17, 2.13.8, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO, 3.4) (push) Has been cancelled
Celeborn SBT CI / spark3 (17, 2.13.8, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO, 3.5) (push) Has been cancelled
Celeborn SBT CI / spark3 (8, 2.12.10, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO, 3.0) (push) Has been cancelled
Celeborn SBT CI / spark3 (8, 2.12.10, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO, 3.1) (push) Has been cancelled
Celeborn SBT CI / spark3 (8, 2.12.15, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO, 3.2) (push) Has been cancelled
Celeborn SBT CI / spark3 (8, 2.12.15, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO, 3.3) (push) Has been cancelled
Celeborn SBT CI / spark3 (8, 2.12.17, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO, 3.4) (push) Has been cancelled
Celeborn SBT CI / spark3 (8, 2.12.18, 2.12, org.apache.spark.shuffle.celeborn.CelebornShuffleDataIO, 3.5) (push) Has been cancelled
Celeborn SBT CI / spark3 (8, 2.12.18, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO, 3.5) (push) Has been cancelled
Celeborn SBT CI / spark3 (8, 2.13.5, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO, 3.2) (push) Has been cancelled
Celeborn SBT CI / spark3 (8, 2.13.8, 2.13, org.apache.spark.shuffle.celeborn.CelebornShuffleDataIO, 3.5) (push) Has been cancelled
Celeborn SBT CI / spark3 (8, 2.13.8, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO, 3.3) (push) Has been cancelled
Celeborn SBT CI / spark3 (8, 2.13.8, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO, 3.4) (push) Has been cancelled
Celeborn SBT CI / spark3 (8, 2.13.8, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO, 3.5) (push) Has been cancelled
Celeborn SBT CI / spark4 (17, 2.13.16, 2.13, org.apache.spark.shuffle.celeborn.CelebornShuffleDataIO, 4.0) (push) Has been cancelled
Celeborn SBT CI / flink1 (1.16, 11) (push) Has been cancelled
Celeborn SBT CI / flink1 (1.16, 8) (push) Has been cancelled
Celeborn SBT CI / flink1 (1.17, 11) (push) Has been cancelled
Celeborn SBT CI / flink1 (1.17, 8) (push) Has been cancelled
Celeborn SBT CI / flink1 (1.18, 11) (push) Has been cancelled
Celeborn SBT CI / flink1 (1.18, 8) (push) Has been cancelled
Celeborn SBT CI / flink1 (1.19, 11) (push) Has been cancelled
Celeborn SBT CI / flink1 (1.19, 8) (push) Has been cancelled
Celeborn SBT CI / flink1 (1.20, 11) (push) Has been cancelled
Celeborn SBT CI / flink1 (1.20, 8) (push) Has been cancelled
Celeborn SBT CI / flink2 (2.0, 11) (push) Has been cancelled
Celeborn SBT CI / flink2 (2.0, 17) (push) Has been cancelled
Celeborn SBT CI / flink2 (2.1, 11) (push) Has been cancelled
Celeborn SBT CI / flink2 (2.1, 17) (push) Has been cancelled
Celeborn SBT CI / mr (11) (push) Has been cancelled
Celeborn SBT CI / mr (8) (push) Has been cancelled
Celeborn SBT CI / openapi-codegen-check (11) (push) Has been cancelled
Style check / License (push) Has been cancelled
Lint Check for Web / lint (push) Has been cancelled
[CELEBORN-2047] Reuse FileChannel/FSDataInputStream in PartitionDataReader
### What changes were proposed in this pull request?

Reuse FileChannel/FSDataInputStream in PartitionDataReader to avoid  open too many files.

### Why are the changes needed?

In previous implementations, different PartitionDataReader reused the same FileChannel/FSDataInputStream,but in #3349
changed this logic, so we need to maintain logical consistency

### Does this PR introduce any user-facing change?

No.

### How was this patch tested?

Manual test.

Closes #3445 from Alibaba-HZY/mirror-fix.

Authored-by: daowu.hzy <daowu.hzy@alibaba-inc.com>
Signed-off-by: mingji <fengmingxiao.fmx@alibaba-inc.com>
2025-09-03 16:14:56 +08:00
..
src [CELEBORN-2047] Reuse FileChannel/FSDataInputStream in PartitionDataReader 2025-09-03 16:14:56 +08:00
pom.xml [CELEBORN-1994] Introduce disruptor dependency to support asynchronous logging of log4j2 2025-05-13 19:45:51 +08:00