diff --git a/README.md b/README.md index 95c2c2a38..17c625c06 100644 --- a/README.md +++ b/README.md @@ -312,7 +312,7 @@ spark.executor.userClassPathFirst false ### Deploy Flink client -**Important: Only Flink batch jobs are supported for now.** +**Important: Only Flink batch jobs are supported for now. Due to the Shuffle Service in Flink is cluster-granularity, if you want to use Celeborn in a session cluster, it will not be able to submit both streaming and batch job to the same cluster. We plan to get rid of this restriction for Hybrid Shuffle mode in a future release.** Copy `$CELEBORN_HOME/flink/*.jar` to `$FLINK_HOME/lib/`. diff --git a/docs/deploy.md b/docs/deploy.md index 30909603f..d151ef494 100644 --- a/docs/deploy.md +++ b/docs/deploy.md @@ -210,7 +210,7 @@ spark.executor.userClassPathFirst false ## Deploy Flink client -**Important: Only Flink batch jobs are supported for now.** +**Important: Only Flink batch jobs are supported for now. Due to the Shuffle Service in Flink is cluster-granularity, if you want to use Celeborn in a session cluster, it will not be able to submit both streaming and batch job to the same cluster. We plan to get rid of this restriction for Hybrid Shuffle mode in a future release.** Celeborn release binary contains clients for Flink 1.14.x, Flink 1.15.x, Flink 1.17.x, Flink 1.18.x, Flink 1.19.x and Flink 1.20.x, copy the corresponding client jar into Flink's `lib/` directory: