a759efb6dd
1.20 was the last non-bug-fix release before Flink 2.0, you can found all main upgrade features in this [release note](https://nightlies.apache.org/flink/flink-docs-release-1.20/release-notes/flink-1.20/). I think the most important feature related to Celeborn is we expose some interface to support Flink hybrid shuffle integration with Celeborn([FLIP-459](https://cwiki.apache.org/confluence/display/FLINK/FLIP-459%3A+Support+Flink+hybrid+shuffle+integration+with+Apache+Celeborn)). This(supporting hybrid shuffle in Celeborn side) is also a follow-up stuff to this PR. incompatible changes in 1.20: - 1.20 use enum `CompressionCodec` instead of `String` to construct `BufferDecompressor` and `BufferCompressor`. - 1.20 introduce a new method(`notifyPartitionRecoveryStarted`) to `JobShuffleContext` in a non-compatible way. I've already done the adaptation in this PR. Closes #2662 from reswqa/support-120. Authored-by: Weijie Guo <reswqa@163.com> Signed-off-by: Shuang <lvshuang.xjs@alibaba-inc.com>
37 lines
1.4 KiB
Bash
Executable File
37 lines
1.4 KiB
Bash
Executable File
#!/bin/bash
|
|
#
|
|
# Licensed to the Apache Software Foundation (ASF) under one or more
|
|
# contributor license agreements. See the NOTICE file distributed with
|
|
# this work for additional information regarding copyright ownership.
|
|
# The ASF licenses this file to You under the Apache License, Version 2.0
|
|
# (the "License"); you may not use this file except in compliance with
|
|
# the License. You may obtain a copy of the License at
|
|
#
|
|
# http://www.apache.org/licenses/LICENSE-2.0
|
|
#
|
|
# Unless required by applicable law or agreed to in writing, software
|
|
# distributed under the License is distributed on an "AS IS" BASIS,
|
|
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
|
|
# See the License for the specific language governing permissions and
|
|
# limitations under the License.
|
|
#
|
|
|
|
set -x
|
|
|
|
PROJECT_DIR="$(cd "`dirname "$0"`/.."; pwd)"
|
|
|
|
if [ "$1" == "--web" ]; then
|
|
${PROJECT_DIR}/build/mvn clean install -pl web
|
|
else
|
|
${PROJECT_DIR}/build/mvn spotless:apply -Pflink-1.14
|
|
${PROJECT_DIR}/build/mvn spotless:apply -Pflink-1.15
|
|
${PROJECT_DIR}/build/mvn spotless:apply -Pflink-1.16
|
|
${PROJECT_DIR}/build/mvn spotless:apply -Pflink-1.17
|
|
${PROJECT_DIR}/build/mvn spotless:apply -Pflink-1.18
|
|
${PROJECT_DIR}/build/mvn spotless:apply -Pflink-1.19
|
|
${PROJECT_DIR}/build/mvn spotless:apply -Pflink-1.20
|
|
${PROJECT_DIR}/build/mvn spotless:apply -Pspark-2.4
|
|
${PROJECT_DIR}/build/mvn spotless:apply -Pspark-3.3
|
|
${PROJECT_DIR}/build/mvn spotless:apply -Pmr
|
|
fi
|