diff --git a/docs/develop_tools/building.md b/docs/develop_tools/building.md index e57501ec6..0de86bef9 100644 --- a/docs/develop_tools/building.md +++ b/docs/develop_tools/building.md @@ -73,22 +73,18 @@ Profile | Default | Since -Pspark-3.1 | No | 1.1.0 -## Defining the Apache Mirror for Spark or Flink +## Building with Apache dlcdn site -By default, we use `https://archive.apache.org/dist/spark/` to download the built-in Spark or -use `https://archive.apache.org/dist/flink/` to download the built-in Flink release package, -but if you find it hard to reach, or the downloading speed is too slow, you can define the `spark.archive.mirror` -or `flink.archive.mirror` property to a suitable Apache mirror site. For instance, +By default, we use `https://archive.apache.org/dist/` to download the built-in release packages of engines, +such as Spark or Flink. +But sometimes, you may find it hard to reach, or the download speed is too slow, +then you can define the `apache.archive.dist` by `-Pmirror-cdn` to accelerate to download speed. +For example, ```bash -build/mvn clean package -Dspark.archive.mirror=https://mirrors.bfsu.edu.cn/apache/spark/spark-3.0.1 +build/mvn clean package -Pmirror-cdn ``` -Visit [Apache Mirrors](http://www.apache.org/mirrors/) and choose a mirror based on your region. - -Specifically for developers in China mainland, you can use the pre-defined profile named `mirror-cn` - which use `mirrors.bfsu.edu.cn` to speed up Spark Binary downloading. For instance, - -```bash -build/mvn clean package -Pmirror-cn -``` +The profile migrates your download repo to the Apache offically suggested site - https://dlcdn.apache.org. +Note that, this site only holds the latest versions of Apache releases. You may fail if the specific version +defined by `spark.version` or `flink.version` is overdue. diff --git a/externals/kyuubi-download/pom.xml b/externals/kyuubi-download/pom.xml index 7758df721..e900af7f4 100644 --- a/externals/kyuubi-download/pom.xml +++ b/externals/kyuubi-download/pom.xml @@ -47,11 +47,6 @@ ${spark.archive.download.skip} ${spark.archive.mirror}/${spark.archive.name} - - ${project.build.directory} - 60000 - 3 - true @@ -63,13 +58,15 @@ ${flink.archive.download.skip} ${flink.archive.mirror}/${flink.archive.name} - ${project.build.directory} - 60000 - 3 - true + + ${project.build.directory} + 60000 + 3 + true + diff --git a/pom.xml b/pom.xml index 1ea12aa8a..e9742bb52 100644 --- a/pom.xml +++ b/pom.xml @@ -93,6 +93,7 @@ 2.12 4.8 + https://archive.apache.org/dist 1.67 4.2.8 1.15 @@ -104,7 +105,7 @@ 1.1.0 1.14.3 flink-${flink.version}-bin-scala_${scala.binary.version}.tgz - https://archive.apache.org/dist/flink/flink-${flink.version} + ${apache.archive.dist}/flink/flink-${flink.version} false 3.0.2 30.1-jre @@ -140,7 +141,7 @@ --> 3.2.1 spark-${spark.version}-bin-hadoop3.2.tgz - https://archive.apache.org/dist/spark/spark-${spark.version} + ${apache.archive.dist}/spark/spark-${spark.version} false 2.1.11 4.1.3 @@ -1810,10 +1811,10 @@ - mirror-cn + mirror-cdn + - https://mirrors.bfsu.edu.cn/apache/spark/spark-${spark.version} - https://mirrors.bfsu.edu.cn/apache/flink/flink-${flink.version} + https://dlcdn.apache.org