[KYUUBI #396] Add Backward Compatibility Checker for Compile with Spark 3.0 but Run on 3.1

![yaooqinn](https://badgen.net/badge/Hello/yaooqinn/green) [![Closes #396](https://badgen.net/badge/Preview/Closes%20%23396/blue)](https://github.com/yaooqinn/kyuubi/pull/396) ![10](https://badgen.net/badge/%2B/10/red) ![4](https://badgen.net/badge/-/4/green) ![2](https://badgen.net/badge/commits/2/yellow) ![Target Issue](https://badgen.net/badge/Missing/Target%20Issue/ff0000) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!

Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
  2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
  3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->

### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the use case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->

new ci rule to check Backward Compatibility

### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

Closes #396 from yaooqinn/bc.

ae55ac9 [Kent Yao] ga
bf854bd [Kent Yao] Add Backward Compatibility Checker for Compile with Spark 3.0 but Run on 3.1

Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
This commit is contained in:
Kent Yao 2021-03-04 20:57:58 +08:00
parent 25d2d587b0
commit 874c71c6fe
No known key found for this signature in database
GPG Key ID: F7051850A0AF904D
2 changed files with 10 additions and 4 deletions

View File

@ -18,6 +18,7 @@ jobs:
matrix:
profiles:
- '-Pspark-3.0 -Phadoop-2.7'
- '-Pspark-3.0 -Phadoop-2.7 -Dspark.archive.mirror=https://archive.apache.org/dist/spark/spark-3.1.1 -Dspark.archive.name=spark-3.1.1-bin-hadoop2.7.tgz -Dmaven.plugin.scalatest.exclude.tags=org.apache.kyuubi.tags.DataLakeTest'
- '-Pspark-3.1 -Phadoop-2.7'
- '-Pspark-3.1 -Phadoop-3.2'
steps:

View File

@ -26,21 +26,24 @@ cache:
directories:
- $HOME/.m2
matrix:
include:
- name: Test Kyuubi -Pspark-3.0 -Phadoop-2.7
- name: Test Kyuubi w/ -Pspark-3.0 -Phadoop-2.7
env:
- PROFILE="-Pspark-3.0 -Phadoop-2.7"
- EXCLUDE_TAGS=""
- name: Test Kyuubi -Pspark-3.1 -Phadoop-2.7
- name: Test Kyuubi w/ -Pspark-3.1 -Phadoop-2.7
env:
- PROFILE="-Pspark-3.1 -Phadoop-2.7"
- EXCLUDE_TAGS="org.apache.kyuubi.tags.DataLakeTest"
- name: Test Kyuubi -Pspark-3.1 -Phadoop-3.2
- name: Test Kyuubi w/ -Pspark-3.1 -Phadoop-3.2
env:
- PROFILE="-Pspark-3.1 -Phadoop-3.2"
- EXCLUDE_TAGS="org.apache.kyuubi.tags.DataLakeTest"
- name: Test Kyuubi w/ -Pspark-3.0 -Phadoop-2.7 by Spark 3.1 distribution
env:
- PROFILE="-Pspark-3.0 -Phadoop-2.7 -Dspark.archive.mirror=https://archive.apache.org/dist/spark/spark-3.1.1 -Dspark.archive.name=spark-3.1.1-bin-hadoop2.7.tgz"
- EXCLUDE_TAGS="org.apache.kyuubi.tags.DataLakeTest"
install:
- mvn --version
@ -52,4 +55,6 @@ after_success:
- if [[ -z $EXCLUDE_TAGS ]]; then bash <(curl -s https://codecov.io/bash); fi
after_failure:
- echo "==== Build with $PROFILE FAILED ===="
- for log in `find * -name "kyuubi-spark-sql-engine.log*"`; do echo "=========$log========="; cat $log; done
- for log in `find * -name "unit-tests.log"`; do echo "=========$log========="; cat $log; done