[KYUUBI #6163 ] Set default Spark version to 3.5

# 🔍 Description
## Issue References 🔗

Kyuubi fully supports Spark 3.5 now, this pull request aims to set the default Spark to 3.5 in Kyuubi 1.9

## Types of changes 🔖

- [ ] Bugfix (non-breaking change which fixes an issue)
- [ ] New feature (non-breaking change which adds functionality)
- [ ] Breaking change (fix or feature that would cause existing functionality to change)

## Test Plan 🧪

Pass GA.

---

# Checklist 📝

- [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html)

**Be nice. Be informative.**

Closes #6163 from pan3793/spark-3.5-default.

Closes #6163

f386aeb7a [Cheng Pan] Set default Spark version to 3.5

Authored-by: Cheng Pan <chengpan@apache.org>
Signed-off-by: Cheng Pan <chengpan@apache.org>

2024-03-12 16:22:37 +08:00

1.4 KiB

Raw Blame History

Kyuubi Spark Listener Extension

Functions

All listener extensions can be implemented in this module, like QueryExecutionListener and ExtraListener
Add SparkOperationLineageQueryExecutionListener to extends spark QueryExecutionListener
SQL lineage parsing will be triggered after SQL execution and will be written to the json logger file

Build

build/mvn clean package -DskipTests -pl :kyuubi-spark-lineage_2.12 -am -Dspark.version=3.2.1

Supported Apache Spark Versions

-Dspark.version=

master
3.5.x (default)
3.4.x
3.3.x
3.2.x
3.1.x

1.4 KiB Raw Blame History

Kyuubi Spark Listener Extension

Functions

Build

Supported Apache Spark Versions

1.4 KiB

Raw Blame History