kyuubi/extensions/spark/kyuubi-spark-authz
Cheng Pan a07c57f064
[KYUUBI #6427] Extract data lake artifact names as maven properties
# 🔍 Description

Improve data lake dependency management by extracting the following Maven properties:

- `delta.artifact`
- `hudi.artifact`
- `iceberg.artifact`
- `paimon.artifact`

It often takes a while for the downstream data lakes to support the new Spark versions, extracting those properties makes it easy to override in the new profile on the Kyuubi project's `pom.xml` to workaround before data lakes jars are available.

One use case is a19bb7c18e

## Types of changes 🔖

- [ ] Bugfix (non-breaking change which fixes an issue)
- [ ] New feature (non-breaking change which adds functionality)
- [ ] Breaking change (fix or feature that would cause existing functionality to change)

## Test Plan 🧪

Pass GHA.

---

# Checklist 📝

- [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html)

**Be nice. Be informative.**

Closes #6427 from pan3793/datalake-dep.

Closes #6427

74a9300e0 [Cheng Pan] Improve datalake dependency management

Authored-by: Cheng Pan <chengpan@apache.org>
Signed-off-by: Cheng Pan <chengpan@apache.org>
2024-06-05 15:23:45 +08:00
..
src [KYUUBI #6451] Bump Hudi 0.15.0 and enable Hudi authZ test for Spark 3.5 2024-06-05 12:33:29 +08:00
pom.xml [KYUUBI #6427] Extract data lake artifact names as maven properties 2024-06-05 15:23:45 +08:00
README.md [KYUUBI #6163] Set default Spark version to 3.5 2024-03-12 16:22:37 +08:00

Kyuubi Spark AuthZ Extension

Functions

  • Column-level fine-grained authorization
  • Row-level fine-grained authorization, a.k.a. Row-level filtering
  • Data masking

Build

build/mvn clean package -DskipTests -pl :kyuubi-spark-authz_2.12 -am -Dspark.version=3.2.1 -Dranger.version=2.4.0

Supported Apache Spark Versions

-Dspark.version=

  • master
  • 3.5.x (default)
  • 3.4.x
  • 3.3.x
  • 3.2.x
  • 3.1.x
  • 3.0.x
  • 2.4.x and earlier

Supported Apache Ranger Versions

-Dranger.version=

  • 2.4.x (default)
  • 2.3.x
  • 2.2.x
  • 2.1.x
  • 2.0.x
  • 1.2.x
  • 1.1.x
  • 1.0.x
  • 0.7.x
  • 0.6.x