kyuubi/extensions/spark/kyuubi-spark-authz
amanraj2520 35d4b5f0c7
[KYUUBI #6212] Added audit handler shutdown to the shutdown hook
# 🔍 Description

This pull request fixes #6212

When Kyuubi cleans up Ranger related threads like PolicyRefresher, it should also shutdown the audit threads that include SolrZkClient. Otherwise Spark Driver keeps on running since SolrZkClient is a non-daemon thread. Added the cleanup as part of the shutdown hook that Kyuubi registers.

## Types of changes 🔖

- [x] Bugfix (non-breaking change which fixes an issue)
- [ ] New feature (non-breaking change which adds functionality)
- [ ] Breaking change (fix or feature that would cause existing functionality to change)

## Test Plan 🧪

#### Behavior Without This Pull Request ⚰️

#### Behavior With This Pull Request 🎉

#### Related Unit Tests

---

# Checklist 📝

- [ ] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html)

**Be nice. Be informative.**

Closes #6233 from amanraj2520/auditShutdown.

Closes #6212

e663d466c [amanraj2520] Refactored code
ed293a9a4 [amanraj2520] Removed unused import
95a6814ad [amanraj2520] Added audit handler shutdown to the shutdown hook

Authored-by: amanraj2520 <rajaman@microsoft.com>
Signed-off-by: Cheng Pan <chengpan@apache.org>
2024-04-08 10:40:04 +08:00
..
src [KYUUBI #6212] Added audit handler shutdown to the shutdown hook 2024-04-08 10:40:04 +08:00
pom.xml [KYUUBI #6267] Remove unused dependency management in POM 2024-04-07 23:53:46 +08:00
README.md [KYUUBI #6163] Set default Spark version to 3.5 2024-03-12 16:22:37 +08:00

Kyuubi Spark AuthZ Extension

Functions

  • Column-level fine-grained authorization
  • Row-level fine-grained authorization, a.k.a. Row-level filtering
  • Data masking

Build

build/mvn clean package -DskipTests -pl :kyuubi-spark-authz_2.12 -am -Dspark.version=3.2.1 -Dranger.version=2.4.0

Supported Apache Spark Versions

-Dspark.version=

  • master
  • 3.5.x (default)
  • 3.4.x
  • 3.3.x
  • 3.2.x
  • 3.1.x
  • 3.0.x
  • 2.4.x and earlier

Supported Apache Ranger Versions

-Dranger.version=

  • 2.4.x (default)
  • 2.3.x
  • 2.2.x
  • 2.1.x
  • 2.0.x
  • 1.2.x
  • 1.1.x
  • 1.0.x
  • 0.7.x
  • 0.6.x