### Why are the changes needed? In Scala [v2.13.16](https://github.com/scala/scala/releases/tag/v2.13.16) > JNA is no longer a dependency of `scala-compiler.jar` Since Spark 4.0 upgrades to Scala 2.13.16, JNA deps have gone too. ``` $ spark-3.5.5-bin-hadoop3-scala2.13 cat RELEASE Spark 3.5.5 (git revision 7c29c664cdc) built for Hadoop 3.3.4 Build flags: -B -Pmesos -Pyarn -Pkubernetes -Psparkr -Pscala-2.13 -Phadoop-3 -Phive -Phive-thriftserver $ spark-3.5.5-bin-hadoop3-scala2.13 ls jars | grep jna jna-5.9.0.jar ``` ``` $ spark-4.0.0-bin-hadoop3 cat RELEASE Spark 4.0.0 (git revision ca56e9ce591) built for Hadoop 3.4.1 Build flags: -B -Pyarn -Pkubernetes -Psparkr -Phadoop-3 -Phive -Phive-thriftserver $ spark-4.0.0-bin-hadoop3 ls jars | grep jna <no-output> ``` It's rare to use the non-default Scala version with Spark in practice, we shall respect Spark 4 deps for Scala 2.13 cases. ### How was this patch tested? Review. ### Was this patch authored or co-authored using generative AI tooling? No. Closes #6999 from pan3793/authz-scala213. Closes #6999 18230a2d7 [Cheng Pan] Keep JNA in authz-shaded with Scala 2.13 Authored-by: Cheng Pan <chengpan@apache.org> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|---|---|---|
| .. | ||
| kyuubi-extension-spark-3-3 | ||
| kyuubi-extension-spark-3-4 | ||
| kyuubi-extension-spark-3-5 | ||
| kyuubi-extension-spark-jdbc-dialect | ||
| kyuubi-spark-authz | ||
| kyuubi-spark-authz-shaded | ||
| kyuubi-spark-connector-common | ||
| kyuubi-spark-connector-hive | ||
| kyuubi-spark-connector-tpcds | ||
| kyuubi-spark-connector-tpch | ||
| kyuubi-spark-jvm-quake | ||
| kyuubi-spark-lineage | ||