9fd392b7e9
575 Commits
| Author | SHA1 | Message | Date | |
|---|---|---|---|---|
Cheng Pan
|
9fd392b7e9
|
[KYUUBI #6153] Cut out Hive JDBC and Hive Service deps in beeline module
# 🔍 Description ## Issue References 🔗 This is the next step of https://github.com/apache/kyuubi/issues/6146, cutting out most Hive deps(excepting `hive-common`) and recovering the skipped tests via minor code tunning. ## Describe Your Solution 🔧 - Drop `hive-jdbc`, `hive-service`, `hive-service-rpc` deps in the beeline module. - Migrate from `commons-lang` to `commons-lang3` in the beeline module. - Recover the skipped test `TestClientCommandHookFactory#connectHook` ## Types of changes 🔖 - [x] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 Pass GA, and manually test to ensure the following error has gone. Before ``` roothadoop-master1:/opt/kyuubi# bin/beeline --version Warn: Not find kyuubi environment file /etc/kyuubi/conf/kyuubi-env.sh, using default ones... java.lang.NoClassDefFoundError: org/apache/curator/RetryPolicy ``` After ``` roothadoop-master1:/opt/kyuubi# bin/beeline --version Connecting to jdbc:hive2://hadoop-master1.orb.local:10000/default;password=hive;user=hive Connected to: Apache Hive (version 2.3.9) Driver: Kyuubi Project Hive JDBC Client (version 1.9.0-SNAPSHOT) Beeline version 1.9.0-SNAPSHOT by Apache Kyuubi 0: jdbc:hive2://hadoop-master1.orb.local:1000> ``` --- # Checklist 📝 - [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) **Be nice. Be informative.** Closes #6153 from pan3793/beeline-2. Closes #6153 8cd52e509 [Cheng Pan] notice d03c72992 [Cheng Pan] minor 5d16bf4ce [Cheng Pan] beeline test pass Authored-by: Cheng Pan <chengpan@apache.org> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
Cheng Pan
|
182f4349a7
|
[KYUUBI #6117] Bump Kyuubi Shaded 0.3.0
# 🔍 Description ## Issue References 🔗 This PR upgrades Kyuubi Shaded to 0.3.0, the major changes are: - upgrade Thrift from 0.9.3-1 to 0.16.0 - upgrade JLine used by Zookeeper CLI from 0.9.94 to 2.14.6 - split kyuubi-relocated-thrift from kyuubi-relocated-hive-service-rpc - introduce a light kyuubi-relocated-hive-metastore-client for getting DelegationToken Due to THRIFT-5297 (fixed in 0.14.0) removes requestTimeout and beBackoffSlotLength, the following Kyuubi configurations are removed too. - kyuubi.frontend.login.timeout - kyuubi.frontend.thrift.login.timeout - kyuubi.frontend.backoff.slot.length - kyuubi.frontend.thrift.backoff.slot.length Previously, Zookeeper 3.4 depends on JLine 0.9.94 while Zookeeper 3.6 and Hive Beeline depends on JLine 2.14.6, we pulls different versions of JLine into the binary distribution. Now we align them to a single JLine 2.14.6. ## Describe Your Solution 🔧 Upgrade dependencies and change code to adapt to the breaking changes, also upgrade migration guide to mention the removed configurations. ## Types of changes 🔖 - [ ] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 Pass GA. --- # Checklist 📝 - [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) **Be nice. Be informative.** Closes #6117 from pan3793/shaded-0.3. Closes #6117 5639c9fd8 [Cheng Pan] nit d281cdb4b [Cheng Pan] fix 184e1b95b [Cheng Pan] fix 1628337c8 [Cheng Pan] remove unused conf 24db2d5ad [Cheng Pan] try fix 1e995bb34 [Cheng Pan] nit 1d8e9bce9 [Cheng Pan] dep list 7f33624e8 [Cheng Pan] Bump Kyuubi Shaded 0.3.0 Authored-by: Cheng Pan <chengpan@apache.org> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
Cheng Pan
|
8cc9b98e25
|
[KYUUBI #5384][KSCH] Hive connector supports Spark 3.5
# 🔍 Description ## Issue References 🔗 This pull request fixes #5384 ## Describe Your Solution 🔧 ## Types of changes 🔖 - [ ] Bugfix (non-breaking change which fixes an issue) - [x] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 #### Behavior Without This Pull Request ⚰️ #### Behavior With This Pull Request 🎉 #### Related Unit Tests --- # Checklist 📝 - [ ] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) **Be nice. Be informative.** Closes #6133 from Kwafoor/kyuubi_6073. Closes #5384 9234e35ad [Cheng Pan] fix 7766dfda5 [Cheng Pan] nit e9da162f8 [Cheng Pan] nit 676bfb26e [Cheng Pan] pretty c241859af [Cheng Pan] pretty 0eedcf82c [wangjunbo] compat with spark 3.3 3d866546c [wangjunbo] format code a0898f50f [wangjunbo] delete Unused import 9577f7fe8 [wangjunbo] [KYUUBI #5384] kyuubi-spark-connector-hive supports Spark 3.5 Lead-authored-by: Cheng Pan <chengpan@apache.org> Co-authored-by: wangjunbo <wangjunbo@qiyi.com> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
Cheng Pan
|
85deeccd60
|
[KYUUBI #6139] Expose env vars and sys props to JUnit tests too
# 🔍 Description ## Issue References 🔗 Currently, we leverage `maven-surefire-plugin` to run JUnit tests and `scalatest-maven-plugin` to run Scalatest suites, we should make sure to expose the same env vars and sys props to all tests. ## Describe Your Solution 🔧 Repeat configuration of `scalatest-maven-plugin` to `maven-surefire-plugin` ## Types of changes 🔖 - [x] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 No real affect yet. GA should pass as before. --- # Checklist 📝 - [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) **Be nice. Be informative.** Closes #6139 from pan3793/test. Closes #6139 31d039483 [Cheng Pan] nit 305fb499f [Cheng Pan] nit d67bd268b [Cheng Pan] Expose env vars and sys props to JUnit tests too Authored-by: Cheng Pan <chengpan@apache.org> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
Cheng Pan
|
f1cf1e42de
|
[KYUUBI #6131] Simplify Maven dependency management after dropping building support for Spark 3.1
# 🔍 Description ## Issue References 🔗 SPARK-33212 (fixed in 3.2.0) moves from `hadoop-client` to shaded hadoop client, to simplify the dependency management, previously , we add some workaround to handle Spark 3.1 dependency issues. As we removed building support for Spark 3.1 now, we can remove those workaround to simplify `pom.xml` ## Describe Your Solution 🔧 As above. ## Types of changes 🔖 - [ ] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 Pass GA. --- # Checklist 📝 - [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) **Be nice. Be informative.** Closes #6131 from pan3793/3-1-cleanup. Closes #6131 1341065a7 [Cheng Pan] nit 1d7323f6e [Cheng Pan] fix 9e2e3b747 [Cheng Pan] nit 271166b58 [Cheng Pan] test Authored-by: Cheng Pan <chengpan@apache.org> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
Cheng Pan
|
ab2b7aea4d
|
Revert "[KYUUBI #4279] Use new Apache 'closer.lua' syntax for kyuubi-download to obtain engine"
This reverts commit
|
||
|
Cheng Pan
|
e0d706e696
|
[KYUUBI #6091] Deprecate and remove building support for Spark 3.1
# 🔍 Description ## Issue References 🔗 This pull request aims to remove building support for Spark 3.1, while still keeping the engine support for Spark 3.1. - VOTE: https://lists.apache.org/thread/670fx1qx7rm0vpvk8k8094q2d0fthw5b - VOTE RESULT: https://lists.apache.org/thread/0zdxg5zjnc1wpxmw9mgtsxp1ywqt6qvb The next step is to clean up code in Spark extensions to drop 3.1-related code. ## Describe Your Solution 🔧 - Remove Maven profile `spark-3.1`, and references on docs, release scripts, etc. - Keep the cross-version verification to ensure that the Spark SQL engine built on the default Spark version (3.4) still works well on Spark 3.1 runtime. ## Types of changes 🔖 - [ ] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [x] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 Pass GA. --- # Checklist 📝 - [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) **Be nice. Be informative.** Closes #6091 from pan3793/remove-spark-3.1-profile. Closes #6091 ce2983284 [Cheng Pan] nit 5887c808b [Cheng Pan] migration guide cf28096d3 [Cheng Pan] Log deprecation message on Spark SQL engine with 3.1 a467e618d [Cheng Pan] nit e11c0fb31 [Cheng Pan] Remove building support for Spark 3.1 Authored-by: Cheng Pan <chengpan@apache.org> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
Deepali Gupta
|
8026e72b3c
|
[KYUUBI #6101] Bump Jackson from 2.15.0 to 2.15.4
# 🔍 Description ## Issue References 🔗 This pull request fixes https://github.com/apache/kyuubi/issues/6101 ## Describe Your Solution 🔧 This updates the jackson version from 2.15.0 to 2.15.4 ## Types of changes 🔖 - [ ] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 #### Behavior Without This Pull Request ⚰️ #### Behavior With This Pull Request 🎉 #### Related Unit Tests --- # Checklist 📝 - [X] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) **Be nice. Be informative.** Closes #6110 from Deepali1211/upgrade-jackson. Closes #6101 5da3a2527 [Deepali Gupta] Upgrade jackson to 2.15.4 2666a1eb0 [Deepali Gupta] Upgrade jackson to 2.15.4 Authored-by: Deepali Gupta <Deepali.gupta@ibm.com> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
XH Qian
|
84e60e92db
|
[KYUUBI #6094] Bump Spark from 3.5.0 to 3.5.1
# 🔍 Description ## Issue References 🔗 This pull request closes #6094 ## Describe Your Solution 🔧 Upgrade Spark from 3.5.0 to 3.5.1 ## Types of changes 🔖 - [ ] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 #### Behavior Without This Pull Request ⚰️ #### Behavior With This Pull Request 🎉 #### Related Unit Tests --- # Checklist 📝 - [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) **Be nice. Be informative.** Closes #6103 from GGHWS/features/kyuubi-6094. Closes #6094 c44f2b879 [XH Qian] Upgrade Spark from 3.5.0 to 3.5.1 Authored-by: XH Qian <16678125728@163.com> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
Deepali Gupta
|
494eff41f4
|
[KYUUBI #6097][KYUUBI #6098] Upgrade Flink 1.16.3 and 1.18.1
# 🔍 Description ## Issue References 🔗 This pull request fixes https://github.com/apache/kyuubi/issues/6098, https://github.com/apache/kyuubi/issues/6097 ## Describe Your Solution 🔧 Upgrade flink from 1.16.2 to 1.16.3 and 1.18.0 to 1.18.1 ## Types of changes 🔖 - [ ] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 #### Behavior Without This Pull Request ⚰️ #### Behavior With This Pull Request 🎉 #### Related Unit Tests --- # Checklist 📝 - [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) **Be nice. Be informative.** Closes #6105 from Deepali1211/master. Closes #6097 Closes #6098 0d3516b24 [Deepali Gupta] Update flink version 1543443d3 [Deepali Gupta] Update flink version c95e3bfc0 [Deepali Gupta] Update flink version Lead-authored-by: Deepali Gupta <g.deepali1211@gmail.com> Co-authored-by: Deepali Gupta <90255953+Deepali1211@users.noreply.github.com> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
Cheng Pan
|
c6962beb65
|
[KYUUBI #6096] Enable PySpark tests for Spark 3.5
# 🔍 Description ## Issue References 🔗 As title ## Describe Your Solution 🔧 As title ## Types of changes 🔖 - [ ] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 Pass GA. --- # Checklist 📝 - [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) **Be nice. Be informative.** Closes #6096 from pan3793/spark-3.5-pyspark. Closes #6096 49229f7f7 [Cheng Pan] Enable PySpark tests for Spark 3.5 Authored-by: Cheng Pan <chengpan@apache.org> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
Cheng Pan
|
07068a8416
|
[KYUUBI #6095] Enable PaimonTest for Spark 3.5
# 🔍 Description ## Issue References 🔗 This pull request enables PaimonTest for Spark 3.5 ## Describe Your Solution 🔧 As Paimon 0.7.0 already brings support for Spark 3.5, we should enable PaimonTest for Spark 3.5. ## Types of changes 🔖 - [ ] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 Pass GA. --- # Checklist 📝 - [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) **Be nice. Be informative.** Closes #6095 from pan3793/paimon-spark-3.5. Closes #6095 f55801b7f [Cheng Pan] Enable PaimonTest for Spark 3.5 Authored-by: Cheng Pan <chengpan@apache.org> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
zml1206
|
aab8c18c93
|
[KYUUBI #6092] Enable DeltaTest for Spark 3.5
# 🔍 Description ## Issue References 🔗 This pull request fixes #6092 ## Describe Your Solution 🔧 ## Types of changes 🔖 - [ ] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 #### Behavior Without This Pull Request ⚰️ Don't run `DeltaTest` for Spark 3.5 #### Behavior With This Pull Request 🎉 Run `DeltaTest` for Spark 3.5 #### Related Unit Tests --- # Checklist 📝 - [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) **Be nice. Be informative.** Closes #6093 from zml1206/KYUUBI-6092. Closes #6092 623025ad3 [zml1206] Support DeltaTest for Spark 3.5 Authored-by: zml1206 <zhuml1206@gmail.com> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
Cheng Pan
|
3247e432f5
|
[KYUUBI #6090] Bump Delta from 3.0.0 to 3.1.0 for Spark 3.5
# 🔍 Description ## Issue References 🔗 [Delta 3.1.0](https://github.com/delta-io/delta/releases/tag/v3.1.0) is available, which is built on top of Spark 3.5. ## Describe Your Solution 🔧 Bump Delta from 3.0.0 to 3.1.0 for Spark 3.5 ## Types of changes 🔖 - [ ] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 Pass GA. --- # Checklist 📝 - [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) **Be nice. Be informative.** Closes #6090 from pan3793/delta-3.1. Closes #6090 45321e404 [Cheng Pan] Bump Delta from 3.0.0 to 3.1.0 for Spark 3.5 Authored-by: Cheng Pan <chengpan@apache.org> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
Cheng Pan
|
2f2d42ea9c
|
[KYUUBI #6089] Bump Paimon from 0.5.0-incubating to 0.7.0-incubating
# 🔍 Description ## Issue References 🔗 This pull request bumps Paimon from 0.5.0-incubating to 0.7.0-incubating, which brings the Spark 3.5 support. ## Describe Your Solution 🔧 Same as above. ## Types of changes 🔖 - [ ] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 Pass GA. --- # Checklist 📝 - [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) **Be nice. Be informative.** Closes #6089 from pan3793/paimon-0.7. Closes #6089 9d449bcc0 [Cheng Pan] Bump Paimon 0.7.0-incubating Authored-by: Cheng Pan <chengpan@apache.org> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
senmiaoliu
|
2f03c94993
|
[KYUUBI #6083] Bump Spark 3.3.3 to 3.3.4
# 🔍 Description ## Issue References 🔗 This pull request fixes # close #6083 ## Describe Your Solution 🔧 Please include a summary of the change and which issue is fixed. Please also include relevant motivation and context. List any dependencies that are required for this change. ## Types of changes 🔖 - [ ] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 #### Behavior Without This Pull Request ⚰️ #### Behavior With This Pull Request 🎉 #### Related Unit Tests --- # Checklist 📝 - [ ] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) **Be nice. Be informative.** Closes #6087 from lsm1/branch-kyuubi-6083. Closes #6083 60e994504 [senmiaoliu] bump spark 3.3.4 Authored-by: senmiaoliu <senmiaoliu@trip.com> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
Cheng Pan
|
0689b37234
|
[KYUUBI #6085] Bump gRPC from 1.60.1 to 1.60.2
# 🔍 Description ## Issue References 🔗 A routine work, keep deps up-to-date. ## Describe Your Solution 🔧 Bump gRPC from 1.60.1 to 1.60.2 ## Types of changes 🔖 - [ ] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 Pass GA. --- # Checklist 📝 - [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) **Be nice. Be informative.** Closes #6085 from pan3793/grpc-1-60-2. Closes #6085 68f1cae53 [Cheng Pan] fix 3cdf9bd1b [Cheng Pan] Bump gRPC from 1.60.1 to 1.60.2 Authored-by: Cheng Pan <chengpan@apache.org> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
dependabot[bot]
|
c93e0a2779 |
[KYUUBI #6067] Bump org.postgresql:postgresql from 42.6.0 to 42.7.2
Bumps [org.postgresql:postgresql](https://github.com/pgjdbc/pgjdbc) from 42.6.0 to 42.7.2. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/pgjdbc/pgjdbc/releases">org.postgresql:postgresql's releases</a>.</em></p> <blockquote> <h2>v42.7.1</h2> <h2>Fixed regressions since 42.7.0</h2> <ul> <li>Revert "Use canonical DateStyle name (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2925">#2925</a>)" <a href="https://github.com/vlsi"><code>vlsi</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3035">#3035</a>)</li> <li>Revert "feat: support SET statements combining with other queries with semicolon in PreparedStatement" <a href="https://github.com/vlsi"><code>vlsi</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3010">#3010</a>)</li> <li>chore: use java.release=8 when building pgjdbc from the generated source distribution <a href="https://github.com/vlsi"><code>vlsi</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3038">#3038</a>), the driver uses Java 8 methods only</li> </ul> <h2>Changes</h2> <ul> <li>Apply connectTimeout before SSLSocket.startHandshake to avoid infinite wait in case the connection is broken <a href="https://github.com/davecramer"><code>davecramer</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3040">#3040</a>)</li> <li>perf: improve performance of PreparedStatement.setBlob, BlobInputStream, and BlobOutputStream with dynamic buffer sizing <a href="https://github.com/vlsi"><code>vlsi</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3044">#3044</a>)</li> <li>fix: avoid timezone conversions when sending LocalDateTime to the database <a href="https://github.com/vlsi"><code>vlsi</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2852">#2852</a>)</li> <li>fix: support waffle-jna 2.x and 3.x by using reflective approach for ManagedSecBufferDesc <a href="https://github.com/chrullrich"><code>chrullrich</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2720">#2720</a>)</li> </ul> <h2>🧰 Maintenance</h2> <ul> <li>chore: bump Gradle to 8.5 <a href="https://github.com/vlsi"><code>vlsi</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3045">#3045</a>)</li> <li>chore: use Java 17 for building pgjdbc, and use --release 8 to target Java 8, add tests with Java 21 and 22 <a href="https://github.com/vlsi"><code>vlsi</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3026">#3026</a>)</li> <li>fedora/rpm: move source build to java-17-openjdk-devel <a href="https://github.com/praiskup"><code>praiskup</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3036">#3036</a>)</li> <li>Update site 42 7 0 <a href="https://github.com/davecramer"><code>davecramer</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3004">#3004</a>)</li> <li>prepared for release 42.7.1 update changelogs <a href="https://github.com/davecramer"><code>davecramer</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3037">#3037</a>)</li> </ul> <h2>⬆️ Dependencies</h2> <ul> <li>fix(deps): update dependency org.checkerframework:org.checkerframework.gradle.plugin to v0.6.36 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3060">#3060</a>)</li> <li>chore(deps): update plugin biz.aqute.bnd.builder to v7 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3034">#3034</a>)</li> <li>fix(deps): update dependency com.github.spotbugs:com.github.spotbugs.gradle.plugin to v6 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3056">#3056</a>)</li> <li>fix(deps): update dependency com.github.spotbugs:com.github.spotbugs.gradle.plugin to v5.2.5 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3032">#3032</a>)</li> <li>chore(deps): update codecov/codecov-action digest to b0466b4 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3059">#3059</a>)</li> <li>fix(deps): update checkerframework to v3.41.0 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3058">#3058</a>)</li> <li>fix(deps): update logback to v1.2.13 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3053">#3053</a>)</li> <li>chore(deps): update codecov/codecov-action digest to 438fa9e <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3051">#3051</a>)</li> <li>fix(deps): update dependency spotbugs to v4.8.2 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3052">#3052</a>)</li> <li>chore: bump Gradle to 8.5 <a href="https://github.com/vlsi"><code>vlsi</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3045">#3045</a>)</li> <li>fix(deps): update dependency org.ops4j.pax.url:pax-url-aether to v2.6.14 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3030">#3030</a>)</li> <li>chore(deps): update plugin org.nosphere.gradle.github.actions to v1.4.0 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3031">#3031</a>)</li> <li>chore(deps): update dependency ubuntu to v22 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3033">#3033</a>)</li> <li>fix(deps): update checkerframework <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3027">#3027</a>)</li> <li>fix(deps): update dependency spotbugs to v4.8.1 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3023">#3023</a>)</li> <li>fix(deps): update dependency uk.org.webcompere:system-stubs-jupiter to v2.1.5 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3024">#3024</a>)</li> <li>fix(deps): update jmh to v1.37 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3025">#3025</a>)</li> <li>fix(deps): update dependency com.google.errorprone:error_prone_core to v2.23.0 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3022">#3022</a>)</li> <li>fix(deps): update junit5 monorepo to v5.10.1 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3015">#3015</a>)</li> <li>chore(deps): update plugin com.github.burrunan.s3-build-cache to v1.7 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3016">#3016</a>)</li> <li>chore(deps): update dependency com.typesafe.play:sbt-plugin to v2.9.0 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3021">#3021</a>)</li> <li>fix(deps): update dependency checkstyle to v10.12.5 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3020">#3020</a>)</li> <li>chore(deps): update codecov/codecov-action digest to 920a494 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3019">#3019</a>)</li> <li>chore(deps): update actions/github-script action to v7 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3018">#3018</a>)</li> </ul> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Changelog</summary> <p><em>Sourced from <a href="https://github.com/pgjdbc/pgjdbc/blob/master/CHANGELOG.md">org.postgresql:postgresql's changelog</a>.</em></p> <blockquote> <h1>Changelog</h1> <p>Notable changes since version 42.0.0, read the complete <a href="https://jdbc.postgresql.org/documentation/changelog.html">History of Changes</a>.</p> <p>The format is based on <a href="http://keepachangelog.com/en/1.0.0/">Keep a Changelog</a>.</p> <h2>[Unreleased]</h2> <h3>Changed</h3> <h3>Added</h3> <ul> <li>feat: Add PasswordUtil for encrypting passwords client side [PR <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3082">#3082</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/3082">pgjdbc/pgjdbc#3082</a>)</li> </ul> <h3>Fixed</h3> <h2>[42.7.1] (2023-12-06 08:34:00 -0500)</h2> <h3>Changed</h3> <ul> <li>perf: improve performance of PreparedStatement.setBlob, BlobInputStream, and BlobOutputStream with dynamic buffer sizing [PR <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3044">#3044</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/3044">pgjdbc/pgjdbc#3044</a>)</li> </ul> <h3>Fixed</h3> <ul> <li>fix: Apply connectTimeout before SSLSocket.startHandshake to avoid infinite wait in case the connection is broken [PR <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3040">#3040</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/3040">pgjdbc/pgjdbc#3040</a>)</li> <li>fix: support waffle-jna 2.x and 3.x by using reflective approach for ManagedSecBufferDesc [PR <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2720">#2720</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/2720">pgjdbc/pgjdbc#2720</a>) Fixes [Issue <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2690">#2690</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2720">pgjdbc/pgjdbc#2720</a>).</li> <li>fix: NoSuchMethodError on ByteBuffer#position When Running on Java 8 when accessing arrays, fixes [Issue <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3014">#3014</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3014">pgjdbc/pgjdbc#3014</a>)</li> <li>Revert "[PR <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2925">#2925</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/2925">pgjdbc/pgjdbc#2925</a>) Use canonical DateStyle name" [PR <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3035">#3035</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/3035">pgjdbc/pgjdbc#3035</a>) Fixes [Issue <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3008">#3008</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3008">pgjdbc/pgjdbc#3008</a>)</li> <li>Revert "[PR #<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2973">#2973</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/2973">pgjdbc/pgjdbc#2973</a>) feat: support SET statements combining with other queries with semicolon in PreparedStatement" [PR <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3010">#3010</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/3010">pgjdbc/pgjdbc#3010</a>) Fixes [Issue <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3007">#3007</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3007">pgjdbc/pgjdbc#3007</a>)</li> <li>fix: avoid timezone conversions when sending LocalDateTime to the database <a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/3010">#2852</a> Fixes [Issue <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/1390">#1390</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/1390">pgjdbc/pgjdbc#1390</a>) ,[Issue <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2850">#2850</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2850">pgjdbc/pgjdbc#2850</a>) Closes [Issue <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/1391">#1391</a>(https://redirect.github.com/pgjdbc/pgjdbc/issues/1391)</li> </ul> <h2>[42.7.0] (2023-11-20 09:33:00 -0500)</h2> <h3>Changed</h3> <ul> <li>fix: Deprecate for removal PGPoint.setLocation(java.awt.Point) to cut dependency to <code>java.desktop</code> module. [PR <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2967">#2967</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/2967">pgjdbc/pgjdbc#2967</a>)</li> <li>feat: return all catalogs for getCatalogs metadata query closes [ISSUE <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2949">#2949</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2949">pgjdbc/pgjdbc#2949</a>) [PR <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2953">#2953</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/2953">pgjdbc/pgjdbc#2953</a>)</li> <li>feat: support SET statements combining with other queries with semicolon in PreparedStatement [PR #<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2973">#2973</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/2973">pgjdbc/pgjdbc#2973</a>)</li> </ul> <h3>Fixed</h3> <ul> <li>chore: add styleCheck Gradle task to report style violations [PR <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2980">#2980</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/2980">pgjdbc/pgjdbc#2980</a>)</li> <li>fix: Include currentXid in "Error rolling back prepared transaction" exception message [PR <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2978">#2978</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/2978">pgjdbc/pgjdbc#2978</a>)</li> <li>fix: add varbit as a basic type inside the TypeInfoCache [PR <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2960">#2960</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/2960">pgjdbc/pgjdbc#2960</a>)</li> <li>fix: Fix failing tests for version 16. [PR <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2962">#2962</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/2962">pgjdbc/pgjdbc#2962</a>)</li> <li>fix: allow setting arrays with ANSI type name [PR <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2952">#2952</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/2952">pgjdbc/pgjdbc#2952</a>)</li> <li>feat: Use KeepAlive to confirm LSNs [PR <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2941">#2941</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/2941">pgjdbc/pgjdbc#2941</a>)</li> <li>fix: put double ' around log parameter [PR <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2936">#2936</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/2936">pgjdbc/pgjdbc#2936</a>) fixes [ISSUE <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2935">#2935</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2935">pgjdbc/pgjdbc#2935</a>)</li> <li>fix: Fix Issue <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2928">#2928</a> number of ports not equal to number of servers in datasource [PR <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2929">#2929</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/2929">pgjdbc/pgjdbc#2929</a>)</li> <li>fix: Use canonical DateStyle name (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2925">#2925</a>) fixes <a href="https://redirect.github.com/pgbouncer/pgbouncer/issues/776">pgbouncer issue</a></li> <li>fix: Method getFastLong should be able to parse all longs [PR <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2881">#2881</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/2881">pgjdbc/pgjdbc#2881</a>)</li> <li>docs: Fix typos in info.html [PR <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2860">#2860</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/2860">pgjdbc/pgjdbc#2860</a>)</li> </ul> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Commits</summary> <ul> <li>See full diff in <a href="https://github.com/pgjdbc/pgjdbc/commits">compare view</a></li> </ul> </details> <br /> [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `dependabot rebase` will rebase this PR - `dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `dependabot merge` will merge this PR after your CI passes on it - `dependabot squash and merge` will squash and merge this PR after your CI passes on it - `dependabot cancel merge` will cancel a previously requested merge and block automerging - `dependabot reopen` will reopen this PR if it is closed - `dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) You can disable automated security fix PRs for this repo from the [Security Alerts page](https://github.com/apache/kyuubi/network/alerts). </details> Closes #6067 from dependabot[bot]/dependabot/maven/org.postgresql-postgresql-42.7.2. Closes #6067 55ea68732 [dependabot[bot]] ⬆️ Bump org.postgresql:postgresql from 42.6.0 to 42.7.2 Authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
GGHWS
|
f61338db49
|
[KYUUBI #6063] Bump iceberg 1.4.3
# 🔍 Description ## Issue References 🔗 This pull request closes #6063 ## Describe Your Solution 🔧 ## Types of changes 🔖 - [ ] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 #### Behavior Without This Pull Request ⚰️ #### Behavior With This Pull Request 🎉 #### Related Unit Tests # Checklist 📝 - [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) **Be nice. Be informative.** Closes #6065 from GGHWS/features/kyuubi-6063. Closes #6063 f25f82b93 [GGHWS] Bump iceberg 1.4.3 Authored-by: GGHWS <16678125728@163.com> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
yuqingyang
|
47a1091fa8
|
[KYUUBI #4279] Use new Apache 'closer.lua' syntax for kyuubi-download to obtain engine
…ne archives # 🔍 Description ## Issue References [4279](https://github.com/apache/kyuubi/issues/4279)🔗 This pull request fixes # ## Describe Your Solution 🔧 Use new Apache 'closer.lua' syntax for kyuubi-download to obtain engine ## Types of changes 🔖 - [x] New feature (non-breaking change which adds functionality) ## Test Plan 🧪 #### Behavior Without This Pull Request ⚰️ #### Behavior With This Pull Request 🎉 #### Related Unit Tests --- # Checklist 📝 - [ ] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) **Be nice. Be informative.** Closes #6009 from sincewhen/master. Closes #4279 2152a9b92 [yuqingyang] Use new Apache 'closer.lua' syntax for kyuubi-download to obtain engine archives Authored-by: yuqingyang <yuqingyang@kingsoft.com> Signed-off-by: Kent Yao <yao@apache.org> |
||
|
Cheng Pan
|
87ed400562
|
[KYUUBI #5975] Bump trino-client 411
# 🔍 Description ## Issue References 🔗 This is a regular dependency upgrading, ## Describe Your Solution 🔧 Upgrade `trino-client` from 363 to 411. 411 is the latest version which uses okhttp 3.x, hence it does not have kotlin runtime dependencies. This PR also updates the docs, especially the Trino cluster version requirement. ## Types of changes 🔖 - [ ] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 Pass GA. --- # Checklist 📝 - [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) **Be nice. Be informative.** Closes #5975 from pan3793/trino-411. Closes #5975 2b57df34d [Cheng Pan] fix c498a5bb3 [Cheng Pan] fix 21948ca4f [Cheng Pan] Fix compile e4f1397cc [Cheng Pan] license 66583ca16 [Cheng Pan] Bump trino-client 411 Authored-by: Cheng Pan <chengpan@apache.org> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
Cheng Pan
|
35e988d182
|
[KYUUBI #5974] Bump jetcd 0.7.7
# 🔍 Description ## Issue References 🔗 It's regular dependency upgrading, and jetcd 0.7.7 may be the latest version that supports Java 8. ## Describe Your Solution 🔧 Upgrading jetcd to 0.7.7, and this upgrading involves the transitive dep `failsafe` major upgrades, the group is changed from `net.jodah` to `dev.failsafe` ## Types of changes 🔖 - [ ] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 Pass GA. --- # Checklist 📝 - [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) **Be nice. Be informative.** Closes #5974 from pan3793/jetcd-version. Closes #5974 7c1d815a4 [Cheng Pan] relocation 5eca6cdb4 [Cheng Pan] Bump jetcd 0.7.7 Authored-by: Cheng Pan <chengpan@apache.org> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
Cheng Pan
|
f35761b50f
|
[KYUUBI #5973] Bump gRPC from 1.53.0 to 1.60.1
# 🔍 Description ## Issue References 🔗 It's a regular dependency upgrading task. ## Describe Your Solution 🔧 Bump gRPC from 1.53.0 to 1.60.1, a new module [grpc-util](https://mvnrepository.com/artifact/io.grpc/grpc-util) was added in 1.58.0, LICENSE files updated accordingly. https://github.com/grpc/grpc-java/releases ## Types of changes 🔖 - [ ] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 Pass GA. --- # Checklist 📝 - [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) **Be nice. Be informative.** Closes #5973 from pan3793/grpc. Closes #5973 b47c7f295 [Cheng Pan] nit dd0e966f0 [Cheng Pan] Bump gRPC from 1.53.0 to 1.60.1 Authored-by: Cheng Pan <chengpan@apache.org> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
liuxiao
|
bffbdbdaa5
|
[KYUUBI #5962] Bump Flink 1.17.1 to 1.17.2
# 🔍 Description ## Issue References 🔗 This pull request fixes when exec `./build/mvn clean package -Pmirror-cdn -DskipTests -Dapache.archive.dist=https://mirrors.aliyun.com/apache/`, it shows flink 1.17.1 is missing. ## Describe Your Solution 🔧 Please include a summary of the change and which issue is fixed. Please also include relevant motivation and context. List any dependencies that are required for this change. ## Types of changes 🔖 - [ ] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 #### Behavior Without This Pull Request ⚰️ #### Behavior With This Pull Request 🎉 #### Related Unit Tests --- # Checklist 📝 - [ ] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) **Be nice. Be informative.** Closes #5962 from liuxiaocs7/bump_flink. Closes #5962 5a9496d12 [liuxiao] Bump Flink 1.17.1 to 1.17.2 Authored-by: liuxiao <liuxiao2103@qq.com> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
zwangsheng
|
c6bba915b2
|
[KYUUBI #5941] Drop Kubernetes Block Cleaner Tool from Kyuubi
# 🔍 Description ## Issue References 🔗 This pull request fixes #5941 ## Describe Your Solution 🔧 Originally aims to support Spark On Kubernetes Shuffle Data Clean, limitations became more and more apparent over time, so let's drop this. ## Types of changes 🔖 - [ ] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [x] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 #### Behavior Without This Pull Request ⚰️ #### Behavior With This Pull Request 🎉 #### Related Unit Tests --- # Checklist 📝 - [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) **Be nice. Be informative.** Closes #5942 from zwangsheng/KYUUBI#5941. Closes #5941 23bf14f37 [Cheng Pan] Update docs/tools/spark_block_cleaner.md 1c3350186 [zwangsheng] fix comment 0bdbb1104 [zwangsheng] nit 0a5aa2bfa [zwangsheng] fix comments Lead-authored-by: zwangsheng <binjieyang@apache.org> Co-authored-by: Cheng Pan <pan3793@gmail.com> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
Bowen Liang
|
e2d9a8efb6
|
[KYUUBI #5879] Bump dropwizard metrics from 4.2.8 to 4.2.23
# 🔍 Description ## Issue References 🔗 As described. ## Describe Your Solution 🔧 - Currently used Dropwiard Metrics v4.2.8 was released on Feb 3, 2022 - Dropwiard Metrics v4.2.23 released on Dec 6, 2023, release notes: https://github.com/dropwizard/metrics/releases/tag/v4.2.23 ## Types of changes 🔖 - [ ] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 #### Behavior Without This Pull Request ⚰️ No behaviour changes. #### Behavior With This Pull Request 🎉 No behaviour changes. #### Related Unit Tests No behaviour changes. --- # Checklists ## 📝 Author Self Checklist - [ ] My code follows the [style guidelines](https://kyuubi.readthedocs.io/en/master/contributing/code/style.html) of this project - [ ] I have performed a self-review - [ ] I have commented my code, particularly in hard-to-understand areas - [ ] I have made corresponding changes to the documentation - [ ] My changes generate no new warnings - [ ] I have added tests that prove my fix is effective or that my feature works - [ ] New and existing unit tests pass locally with my changes - [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) ## 📝 Committer Pre-Merge Checklist - [x] Pull request title is okay. - [x] No license issues. - [x] Milestone correctly set? - [x] Test coverage is ok - [x] Assignees are selected. - [x] Minimum number of approvals - [x] No changes are requested **Be nice. Be informative.** Closes #5879 from bowenliang123/metrics-4.2.23. Closes #5879 08c3469f4 [Bowen Liang] bump dropwizard to 4.2.23 Authored-by: Bowen Liang <liangbowen@gf.com.cn> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
zml1206
|
b3d33cabfa |
[KYUUBI #5856] Bump Spark 3.4.2
# 🔍 Description ## Issue References 🔗 This pull request fixes #5856 ## Describe Your Solution 🔧 ## Types of changes 🔖 - [ ] Bugfix (non-breaking change which fixes an issue) - [x] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 #### Behavior Without This Pull Request ⚰️ #### Behavior With This Pull Request 🎉 #### Related Unit Tests --- # Checklists ## 📝 Author Self Checklist - [x] My code follows the [style guidelines](https://kyuubi.readthedocs.io/en/master/contributing/code/style.html) of this project - [x] I have performed a self-review - [ ] I have commented my code, particularly in hard-to-understand areas - [ ] I have made corresponding changes to the documentation - [x] My changes generate no new warnings - [ ] I have added tests that prove my fix is effective or that my feature works - [ ] New and existing unit tests pass locally with my changes - [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) ## 📝 Committer Pre-Merge Checklist - [x] Pull request title is okay. - [x] No license issues. - [x] Milestone correctly set? - [x] Test coverage is ok - [x] Assignees are selected. - [x] Minimum number of approvals - [x] No changes are requested **Be nice. Be informative.** Closes #5859 from zml1206/KYUUBI-5856. Closes #5856 872fd06d2 [zml1206] Revert changes in SparkProcessBuilderSuite bc4996f90 [zml1206] Bump spark 3.4.2 Authored-by: zml1206 <zhuml1206@gmail.com> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
Bowen Liang
|
acdd74d5ca |
[KYUUBI #5862] Use TestContainerForAll for testing JDBC engine with testcontainers
# 🔍 Description ## Issue References 🔗 As described. ## Describe Your Solution 🔧 - replacing the usage of `ForAllTestContainer` with `TestContainerForAll`, simplifying the lifecycle for starting / stopping the containers and fetching the configs from the containers - use `testcontainers-scala-postgresql` for testing with PostgreSQL containers - add version 16 for PostgreSQL image tag ## Types of changes 🔖 - [ ] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 #### Behavior Without This Pull Request ⚰️ No behaviour changes. #### Behavior With This Pull Request 🎉 No behaviour changes. #### Related Unit Tests JDBC Engine IT. --- # Checklists ## 📝 Author Self Checklist - [x] My code follows the [style guidelines](https://kyuubi.readthedocs.io/en/master/contributing/code/style.html) of this project - [x] I have performed a self-review - [ ] I have commented my code, particularly in hard-to-understand areas - [ ] I have made corresponding changes to the documentation - [x] My changes generate no new warnings - [ ] I have added tests that prove my fix is effective or that my feature works - [x] New and existing unit tests pass locally with my changes - [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) ## 📝 Committer Pre-Merge Checklist - [ ] Pull request title is okay. - [ ] No license issues. - [ ] Milestone correctly set? - [ ] Test coverage is ok - [ ] Assignees are selected. - [ ] Minimum number of approvals - [ ] No changes are requested **Be nice. Be informative.** Closes #5862 from bowenliang123/jdbc-container. Closes #5862 29e85121c [Bowen Liang] TestContainerForAll Authored-by: Bowen Liang <liangbowen@gf.com.cn> Signed-off-by: liangbowen <liangbowen@gf.com.cn> |
||
|
hezhao2
|
8ab4763ce4 |
[KYUUBI #5828] [CHAT] Kyuubi chat engine supports ernie bot(文心一言)
# 🔍 Description ## Issue References 🔗 This pull request fixes #5386 ## Describe Your Solution 🔧 add a new backend(ernie bot) for the Chat engine. <img width="1672" alt="Screenshot 2023-12-07 at 16 20 56" src="https://github.com/apache/kyuubi/assets/32693629/9850916c-3c4a-433c-8278-3068e7b37314"> ## Types of changes 🔖 - [ ] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 #### Behavior Without This Pull Request ⚰️ #### Behavior With This Pull Request 🎉 #### Related Unit Tests --- # Checklists ## 📝 Author Self Checklist - [ ] My code follows the [style guidelines](https://kyuubi.readthedocs.io/en/master/contributing/code/style.html) of this project - [ ] I have performed a self-review - [ ] I have commented my code, particularly in hard-to-understand areas - [ ] I have made corresponding changes to the documentation - [ ] My changes generate no new warnings - [ ] I have added tests that prove my fix is effective or that my feature works - [ ] New and existing unit tests pass locally with my changes - [ ] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) ## 📝 Committer Pre-Merge Checklist - [x] Pull request title is okay. - [x] No license issues. - [x] Milestone correctly set? - [ ] Test coverage is ok - [x] Assignees are selected. - [x] Minimum number of approvals - [x] No changes are requested **Be nice. Be informative.** Closes #5828 from zhaohehuhu/dev-1207. Closes #5828 c7314d4a8 [Cheng Pan] Update externals/kyuubi-chat-engine/src/main/scala/org/apache/kyuubi/engine/chat/ernie/service/ErnieBotService.scala 0c4e01007 [hezhao2] update doc 78e51b3d1 [hezhao2] add ernie into doc 2f4a63845 [hezhao2] refactor 832bc0453 [hezhao2] delete enum model 67214c575 [hezhao2] get rid of some java code 567772679 [hezhao2] java bean to scale case class 4d5c5940d [hezhao2] refactor some params 7c44eb83f [hezhao2] refactor some params 56b9ad13a [hezhao2] refactor a8e3d6cf6 [hezhao2] refactor 7376d800d [hezhao2] Kyuubi chat engine supports ernie bot 4b72a09c0 [hezhao2] Kyuubi chat engine supports ernie bot Lead-authored-by: hezhao2 <hezhao2@cisco.com> Co-authored-by: Cheng Pan <pan3793@gmail.com> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
Cheng Pan
|
ffcee97afe
|
[KYUUBI #5837] [INFRA] Only enable Jacoco with explicit profile
# 🔍 Description ## Issue References 🔗 Currently, we always enable Jacoco, which would add additional building time and produce lots of HTML files, also increase the IDEA indexing burden. <img width="1065" alt="image" src="https://github.com/apache/kyuubi/assets/26535726/6276f309-8ba4-4563-96d6-91cb53ce20a5"> ## Describe Your Solution 🔧 Add a new maven profile `codecov`, only enable it in CI with codecov enabled. ## Types of changes 🔖 - [ ] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 See CI result. --- # Checklists ## 📝 Author Self Checklist - [x] My code follows the [style guidelines](https://kyuubi.readthedocs.io/en/master/contributing/code/style.html) of this project - [x] I have performed a self-review - [ ] I have commented my code, particularly in hard-to-understand areas - [ ] I have made corresponding changes to the documentation - [x] My changes generate no new warnings - [ ] I have added tests that prove my fix is effective or that my feature works - [x] New and existing unit tests pass locally with my changes - [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) ## 📝 Committer Pre-Merge Checklist - [x] Pull request title is okay. - [x] No license issues. - [x] Milestone correctly set? - [x] Test coverage is ok - [x] Assignees are selected. - [x] Minimum number of approvals - [x] No changes are requested **Be nice. Be informative.** Closes #5837 from pan3793/codecov. Closes #5837 97d0b22de [Cheng Pan] fi c60367dd1 [Cheng Pan] fix a0e8910bc [Cheng Pan] Only enable Jacoco with explicit profile Authored-by: Cheng Pan <chengpan@apache.org> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
Cheng Pan
|
9be0c65fe9
|
[KYUUBI #5783] Switch to kyuubi-relocated-hive-service-rpc
# 🔍 Description ## Issue References 🔗 TL;DR there are some issues with shading Thrift RPC classes during the engine packaging phase, see details in the PR description of https://github.com/apache/kyuubi-shaded/pull/20. ## Describe Your Solution 🔧 This PR aims to migrate from vanilla `hive-service-rpc`, `libfb303`, `libthrift` to `kyuubi-relocated-hive-service-rpc` introduced in https://github.com/apache/kyuubi-shaded/pull/20, the detailed works are: - replace imported deps in `pom.xml` and rename the package prefix in all modules, except for - `kyuubi-server` there are a few places use vanilla thrift classes to access HMS to get token - `kyuubi-hive-sql-engine` Hive method invocation - update relocations rules in modules that creates shaded jar - introduce `HiveRpcUtils` in `kyuubi-hive-sql-engine` module for object conversion. As part of the whole change, this PR upgrades from the Kyuubi Shaded 0.1.0 to 0.2.0, which changes the jars name. see https://kyuubi.apache.org/shaded-release/0.2.0.html ## Types of changes 🔖 - [x] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 #### Behavior Without This Pull Request ⚰️ #### Behavior With This Pull Request 🎉 #### Related Unit Tests Pass all Hive UT with Hive 3.1.3, and IT with Hive 3.1.3 and 2.3.9 (also tested with 2.1.1-cdh6.3.2) --- # Checklists ## 📝 Author Self Checklist - [ ] My code follows the [style guidelines](https://kyuubi.readthedocs.io/en/master/contributing/code/style.html) of this project - [x] I have performed a self-review - [x] I have commented my code, particularly in hard-to-understand areas - [ ] I have made corresponding changes to the documentation - [x] My changes generate no new warnings - [ ] I have added tests that prove my fix is effective or that my feature works - [x] New and existing unit tests pass locally with my changes - [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) ## 📝 Committer Pre-Merge Checklist - [x] Pull request title is okay. - [x] No license issues. - [x] Milestone correctly set? - [x] Test coverage is ok - [x] Assignees are selected. - [x] Minimum number of approvals - [x] No changes are requested **Be nice. Be informative.** Closes #5783 from pan3793/rpc-shaded. Closes #5783 b45d4deaa [Cheng Pan] remove staging repo 890076a20 [Cheng Pan] Kyuubi Shaded 0.2.0 RC0 071945d45 [Cheng Pan] Rebase 199794ed9 [Cheng Pan] fix fc128b170 [Cheng Pan] fix 26d313896 [Cheng Pan] fix 632984c92 [Cheng Pan] fix 428305589 [Cheng Pan] fix 6301e28fd [Cheng Pan] fix 955cdb33b [Cheng Pan] Switch to kyuubi-shaded-hive-service-rpc Authored-by: Cheng Pan <chengpan@apache.org> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
wangjunbo
|
5481bf54f2 |
[KYUUBI #5464] JDBC Engine supports MySQL
### _Why are the changes needed?_ To close https://github.com/apache/kyuubi/issues/5464. To support JDBC engine use MySQL Dialect (kyuubi.engine.jdbc.type=mysql). ### _How was this patch tested?_ - [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [ ] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request ### _Was this patch authored or co-authored using generative AI tooling?_ No. Closes #5588 from Kwafoor/kyuubi_5464. Closes #5464 1019a6118 [wangjunbo] [KYUUBI #5464]rename function name `getProviderClass` to `getDriverClass` 9901bbad4 [wangjunbo] [KYUUBI #5464]handle properly to keep compatiblity b33d79ed2 [wangjunbo] [KYUUBI #5464]handle properly to keep compatiblity 86e6ee2b3 [wangjunbo] [KYUUBI #5464]handle properly to keep compatiblity d76cb3275 [wangjunbo] [KYUUBI #5464]update the docs 4a1acffd1 [wangjunbo] [KYUUBI #5464]update the docs 1aff55ecd [wangjunbo] [KYUUBI #5464]update the docs of kyuubi.engine.type 84202ea0c [wangjunbo] [KYUUBI #5464] update the docs of kyuubi.engine.type e3c1e94db [wangjunbo] [KYUUBI #5464] fix check cdf820da0 [wangjunbo] [KYUUBI #5464] fix check ff0f30ad8 [wangjunbo] [KYUUBI #5464] fix check 01321dc44 [wangjunbo] [KYUUBI #5464] JDBC Engine supports MySQL 756f5303c [wangjunbo] [KYUUBI #5464] JDBC Engine supports MySQL Authored-by: wangjunbo <wangjunbo@qiyi.com> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
Cheng Pan
|
c6accec623 |
Revert "[KYUUBI #5739][Bug] Fix spark extension pom import issue"
This reverts commit
|
||
|
Angerszhuuuu
|
9861bebca1 |
[KYUUBI #5739][Bug] Fix spark extension pom import issue
# 🔍 Description ## Issue References 🔗 To close #5739 This pull request fixes # ## Describe Your Solution 🔧 Fix a spark extension import issue ## Types of changes 🔖 - [x] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 #### Behavior Without This Pull Request ⚰️ #### Behavior With This Pull Request 🎉 #### Related Unit Tests --- # Checklists ## 📝 Author Self Checklist - [ ] My code follows the [style guidelines](https://kyuubi.readthedocs.io/en/master/contributing/code/style.html) of this project - [ ] I have performed a self-review - [ ] I have commented my code, particularly in hard-to-understand areas - [ ] I have made corresponding changes to the documentation - [ ] My changes generate no new warnings - [ ] I have added tests that prove my fix is effective or that my feature works - [ ] New and existing unit tests pass locally with my changes - [ ] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) ## 📝 Committer Pre-Merge Checklist - [x] Pull request title is okay. - [x] No license issues. - [x] Milestone correctly set? - [x] Test coverage is ok - [x] Assignees are selected. - [x] Minimum number of approvals - [x] No changes are requested **Be nice. Be informative.** Closes #5740 from AngersZhuuuu/KYUUBI-5739. Closes #5739 cdb824c70 [Angerszhuuuu] [KYUUBI #5739][Bug] Fix spark extension pom import issue Authored-by: Angerszhuuuu <angers.zhu@gmail.com> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
Bowen Liang
|
c2e90a9e9e |
[KYUUBI #5395] Bump netty from 4.1.93.Final to 4.1.100.Final
Bumps [io.netty:netty-codec-http2](https://github.com/netty/netty) from 4.1.93.Final to 4.1.100.Final. <details> <summary>Commits</summary> <ul> <li><a href=" |
||
|
Bowen Liang
|
b1953e877b |
[KYUUBI #5676] Bump Apache parent pom from 30 to 31
### _Why are the changes needed?_ - Apache parent pom version 31 release note: https://github.com/apache/maven-apache-parent/releases/tag/apache-31 ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [ ] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request ### _Was this patch authored or co-authored using generative AI tooling?_ Closes #5676 from bowenliang123/apache-parent-31. Closes #5676 064fc9da8 [Bowen Liang] bump apache parent pom version from 30 to 31 Authored-by: Bowen Liang <liangbowen@gf.com.cn> Signed-off-by: Bowen Liang <liangbowen@gf.com.cn> |
||
|
zhaoyangming
|
456b3c3f06 |
[KYUUBI #5375] JDBC Engine supports PostgreSQL
### _Why are the changes needed?_ Close #5375 ### _How was this patch tested?_ - [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [x] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request ### _Was this patch authored or co-authored using generative AI tooling?_ No Closes #5416 from ymZhao1001/jdbc-pg-dialect. Closes #5375 d81988d84 [zhaoyangming] postgreSQL 915f9fb0a [yangming] change to like d8da12af5 [yangming] reformat 29c63e38e [zhaoyangming] add postgresql dependency ec328ad93 [zhaoyangming] add postgresql dependency a8944fed5 [zhaoyangming] update postgresql to postgreSQL cf7b69107 [zhaoyangming] Merge remote-tracking branch 'origin/jdbc-pg-dialect' into jdbc-pg-dialect c127aa3d3 [zhaoyangming] update postgresql to postgreSQL a693d6c34 [yangming] reformat 0d12a6ceb [zhaoyangming] add postgresql dependency c7d3fa3da [yangming] fix conflict dde1564b6 [zhaoyangming] add test info 2a49b338a [zhaoyangming] style c8ce15f29 [zhaoyangming] StringBuilder is redundant. 5d70173cf [yangming] JDBC Engine supports PostgreSQL Lead-authored-by: zhaoyangming <zhaoyangming@deepexi.com> Co-authored-by: yangming <261635393@qq.com> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
Xianxun Ye
|
d4320e7a6b |
[KYUUBI #5505][FLINK] Support HELP command
### _Why are the changes needed?_ resolve: #5505 Show available commands when users type 'HELP;' in the beeline. #### Solution: - Using `ExtendedParser` parse statement and return Operation of Flink engine. - Check whether the operation is HelpOperation or not. - dependency on `flink-table-planner-loader.jar`. #### **Why not using Flink SQL Client Parser(SqlCommandParserImpl) to obtain the Command enum?** Flink 1.16's approach: ``` val opt:Optional[Operation] = org.apache.flink.table.client.cli.SqlCommandParserImpl.parseCommand() check opt.get() instance of HelpOperation or not if yes return CliStrings.MESSAGE_HELP ``` Flink 1.17 & 1.18 ``` val opt: Optional[Command] = org.apache.flink.table.client.cli.parser.SqlCommandParserImpl.parseStatement() check opt.get() is Command.HELP or not if yes return CliStrings.MESSAGE_HELP ``` The `Command` class is added from Flink1.17; The `SqlCommandParserImpl` package is changed, and the method name is changed from Flink1.17; This approach requires distinguishing between different Flink versions and maintaining both implementations. It's more complicated, so abandoned. ### _How was this patch tested?_ - [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [x] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request ### _Was this patch authored or co-authored using generative AI tooling?_ Closes #5585 from YesOrNo828/help. Closes #5505 e73b15e43 [Xianxun Ye] [KYUUBI #5505] [FLINK] Add job,update,delete,truncate and call statements 5943dd072 [Xianxun Ye] [KYUUBI #5505] [FLINK] Add help messages fdc2db6ab [Xianxun Ye] [KYUUBI #5505] [FLINK] Support HELP command, fixed Pan's comments a728048fc [Xianxun Ye] [KYUUBI #5505] [FLINK] Support HELP command, fixed Pan's comments 6323cfb85 [Xianxun Ye] [KYUUBI #5505] [FLINK] Support HELP command Authored-by: Xianxun Ye <yesorno828423@gmail.com> Signed-off-by: Paul Lin <paullin3280@gmail.com> |
||
|
Kent Yao
|
ceb8453783
|
[KYUUBI #5501] Update codecov token and fix codecov reporting on PRs
### _Why are the changes needed?_ Update codecov token to fix stale code coverage action ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [ ] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request ### _Was this patch authored or co-authored using generative AI tooling?_ no Closes #5501 from yaooqinn/token. Closes #5501 1f4053231 [Kent Yao] java-17 fcd8391e7 [Kent Yao] java-17 5ccead77d [Kent Yao] upgrade jacoco 5cb4a8374 [Kent Yao] Revert "rm" 45d7a2134 [Kent Yao] rm 0a3dd2f42 [Kent Yao] Update codecov token Authored-by: Kent Yao <yao@apache.org> Signed-off-by: Kent Yao <yao@apache.org> |
||
|
Rojin Raju
|
7517f8c011 |
[KYUUBI #5508] Upgrade download-maven-plugin from 1.6.8 to 1.7.1
### _Why are the changes needed?_ Updated the download maven plugin from 1.6.8 to 1.7.1 to solve #5508 - release note: https://github.com/maven-download-plugin/maven-download-plugin/releases/tag/1.7.1 ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [ ] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request ### _Was this patch authored or co-authored using generative AI tooling?_ NO Closes #5525 from rojin254/patch-1. Closes #5508 2a628b40e [Rojin Raju] Update download maven plugin version to 1.7.1 in pom.xml Lead-authored-by: Rojin Raju <rojinraju7@gmail.com> Co-authored-by: Rojin Raju <46747837+rojin254@users.noreply.github.com> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
liangbowen
|
ab4dfa3688 |
[KYUUBI #5486] Bump Kafka client version from 3.4.0 to 3.5.1
### _Why are the changes needed?_ - Bump Kafka client version from 3.4.0 to 3.5.1 - Bump Docker image for Kafka 3 to 3.5.0 (equivalent to Confluent Platform 7.5.x) - https://docs.confluent.io/platform/current/installation/versions-interoperability.html#cp-and-apache-ak-compatibility ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [x] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request ### _Was this patch authored or co-authored using generative AI tooling?_ No. Closes #5486 from bowenliang123/bump-kafka. Closes #5486 017ea860d [Bowen Liang] update dependencyList 20ad988ed [liangbowen] bump kafka client version 3.5.1 Lead-authored-by: liangbowen <liangbowen@gf.com.cn> Co-authored-by: Bowen Liang <liangbowen@gf.com.cn> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
Xianxun Ye
|
3646ae08bd
|
[KYUUBI #5405] [FLINK] Support Flink 1.18
### _Why are the changes needed?_ Resolve: #5405 Support the Flink 1.18 ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [x] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request ### _Was this patch authored or co-authored using generative AI tooling?_ No Closes #5465 from YesOrNo828/flink-1.18. Closes #5405 a0010ca14 [Xianxun Ye] [KYUUBI #5405] [FLINK] Remove flink1.18 rc repo 2a4ae365c [Xianxun Ye] Update .github/workflows/master.yml d4d458dc7 [Xianxun Ye] [KYUUBI #5405] [FLINK] Update the flink1.18-rc3 repo 99172e3da [Xianxun Ye] [KYUUBI #5405] [FLINK] Using the staging repo during the RC stage 4c0cf887b [Xianxun Ye] [KYUUBI #5405] [FLINK] Using the staging repo during the RC stage c74f5c31b [Xianxun Ye] [KYUUBI #5405] [FLINK] fixed Pan's comments. 1933ebadd [Xianxun Ye] [KYUUBI #5405] [FLINK] Support Flink 1.18 Authored-by: Xianxun Ye <yesorno828423@gmail.com> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
Cheng Pan
|
75428bb979
|
[KYUUBI #5484] Remove legacy Web UI
### _Why are the changes needed?_ Close https://github.com/apache/kyuubi/issues/5484 Kyuubi provides a basic new Web UI which is built on top of Vue3, we can remove the legacy dummy Web UI in 1.8. The new UI hosts at `http://<host>:<port>/ui/` and the legacy UI hosts at `http://<host>:<port>/`, we should 1. Remove the legacy UI routing from Jetty 2. Remove all files related to legacy UI 3. Redirect `http://<host>:<port>/` to `http://<host>:<port>/ui/` ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [x] Add screenshots for manual tests if appropriate building with the command `build/dist --web-ui`, then `cd dist` and perform `bin/kyuubi run` access http://0.0.0.0:10099 could correctly redirect to http://0.0.0.0:10099/ui/ <img width="1428" alt="image" src="https://github.com/apache/kyuubi/assets/26535726/1e8a67f6-e4db-415e-8a47-dd7c41b487cf"> swagger is render correctly too. <img width="1428" alt="image" src="https://github.com/apache/kyuubi/assets/26535726/1cb4ba31-9965-4468-b7c3-b0319ba959e6"> - [ ] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request ### _Was this patch authored or co-authored using generative AI tooling?_ No. Closes #5516 from pan3793/5484. Closes #5484 9d58ef758 [Cheng Pan] address comment and fix test 6d4c0981b [Cheng Pan] [KYUUBI #5484] Remove legacy Web UI Authored-by: Cheng Pan <chengpan@apache.org> Signed-off-by: Kent Yao <yao@apache.org> |
||
|
yikaifei
|
59c25b9851
|
[KYUUBI #5427] [AUTHZ] Shade spark authz plugin
### _Why are the changes needed?_ This PR aims to shade the kyuubi spark authz plugin to simplify the user's use. ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [x] Add screenshots for manual tests if appropriate - [ ] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request ### _Was this patch authored or co-authored using generative AI tooling?_ No Closes #5427 from Yikf/shade-authz. Closes #5427 d2f7ea8d1 [yikaifei] fix 695133de4 [Kent Yao] Update docs/security/authorization/spark/install.md f3a653133 [Kent Yao] Update docs/security/authorization/spark/build.md 963cab372 [yikaifei] bundle 2068c98fc [yikaifei] relocation 6c6e50ea7 [yikaifei] Shade spark authz plugin Lead-authored-by: yikaifei <yikaifei@apache.org> Co-authored-by: Kent Yao <yao@apache.org> Signed-off-by: yikaifei <yikaifei@apache.org> |
||
|
Bowen Liang
|
d68507d239 |
[KYUUBI #5462] [AUTHZ] Support create table command for Paimon
### _Why are the changes needed?_ Apache Paimon is an incubating Apache project of data lake platform for high-speed data ingestion, changelog tracking and efficient real-time analytics. - Initial support for Paimon tables in Authz plugin - Create Table Command: https://paimon.apache.org/docs/master/engines/spark3/#create-table - Paimon `0.5.0-incubating` supports Spark 3.1/3.2/3.3/3.4. ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [x] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request ### _Was this patch authored or co-authored using generative AI tooling?_ Closes #5462 from bowenliang123/authz-paimon-createtable. Closes #5462 8393f6ecc [liangbowen] remove spark-authz-paimon-test profile, use 3.4 as spark binary version for Paimon a4e01a2a8 [liangbowen] update workflow inclusions f372882aa [liangbowen] update workflow exclusions 7785dec52 [liangbowen] update workflow include 64ee20106 [liangbowen] update 73edea38f [liangbowen] add spark-authz-paimon-test profile and excluded for Spark 3.5 de58605bb [liangbowen] nit 81a4a4370 [liangbowen] nit eb2de8359 [Bowen Liang] exclude paimon tests for spark-3.5 4f58d7727 [Bowen Liang] fix typo cf360e6da [Bowen Liang] drop database af8ffda14 [Bowen Liang] drop database dc3ee9462 [Bowen Liang] support Paimon create table Lead-authored-by: Bowen Liang <liangbowen@gf.com.cn> Co-authored-by: liangbowen <liangbowen@gf.com.cn> Signed-off-by: Bowen Liang <liangbowen@gf.com.cn> |
||
|
zml1206
|
8d2c8d1009
|
[KYUUBI #5449] Bump Delta Lake 3.0.0
### _Why are the changes needed?_ close [#5449](https://github.com/apache/kyuubi/issues/5449). Unlike the initial preview release, Delta Spark 3.0.0 is now built on top of Apache Spark™ 3.5. Delta Spark maven artifact has been renamed from delta-core to delta-spark. https://github.com/delta-io/delta/releases/tag/v3.0.0 ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [ ] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request ### _Was this patch authored or co-authored using generative AI tooling?_ No Closes #5450 from zml1206/5449. Closes #5449 a7969ed6a [zml1206] bump Delta Lake 3.0.0 Authored-by: zml1206 <zhuml1206@gmail.com> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
Bowen Liang
|
dcaacc3ed5 |
[KYUUBI #4916] [AUTHZ] Support ReplaceData and compatible Spark 3.4 and 3.5
### _Why are the changes needed?_ - Iceberg 1.3.0 use Spark's `ReplaceData` since 3.4 as Logical plan for "DELETE FROM", instead of Iceberg's `DeleteFromTable` in Spark3.4 - Requiring select privilege for input table, even it's the same with output table - compatible Spark 3.4 and 3.5, subquies in the plan - enable iceberg test for authz plugin on Spark 3.4 and 3.5 ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [x] [Run test](https://kyuubi.readthedocs.io/en/master/develop_tools/testing.html#running-tests) locally before make a pull request Closes #4916 from bowenliang123/authz-replacedata. Closes #4916 658917752 [Bowen Liang] Merge branch 'master' into authz-replacedata 17f5d84dd [liangbowen] update 25009908a [Bowen Liang] ut of user with select only for DELETE FROM fa77cea15 [Bowen Liang] ut fd9bb8f3a [Bowen Liang] update f9cfb98a9 [Bowen Liang] assertion for Spark 3.5 f574e0da3 [Bowen Liang] assertion for Spark 3.5 2449c27de [Bowen Liang] bring back single call ut for someone 78786988d [Bowen Liang] bring back single call ut for someone b8e4a6319 [wforget] fix style 0e26c08b4 [wforget] fix IcebergCatalogRangerSparkExtensionSuite with spark-3.5 02781781f [wforget] enable iceberg tests in spark-3.5 215e1b861 [wforget] fix TableCommands d019b1632 [wforget] followup ae17e076b [wforget] Merge remote-tracking branch 'origin/master' into authz-replacedata b88f77355 [Bowen Liang] update febcb3ee5 [Bowen Liang] isSparkV34OrGreater 91d41b438 [Bowen Liang] replace data Lead-authored-by: Bowen Liang <liangbowen@gf.com.cn> Co-authored-by: wforget <643348094@qq.com> Co-authored-by: Bowen Liang <bowenliang@apache.org> Co-authored-by: liangbowen <liangbowen@gf.com.cn> Signed-off-by: Bowen Liang <liangbowen@gf.com.cn> |
||
|
Angerszhuuuu
|
143b26b6e8
|
[KYUUBI #5284] Support Hudi Alter Table Command in Authz
### _Why are the changes needed?_ To close #5284. Hudi also is a common used data format, since kyuubi already support iceberg and delta, we should also support hudi. In this pr we support hoodie sql about ALTER COMMAND in authz In this PR we use default Hudi version 0.14.0. We support from spark 3.1 to spark 3.4, since Hudi don't support spark 3.5 yet - [x] spark 3.1 - [x] spark 3.2 - [x] spark 3.3 - [x] spark 3.4 - [ ] spark 3.5 Also since Hudi only supports Scala 2.12, I also made Hudi as a separate profile to avoid importing Hudi when enable Scala 2.13 ### _How was this patch tested?_ - [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [ ] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request ### _Was this patch authored or co-authored using generative AI tooling?_ No Closes #5287 from AngersZhuuuu/KYUUBI-5284. Closes #5284 f171e11af [Angerszhuuuu] Update pom.xml 3f57a3dc5 [Angerszhuuuu] follow comment f6c764028 [Angerszhuuuu] follow comment 51797e25c [Angerszhuuuu] trigger b3c059af9 [Angerszhuuuu] Update HudiCatalogRangerSparkExtensionSuite.scala 3510e7601 [liangbowen] remove scope in dependencyManagement 14ea0d498 [liangbowen] change to use `spark.binary.version` for hudi dependency by default 354260eb0 [liangbowen] remove the abbreviation tite 658bddbab [liangbowen] remove clarification and use ALTERTABLE_PROPERTIES for opType 150edcd40 [Angerszhuuuu] update 30c417b19 [Angerszhuuuu] trigger 56e5cb17b [Angerszhuuuu] Update HudiCatalogRangerSparkExtensionSuite.scala fe9b75270 [Angerszhuuuu] update 888943831 [Angerszhuuuu] Update HudiCatalogRangerSparkExtensionSuite.scala db749a277 [Angerszhuuuu] update 9b09e78c2 [Angerszhuuuu] Update HudiCommands.scala 87de62e52 [Angerszhuuuu] follow comment 2d551d112 [Angerszhuuuu] Update master.yml 89082e06b [Angerszhuuuu] Update master.yml 7c7846378 [Angerszhuuuu] Merge branch 'KYUUBI-5284' of https://github.com/AngersZhuuuu/incubator-kyuubi into KYUUBI-5284 d32ca9839 [Angerszhuuuu] Update master.yml ec43e2a7b [Angerszhuuuu] Merge branch 'master' into KYUUBI-5284 b3611fd3e [Angerszhuuuu] update 2a0dfa74f [Angerszhuuuu] Update AuthZUtils.scala 45ee9e251 [Angerszhuuuu] update 0560a5e14 [Angerszhuuuu] Update pom.xml 97c50f622 [Angerszhuuuu] update f57ee0093 [Angerszhuuuu] Update table_command_spec.json fb72197e6 [Angerszhuuuu] update 2154cf928 [Angerszhuuuu] trigger 44469359f [Angerszhuuuu] trigger b0e768cb8 [Angerszhuuuu] Update HoodieCatalogRangerSparkExtensionSuite.scala 83795ed63 [Angerszhuuuu] Update pom.xml eed190f92 [Angerszhuuuu] update 361660145 [Angerszhuuuu] update 1ed1f3ab6 [Angerszhuuuu] Update 7ee3c7dd5 [Angerszhuuuu] Merge branch 'KYUUBI-5284' of https://github.com/AngersZhuuuu/incubator-kyuubi into KYUUBI-5284 ee0916f63 [Angerszhuuuu] Update HoodieCatalogRangerSparkExtensionSuite.scala 010260fa4 [Angerszhuuuu] Merge branch 'master' into KYUUBI-5284 c11d02def [Angerszhuuuu] update b84f91f65 [Angerszhuuuu] update 42fbb0ffa [Angerszhuuuu] Update HoodieCatalogRangerSparkExtensionSuite.scala c1346adb1 [Angerszhuuuu] update 2ec63ae94 [Angerszhuuuu] Update pom.xml 39bce7468 [Angerszhuuuu] update c70b0ea2f [Angerszhuuuu] Update pom.xml e1d85ff77 [Angerszhuuuu] Update pom.xml 59012ac25 [Angerszhuuuu] Update pom.xml a46de65b5 [Angerszhuuuu] Update HoodieTest.java b8173b893 [Angerszhuuuu] update 055713329 [Angerszhuuuu] Update table_command_spec.json d7b21e820 [Angerszhuuuu] Update HoodieCatalogRangerSparkExtensionSuite.scala 0a93ff794 [Angerszhuuuu] [KYUUBI #5284] Kyuubi authz support Hoodie Alter Table Command Lead-authored-by: Angerszhuuuu <angers.zhu@gmail.com> Co-authored-by: liangbowen <liangbowen@gf.com.cn> Signed-off-by: Kent Yao <yao@apache.org> |
||
|
Bowen Liang
|
e33df9ce66 |
[KYUUBI #5196] Enable CI Test on Scala 2.13 and support custom or spark-core extracted Scala version for Spark's engine
### _Why are the changes needed?_ - enable CI test on Scala-2.13 for all modules except Flink SQL engine - For testing, choose available Spark engine home in `download` module by `SCALA_COMPILE_VERSION` of Kyuubi server - Choose the Scala version of Spark engine main resource Jar in the following order: 1. `SPARK_SCALA_VERSION` system env 2. Extract Scala version from Spark home's `spark-core` jar filename - Fixed 1 assertion error of kyuubi-spark-lineage module, as Spark on Scala 2.12 and 2.13 show different order of column linage output in `MergeIntoTable` ut ``` SparkSQLLineageParserHelperSuite: - columns lineage extract - MergeIntoTable *** FAILED *** inputTables(List(v2_catalog.db.source_t)) outputTables(List(v2_catalog.db.target_t)) columnLineage(List(ColumnLineage(v2_catalog.db.target_t.name,Set(v2_catalog.db.source_t.name)), ColumnLineage(v2_catalog.db.target_t.price,Set(v2_catalog.db.source_t.price)), ColumnLineage(v2_catalog.db.target_t.id,Set(v2_catalog.db.source_t.id)))) did not equal inputTables(List(v2_catalog.db.source_t)) outputTables(List(v2_catalog.db.target_t)) columnLineage(List(ColumnLineage(v2_catalog.db.target_t.id,Set(v2_catalog.db.source_t.id)), ColumnLineage(v2_catalog.db.target_t.name,Set(v2_catalog.db.source_t.name)), ColumnLineage(v2_catalog.db.target_t.price,Set(v2_catalog.db.source_t.price)))) (SparkSQLLineageParserHelperSuite.scala:182) ``` - Fixed other tests relying on Scala scripting results ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [x] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request ### _Was this patch authored or co-authored using generative AI tooling?_ Closes #5196 from bowenliang123/scala213-test. Closes #5196 97fafacd3 [liangbowen] prevent repeated compilation for regrex pattern 76b99d423 [Bowen Liang] test on scala-2.13 Lead-authored-by: Bowen Liang <liangbowen@gf.com.cn> Co-authored-by: liangbowen <liangbowen@gf.com.cn> Signed-off-by: Bowen Liang <liangbowen@gf.com.cn> |
||
|
wforget
|
d2c072b7c2
|
[KYUUBI #5336] Spark extension supports Spark 3.5
### _Why are the changes needed?_ It is basically copied from `kyuubi-extension-spark-3-4`. ### _How was this patch tested?_ Compiled successfully: ``` build/mvn clean install -DskipTests -Pflink-provided,spark-provided,hive-provided,spark-3.5 ``` - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [ ] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request ### _Was this patch authored or co-authored using generative AI tooling?_ No Closes #5336 from wForget/dev_spark_3_5. Closes #5336 7ba99804a [wforget] remove iceberg.version in spark-3.5 profile a18ce166a [wforget] Regenerate KyuubiEnsureRequirements based on EnsureRequirements in spark 3.5 4725c4701 [wforget] fix iceberg version f5a8ea934 [wforget] Bump iceberg 1.4.0 06558dcfa [wforget] make kyuubi-spark-authz plugin compatible with Spark3.5 90d0e4c70 [wforget] make kyuubi-spark-authz plugin compatible with Spark3.5 4bc8d24d6 [wforget] add ci 1b3f2d916 [wforget] Make kyuubi spark extension compatible with Spark3.5 Authored-by: wforget <643348094@qq.com> Signed-off-by: Cheng Pan <chengpan@apache.org> |