c93e0a2779
558 Commits
| Author | SHA1 | Message | Date | |
|---|---|---|---|---|
dependabot[bot]
|
c93e0a2779 |
[KYUUBI #6067] Bump org.postgresql:postgresql from 42.6.0 to 42.7.2
Bumps [org.postgresql:postgresql](https://github.com/pgjdbc/pgjdbc) from 42.6.0 to 42.7.2. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/pgjdbc/pgjdbc/releases">org.postgresql:postgresql's releases</a>.</em></p> <blockquote> <h2>v42.7.1</h2> <h2>Fixed regressions since 42.7.0</h2> <ul> <li>Revert "Use canonical DateStyle name (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2925">#2925</a>)" <a href="https://github.com/vlsi"><code>vlsi</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3035">#3035</a>)</li> <li>Revert "feat: support SET statements combining with other queries with semicolon in PreparedStatement" <a href="https://github.com/vlsi"><code>vlsi</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3010">#3010</a>)</li> <li>chore: use java.release=8 when building pgjdbc from the generated source distribution <a href="https://github.com/vlsi"><code>vlsi</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3038">#3038</a>), the driver uses Java 8 methods only</li> </ul> <h2>Changes</h2> <ul> <li>Apply connectTimeout before SSLSocket.startHandshake to avoid infinite wait in case the connection is broken <a href="https://github.com/davecramer"><code>davecramer</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3040">#3040</a>)</li> <li>perf: improve performance of PreparedStatement.setBlob, BlobInputStream, and BlobOutputStream with dynamic buffer sizing <a href="https://github.com/vlsi"><code>vlsi</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3044">#3044</a>)</li> <li>fix: avoid timezone conversions when sending LocalDateTime to the database <a href="https://github.com/vlsi"><code>vlsi</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2852">#2852</a>)</li> <li>fix: support waffle-jna 2.x and 3.x by using reflective approach for ManagedSecBufferDesc <a href="https://github.com/chrullrich"><code>chrullrich</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2720">#2720</a>)</li> </ul> <h2>🧰 Maintenance</h2> <ul> <li>chore: bump Gradle to 8.5 <a href="https://github.com/vlsi"><code>vlsi</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3045">#3045</a>)</li> <li>chore: use Java 17 for building pgjdbc, and use --release 8 to target Java 8, add tests with Java 21 and 22 <a href="https://github.com/vlsi"><code>vlsi</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3026">#3026</a>)</li> <li>fedora/rpm: move source build to java-17-openjdk-devel <a href="https://github.com/praiskup"><code>praiskup</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3036">#3036</a>)</li> <li>Update site 42 7 0 <a href="https://github.com/davecramer"><code>davecramer</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3004">#3004</a>)</li> <li>prepared for release 42.7.1 update changelogs <a href="https://github.com/davecramer"><code>davecramer</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3037">#3037</a>)</li> </ul> <h2>⬆️ Dependencies</h2> <ul> <li>fix(deps): update dependency org.checkerframework:org.checkerframework.gradle.plugin to v0.6.36 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3060">#3060</a>)</li> <li>chore(deps): update plugin biz.aqute.bnd.builder to v7 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3034">#3034</a>)</li> <li>fix(deps): update dependency com.github.spotbugs:com.github.spotbugs.gradle.plugin to v6 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3056">#3056</a>)</li> <li>fix(deps): update dependency com.github.spotbugs:com.github.spotbugs.gradle.plugin to v5.2.5 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3032">#3032</a>)</li> <li>chore(deps): update codecov/codecov-action digest to b0466b4 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3059">#3059</a>)</li> <li>fix(deps): update checkerframework to v3.41.0 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3058">#3058</a>)</li> <li>fix(deps): update logback to v1.2.13 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3053">#3053</a>)</li> <li>chore(deps): update codecov/codecov-action digest to 438fa9e <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3051">#3051</a>)</li> <li>fix(deps): update dependency spotbugs to v4.8.2 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3052">#3052</a>)</li> <li>chore: bump Gradle to 8.5 <a href="https://github.com/vlsi"><code>vlsi</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3045">#3045</a>)</li> <li>fix(deps): update dependency org.ops4j.pax.url:pax-url-aether to v2.6.14 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3030">#3030</a>)</li> <li>chore(deps): update plugin org.nosphere.gradle.github.actions to v1.4.0 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3031">#3031</a>)</li> <li>chore(deps): update dependency ubuntu to v22 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3033">#3033</a>)</li> <li>fix(deps): update checkerframework <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3027">#3027</a>)</li> <li>fix(deps): update dependency spotbugs to v4.8.1 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3023">#3023</a>)</li> <li>fix(deps): update dependency uk.org.webcompere:system-stubs-jupiter to v2.1.5 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3024">#3024</a>)</li> <li>fix(deps): update jmh to v1.37 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3025">#3025</a>)</li> <li>fix(deps): update dependency com.google.errorprone:error_prone_core to v2.23.0 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3022">#3022</a>)</li> <li>fix(deps): update junit5 monorepo to v5.10.1 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3015">#3015</a>)</li> <li>chore(deps): update plugin com.github.burrunan.s3-build-cache to v1.7 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3016">#3016</a>)</li> <li>chore(deps): update dependency com.typesafe.play:sbt-plugin to v2.9.0 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3021">#3021</a>)</li> <li>fix(deps): update dependency checkstyle to v10.12.5 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3020">#3020</a>)</li> <li>chore(deps): update codecov/codecov-action digest to 920a494 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3019">#3019</a>)</li> <li>chore(deps): update actions/github-script action to v7 <a href="https://github.com/renovate-bot"><code>renovate-bot</code></a> (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3018">#3018</a>)</li> </ul> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Changelog</summary> <p><em>Sourced from <a href="https://github.com/pgjdbc/pgjdbc/blob/master/CHANGELOG.md">org.postgresql:postgresql's changelog</a>.</em></p> <blockquote> <h1>Changelog</h1> <p>Notable changes since version 42.0.0, read the complete <a href="https://jdbc.postgresql.org/documentation/changelog.html">History of Changes</a>.</p> <p>The format is based on <a href="http://keepachangelog.com/en/1.0.0/">Keep a Changelog</a>.</p> <h2>[Unreleased]</h2> <h3>Changed</h3> <h3>Added</h3> <ul> <li>feat: Add PasswordUtil for encrypting passwords client side [PR <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3082">#3082</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/3082">pgjdbc/pgjdbc#3082</a>)</li> </ul> <h3>Fixed</h3> <h2>[42.7.1] (2023-12-06 08:34:00 -0500)</h2> <h3>Changed</h3> <ul> <li>perf: improve performance of PreparedStatement.setBlob, BlobInputStream, and BlobOutputStream with dynamic buffer sizing [PR <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3044">#3044</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/3044">pgjdbc/pgjdbc#3044</a>)</li> </ul> <h3>Fixed</h3> <ul> <li>fix: Apply connectTimeout before SSLSocket.startHandshake to avoid infinite wait in case the connection is broken [PR <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3040">#3040</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/3040">pgjdbc/pgjdbc#3040</a>)</li> <li>fix: support waffle-jna 2.x and 3.x by using reflective approach for ManagedSecBufferDesc [PR <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2720">#2720</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/2720">pgjdbc/pgjdbc#2720</a>) Fixes [Issue <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2690">#2690</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2720">pgjdbc/pgjdbc#2720</a>).</li> <li>fix: NoSuchMethodError on ByteBuffer#position When Running on Java 8 when accessing arrays, fixes [Issue <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3014">#3014</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3014">pgjdbc/pgjdbc#3014</a>)</li> <li>Revert "[PR <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2925">#2925</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/2925">pgjdbc/pgjdbc#2925</a>) Use canonical DateStyle name" [PR <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3035">#3035</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/3035">pgjdbc/pgjdbc#3035</a>) Fixes [Issue <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3008">#3008</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3008">pgjdbc/pgjdbc#3008</a>)</li> <li>Revert "[PR #<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2973">#2973</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/2973">pgjdbc/pgjdbc#2973</a>) feat: support SET statements combining with other queries with semicolon in PreparedStatement" [PR <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3010">#3010</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/3010">pgjdbc/pgjdbc#3010</a>) Fixes [Issue <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3007">#3007</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/3007">pgjdbc/pgjdbc#3007</a>)</li> <li>fix: avoid timezone conversions when sending LocalDateTime to the database <a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/3010">#2852</a> Fixes [Issue <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/1390">#1390</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/1390">pgjdbc/pgjdbc#1390</a>) ,[Issue <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2850">#2850</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2850">pgjdbc/pgjdbc#2850</a>) Closes [Issue <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/1391">#1391</a>(https://redirect.github.com/pgjdbc/pgjdbc/issues/1391)</li> </ul> <h2>[42.7.0] (2023-11-20 09:33:00 -0500)</h2> <h3>Changed</h3> <ul> <li>fix: Deprecate for removal PGPoint.setLocation(java.awt.Point) to cut dependency to <code>java.desktop</code> module. [PR <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2967">#2967</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/2967">pgjdbc/pgjdbc#2967</a>)</li> <li>feat: return all catalogs for getCatalogs metadata query closes [ISSUE <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2949">#2949</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2949">pgjdbc/pgjdbc#2949</a>) [PR <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2953">#2953</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/2953">pgjdbc/pgjdbc#2953</a>)</li> <li>feat: support SET statements combining with other queries with semicolon in PreparedStatement [PR #<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2973">#2973</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/2973">pgjdbc/pgjdbc#2973</a>)</li> </ul> <h3>Fixed</h3> <ul> <li>chore: add styleCheck Gradle task to report style violations [PR <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2980">#2980</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/2980">pgjdbc/pgjdbc#2980</a>)</li> <li>fix: Include currentXid in "Error rolling back prepared transaction" exception message [PR <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2978">#2978</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/2978">pgjdbc/pgjdbc#2978</a>)</li> <li>fix: add varbit as a basic type inside the TypeInfoCache [PR <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2960">#2960</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/2960">pgjdbc/pgjdbc#2960</a>)</li> <li>fix: Fix failing tests for version 16. [PR <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2962">#2962</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/2962">pgjdbc/pgjdbc#2962</a>)</li> <li>fix: allow setting arrays with ANSI type name [PR <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2952">#2952</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/2952">pgjdbc/pgjdbc#2952</a>)</li> <li>feat: Use KeepAlive to confirm LSNs [PR <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2941">#2941</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/2941">pgjdbc/pgjdbc#2941</a>)</li> <li>fix: put double ' around log parameter [PR <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2936">#2936</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/2936">pgjdbc/pgjdbc#2936</a>) fixes [ISSUE <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2935">#2935</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2935">pgjdbc/pgjdbc#2935</a>)</li> <li>fix: Fix Issue <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2928">#2928</a> number of ports not equal to number of servers in datasource [PR <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2929">#2929</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/2929">pgjdbc/pgjdbc#2929</a>)</li> <li>fix: Use canonical DateStyle name (<a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2925">#2925</a>) fixes <a href="https://redirect.github.com/pgbouncer/pgbouncer/issues/776">pgbouncer issue</a></li> <li>fix: Method getFastLong should be able to parse all longs [PR <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2881">#2881</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/2881">pgjdbc/pgjdbc#2881</a>)</li> <li>docs: Fix typos in info.html [PR <a href="https://redirect.github.com/pgjdbc/pgjdbc/issues/2860">#2860</a>](<a href="https://redirect.github.com/pgjdbc/pgjdbc/pull/2860">pgjdbc/pgjdbc#2860</a>)</li> </ul> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Commits</summary> <ul> <li>See full diff in <a href="https://github.com/pgjdbc/pgjdbc/commits">compare view</a></li> </ul> </details> <br /> [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `dependabot rebase` will rebase this PR - `dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `dependabot merge` will merge this PR after your CI passes on it - `dependabot squash and merge` will squash and merge this PR after your CI passes on it - `dependabot cancel merge` will cancel a previously requested merge and block automerging - `dependabot reopen` will reopen this PR if it is closed - `dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) You can disable automated security fix PRs for this repo from the [Security Alerts page](https://github.com/apache/kyuubi/network/alerts). </details> Closes #6067 from dependabot[bot]/dependabot/maven/org.postgresql-postgresql-42.7.2. Closes #6067 55ea68732 [dependabot[bot]] ⬆️ Bump org.postgresql:postgresql from 42.6.0 to 42.7.2 Authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
GGHWS
|
f61338db49
|
[KYUUBI #6063] Bump iceberg 1.4.3
# 🔍 Description ## Issue References 🔗 This pull request closes #6063 ## Describe Your Solution 🔧 ## Types of changes 🔖 - [ ] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 #### Behavior Without This Pull Request ⚰️ #### Behavior With This Pull Request 🎉 #### Related Unit Tests # Checklist 📝 - [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) **Be nice. Be informative.** Closes #6065 from GGHWS/features/kyuubi-6063. Closes #6063 f25f82b93 [GGHWS] Bump iceberg 1.4.3 Authored-by: GGHWS <16678125728@163.com> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
yuqingyang
|
47a1091fa8
|
[KYUUBI #4279] Use new Apache 'closer.lua' syntax for kyuubi-download to obtain engine
…ne archives # 🔍 Description ## Issue References [4279](https://github.com/apache/kyuubi/issues/4279)🔗 This pull request fixes # ## Describe Your Solution 🔧 Use new Apache 'closer.lua' syntax for kyuubi-download to obtain engine ## Types of changes 🔖 - [x] New feature (non-breaking change which adds functionality) ## Test Plan 🧪 #### Behavior Without This Pull Request ⚰️ #### Behavior With This Pull Request 🎉 #### Related Unit Tests --- # Checklist 📝 - [ ] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) **Be nice. Be informative.** Closes #6009 from sincewhen/master. Closes #4279 2152a9b92 [yuqingyang] Use new Apache 'closer.lua' syntax for kyuubi-download to obtain engine archives Authored-by: yuqingyang <yuqingyang@kingsoft.com> Signed-off-by: Kent Yao <yao@apache.org> |
||
|
Cheng Pan
|
87ed400562
|
[KYUUBI #5975] Bump trino-client 411
# 🔍 Description ## Issue References 🔗 This is a regular dependency upgrading, ## Describe Your Solution 🔧 Upgrade `trino-client` from 363 to 411. 411 is the latest version which uses okhttp 3.x, hence it does not have kotlin runtime dependencies. This PR also updates the docs, especially the Trino cluster version requirement. ## Types of changes 🔖 - [ ] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 Pass GA. --- # Checklist 📝 - [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) **Be nice. Be informative.** Closes #5975 from pan3793/trino-411. Closes #5975 2b57df34d [Cheng Pan] fix c498a5bb3 [Cheng Pan] fix 21948ca4f [Cheng Pan] Fix compile e4f1397cc [Cheng Pan] license 66583ca16 [Cheng Pan] Bump trino-client 411 Authored-by: Cheng Pan <chengpan@apache.org> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
Cheng Pan
|
35e988d182
|
[KYUUBI #5974] Bump jetcd 0.7.7
# 🔍 Description ## Issue References 🔗 It's regular dependency upgrading, and jetcd 0.7.7 may be the latest version that supports Java 8. ## Describe Your Solution 🔧 Upgrading jetcd to 0.7.7, and this upgrading involves the transitive dep `failsafe` major upgrades, the group is changed from `net.jodah` to `dev.failsafe` ## Types of changes 🔖 - [ ] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 Pass GA. --- # Checklist 📝 - [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) **Be nice. Be informative.** Closes #5974 from pan3793/jetcd-version. Closes #5974 7c1d815a4 [Cheng Pan] relocation 5eca6cdb4 [Cheng Pan] Bump jetcd 0.7.7 Authored-by: Cheng Pan <chengpan@apache.org> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
Cheng Pan
|
f35761b50f
|
[KYUUBI #5973] Bump gRPC from 1.53.0 to 1.60.1
# 🔍 Description ## Issue References 🔗 It's a regular dependency upgrading task. ## Describe Your Solution 🔧 Bump gRPC from 1.53.0 to 1.60.1, a new module [grpc-util](https://mvnrepository.com/artifact/io.grpc/grpc-util) was added in 1.58.0, LICENSE files updated accordingly. https://github.com/grpc/grpc-java/releases ## Types of changes 🔖 - [ ] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 Pass GA. --- # Checklist 📝 - [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) **Be nice. Be informative.** Closes #5973 from pan3793/grpc. Closes #5973 b47c7f295 [Cheng Pan] nit dd0e966f0 [Cheng Pan] Bump gRPC from 1.53.0 to 1.60.1 Authored-by: Cheng Pan <chengpan@apache.org> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
liuxiao
|
bffbdbdaa5
|
[KYUUBI #5962] Bump Flink 1.17.1 to 1.17.2
# 🔍 Description ## Issue References 🔗 This pull request fixes when exec `./build/mvn clean package -Pmirror-cdn -DskipTests -Dapache.archive.dist=https://mirrors.aliyun.com/apache/`, it shows flink 1.17.1 is missing. ## Describe Your Solution 🔧 Please include a summary of the change and which issue is fixed. Please also include relevant motivation and context. List any dependencies that are required for this change. ## Types of changes 🔖 - [ ] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 #### Behavior Without This Pull Request ⚰️ #### Behavior With This Pull Request 🎉 #### Related Unit Tests --- # Checklist 📝 - [ ] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) **Be nice. Be informative.** Closes #5962 from liuxiaocs7/bump_flink. Closes #5962 5a9496d12 [liuxiao] Bump Flink 1.17.1 to 1.17.2 Authored-by: liuxiao <liuxiao2103@qq.com> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
zwangsheng
|
c6bba915b2
|
[KYUUBI #5941] Drop Kubernetes Block Cleaner Tool from Kyuubi
# 🔍 Description ## Issue References 🔗 This pull request fixes #5941 ## Describe Your Solution 🔧 Originally aims to support Spark On Kubernetes Shuffle Data Clean, limitations became more and more apparent over time, so let's drop this. ## Types of changes 🔖 - [ ] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [x] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 #### Behavior Without This Pull Request ⚰️ #### Behavior With This Pull Request 🎉 #### Related Unit Tests --- # Checklist 📝 - [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) **Be nice. Be informative.** Closes #5942 from zwangsheng/KYUUBI#5941. Closes #5941 23bf14f37 [Cheng Pan] Update docs/tools/spark_block_cleaner.md 1c3350186 [zwangsheng] fix comment 0bdbb1104 [zwangsheng] nit 0a5aa2bfa [zwangsheng] fix comments Lead-authored-by: zwangsheng <binjieyang@apache.org> Co-authored-by: Cheng Pan <pan3793@gmail.com> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
Bowen Liang
|
e2d9a8efb6
|
[KYUUBI #5879] Bump dropwizard metrics from 4.2.8 to 4.2.23
# 🔍 Description ## Issue References 🔗 As described. ## Describe Your Solution 🔧 - Currently used Dropwiard Metrics v4.2.8 was released on Feb 3, 2022 - Dropwiard Metrics v4.2.23 released on Dec 6, 2023, release notes: https://github.com/dropwizard/metrics/releases/tag/v4.2.23 ## Types of changes 🔖 - [ ] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 #### Behavior Without This Pull Request ⚰️ No behaviour changes. #### Behavior With This Pull Request 🎉 No behaviour changes. #### Related Unit Tests No behaviour changes. --- # Checklists ## 📝 Author Self Checklist - [ ] My code follows the [style guidelines](https://kyuubi.readthedocs.io/en/master/contributing/code/style.html) of this project - [ ] I have performed a self-review - [ ] I have commented my code, particularly in hard-to-understand areas - [ ] I have made corresponding changes to the documentation - [ ] My changes generate no new warnings - [ ] I have added tests that prove my fix is effective or that my feature works - [ ] New and existing unit tests pass locally with my changes - [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) ## 📝 Committer Pre-Merge Checklist - [x] Pull request title is okay. - [x] No license issues. - [x] Milestone correctly set? - [x] Test coverage is ok - [x] Assignees are selected. - [x] Minimum number of approvals - [x] No changes are requested **Be nice. Be informative.** Closes #5879 from bowenliang123/metrics-4.2.23. Closes #5879 08c3469f4 [Bowen Liang] bump dropwizard to 4.2.23 Authored-by: Bowen Liang <liangbowen@gf.com.cn> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
zml1206
|
b3d33cabfa |
[KYUUBI #5856] Bump Spark 3.4.2
# 🔍 Description ## Issue References 🔗 This pull request fixes #5856 ## Describe Your Solution 🔧 ## Types of changes 🔖 - [ ] Bugfix (non-breaking change which fixes an issue) - [x] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 #### Behavior Without This Pull Request ⚰️ #### Behavior With This Pull Request 🎉 #### Related Unit Tests --- # Checklists ## 📝 Author Self Checklist - [x] My code follows the [style guidelines](https://kyuubi.readthedocs.io/en/master/contributing/code/style.html) of this project - [x] I have performed a self-review - [ ] I have commented my code, particularly in hard-to-understand areas - [ ] I have made corresponding changes to the documentation - [x] My changes generate no new warnings - [ ] I have added tests that prove my fix is effective or that my feature works - [ ] New and existing unit tests pass locally with my changes - [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) ## 📝 Committer Pre-Merge Checklist - [x] Pull request title is okay. - [x] No license issues. - [x] Milestone correctly set? - [x] Test coverage is ok - [x] Assignees are selected. - [x] Minimum number of approvals - [x] No changes are requested **Be nice. Be informative.** Closes #5859 from zml1206/KYUUBI-5856. Closes #5856 872fd06d2 [zml1206] Revert changes in SparkProcessBuilderSuite bc4996f90 [zml1206] Bump spark 3.4.2 Authored-by: zml1206 <zhuml1206@gmail.com> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
Bowen Liang
|
acdd74d5ca |
[KYUUBI #5862] Use TestContainerForAll for testing JDBC engine with testcontainers
# 🔍 Description ## Issue References 🔗 As described. ## Describe Your Solution 🔧 - replacing the usage of `ForAllTestContainer` with `TestContainerForAll`, simplifying the lifecycle for starting / stopping the containers and fetching the configs from the containers - use `testcontainers-scala-postgresql` for testing with PostgreSQL containers - add version 16 for PostgreSQL image tag ## Types of changes 🔖 - [ ] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 #### Behavior Without This Pull Request ⚰️ No behaviour changes. #### Behavior With This Pull Request 🎉 No behaviour changes. #### Related Unit Tests JDBC Engine IT. --- # Checklists ## 📝 Author Self Checklist - [x] My code follows the [style guidelines](https://kyuubi.readthedocs.io/en/master/contributing/code/style.html) of this project - [x] I have performed a self-review - [ ] I have commented my code, particularly in hard-to-understand areas - [ ] I have made corresponding changes to the documentation - [x] My changes generate no new warnings - [ ] I have added tests that prove my fix is effective or that my feature works - [x] New and existing unit tests pass locally with my changes - [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) ## 📝 Committer Pre-Merge Checklist - [ ] Pull request title is okay. - [ ] No license issues. - [ ] Milestone correctly set? - [ ] Test coverage is ok - [ ] Assignees are selected. - [ ] Minimum number of approvals - [ ] No changes are requested **Be nice. Be informative.** Closes #5862 from bowenliang123/jdbc-container. Closes #5862 29e85121c [Bowen Liang] TestContainerForAll Authored-by: Bowen Liang <liangbowen@gf.com.cn> Signed-off-by: liangbowen <liangbowen@gf.com.cn> |
||
|
hezhao2
|
8ab4763ce4 |
[KYUUBI #5828] [CHAT] Kyuubi chat engine supports ernie bot(文心一言)
# 🔍 Description ## Issue References 🔗 This pull request fixes #5386 ## Describe Your Solution 🔧 add a new backend(ernie bot) for the Chat engine. <img width="1672" alt="Screenshot 2023-12-07 at 16 20 56" src="https://github.com/apache/kyuubi/assets/32693629/9850916c-3c4a-433c-8278-3068e7b37314"> ## Types of changes 🔖 - [ ] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 #### Behavior Without This Pull Request ⚰️ #### Behavior With This Pull Request 🎉 #### Related Unit Tests --- # Checklists ## 📝 Author Self Checklist - [ ] My code follows the [style guidelines](https://kyuubi.readthedocs.io/en/master/contributing/code/style.html) of this project - [ ] I have performed a self-review - [ ] I have commented my code, particularly in hard-to-understand areas - [ ] I have made corresponding changes to the documentation - [ ] My changes generate no new warnings - [ ] I have added tests that prove my fix is effective or that my feature works - [ ] New and existing unit tests pass locally with my changes - [ ] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) ## 📝 Committer Pre-Merge Checklist - [x] Pull request title is okay. - [x] No license issues. - [x] Milestone correctly set? - [ ] Test coverage is ok - [x] Assignees are selected. - [x] Minimum number of approvals - [x] No changes are requested **Be nice. Be informative.** Closes #5828 from zhaohehuhu/dev-1207. Closes #5828 c7314d4a8 [Cheng Pan] Update externals/kyuubi-chat-engine/src/main/scala/org/apache/kyuubi/engine/chat/ernie/service/ErnieBotService.scala 0c4e01007 [hezhao2] update doc 78e51b3d1 [hezhao2] add ernie into doc 2f4a63845 [hezhao2] refactor 832bc0453 [hezhao2] delete enum model 67214c575 [hezhao2] get rid of some java code 567772679 [hezhao2] java bean to scale case class 4d5c5940d [hezhao2] refactor some params 7c44eb83f [hezhao2] refactor some params 56b9ad13a [hezhao2] refactor a8e3d6cf6 [hezhao2] refactor 7376d800d [hezhao2] Kyuubi chat engine supports ernie bot 4b72a09c0 [hezhao2] Kyuubi chat engine supports ernie bot Lead-authored-by: hezhao2 <hezhao2@cisco.com> Co-authored-by: Cheng Pan <pan3793@gmail.com> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
Cheng Pan
|
ffcee97afe
|
[KYUUBI #5837] [INFRA] Only enable Jacoco with explicit profile
# 🔍 Description ## Issue References 🔗 Currently, we always enable Jacoco, which would add additional building time and produce lots of HTML files, also increase the IDEA indexing burden. <img width="1065" alt="image" src="https://github.com/apache/kyuubi/assets/26535726/6276f309-8ba4-4563-96d6-91cb53ce20a5"> ## Describe Your Solution 🔧 Add a new maven profile `codecov`, only enable it in CI with codecov enabled. ## Types of changes 🔖 - [ ] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 See CI result. --- # Checklists ## 📝 Author Self Checklist - [x] My code follows the [style guidelines](https://kyuubi.readthedocs.io/en/master/contributing/code/style.html) of this project - [x] I have performed a self-review - [ ] I have commented my code, particularly in hard-to-understand areas - [ ] I have made corresponding changes to the documentation - [x] My changes generate no new warnings - [ ] I have added tests that prove my fix is effective or that my feature works - [x] New and existing unit tests pass locally with my changes - [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) ## 📝 Committer Pre-Merge Checklist - [x] Pull request title is okay. - [x] No license issues. - [x] Milestone correctly set? - [x] Test coverage is ok - [x] Assignees are selected. - [x] Minimum number of approvals - [x] No changes are requested **Be nice. Be informative.** Closes #5837 from pan3793/codecov. Closes #5837 97d0b22de [Cheng Pan] fi c60367dd1 [Cheng Pan] fix a0e8910bc [Cheng Pan] Only enable Jacoco with explicit profile Authored-by: Cheng Pan <chengpan@apache.org> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
Cheng Pan
|
9be0c65fe9
|
[KYUUBI #5783] Switch to kyuubi-relocated-hive-service-rpc
# 🔍 Description ## Issue References 🔗 TL;DR there are some issues with shading Thrift RPC classes during the engine packaging phase, see details in the PR description of https://github.com/apache/kyuubi-shaded/pull/20. ## Describe Your Solution 🔧 This PR aims to migrate from vanilla `hive-service-rpc`, `libfb303`, `libthrift` to `kyuubi-relocated-hive-service-rpc` introduced in https://github.com/apache/kyuubi-shaded/pull/20, the detailed works are: - replace imported deps in `pom.xml` and rename the package prefix in all modules, except for - `kyuubi-server` there are a few places use vanilla thrift classes to access HMS to get token - `kyuubi-hive-sql-engine` Hive method invocation - update relocations rules in modules that creates shaded jar - introduce `HiveRpcUtils` in `kyuubi-hive-sql-engine` module for object conversion. As part of the whole change, this PR upgrades from the Kyuubi Shaded 0.1.0 to 0.2.0, which changes the jars name. see https://kyuubi.apache.org/shaded-release/0.2.0.html ## Types of changes 🔖 - [x] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 #### Behavior Without This Pull Request ⚰️ #### Behavior With This Pull Request 🎉 #### Related Unit Tests Pass all Hive UT with Hive 3.1.3, and IT with Hive 3.1.3 and 2.3.9 (also tested with 2.1.1-cdh6.3.2) --- # Checklists ## 📝 Author Self Checklist - [ ] My code follows the [style guidelines](https://kyuubi.readthedocs.io/en/master/contributing/code/style.html) of this project - [x] I have performed a self-review - [x] I have commented my code, particularly in hard-to-understand areas - [ ] I have made corresponding changes to the documentation - [x] My changes generate no new warnings - [ ] I have added tests that prove my fix is effective or that my feature works - [x] New and existing unit tests pass locally with my changes - [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) ## 📝 Committer Pre-Merge Checklist - [x] Pull request title is okay. - [x] No license issues. - [x] Milestone correctly set? - [x] Test coverage is ok - [x] Assignees are selected. - [x] Minimum number of approvals - [x] No changes are requested **Be nice. Be informative.** Closes #5783 from pan3793/rpc-shaded. Closes #5783 b45d4deaa [Cheng Pan] remove staging repo 890076a20 [Cheng Pan] Kyuubi Shaded 0.2.0 RC0 071945d45 [Cheng Pan] Rebase 199794ed9 [Cheng Pan] fix fc128b170 [Cheng Pan] fix 26d313896 [Cheng Pan] fix 632984c92 [Cheng Pan] fix 428305589 [Cheng Pan] fix 6301e28fd [Cheng Pan] fix 955cdb33b [Cheng Pan] Switch to kyuubi-shaded-hive-service-rpc Authored-by: Cheng Pan <chengpan@apache.org> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
wangjunbo
|
5481bf54f2 |
[KYUUBI #5464] JDBC Engine supports MySQL
### _Why are the changes needed?_ To close https://github.com/apache/kyuubi/issues/5464. To support JDBC engine use MySQL Dialect (kyuubi.engine.jdbc.type=mysql). ### _How was this patch tested?_ - [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [ ] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request ### _Was this patch authored or co-authored using generative AI tooling?_ No. Closes #5588 from Kwafoor/kyuubi_5464. Closes #5464 1019a6118 [wangjunbo] [KYUUBI #5464]rename function name `getProviderClass` to `getDriverClass` 9901bbad4 [wangjunbo] [KYUUBI #5464]handle properly to keep compatiblity b33d79ed2 [wangjunbo] [KYUUBI #5464]handle properly to keep compatiblity 86e6ee2b3 [wangjunbo] [KYUUBI #5464]handle properly to keep compatiblity d76cb3275 [wangjunbo] [KYUUBI #5464]update the docs 4a1acffd1 [wangjunbo] [KYUUBI #5464]update the docs 1aff55ecd [wangjunbo] [KYUUBI #5464]update the docs of kyuubi.engine.type 84202ea0c [wangjunbo] [KYUUBI #5464] update the docs of kyuubi.engine.type e3c1e94db [wangjunbo] [KYUUBI #5464] fix check cdf820da0 [wangjunbo] [KYUUBI #5464] fix check ff0f30ad8 [wangjunbo] [KYUUBI #5464] fix check 01321dc44 [wangjunbo] [KYUUBI #5464] JDBC Engine supports MySQL 756f5303c [wangjunbo] [KYUUBI #5464] JDBC Engine supports MySQL Authored-by: wangjunbo <wangjunbo@qiyi.com> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
Cheng Pan
|
c6accec623 |
Revert "[KYUUBI #5739][Bug] Fix spark extension pom import issue"
This reverts commit
|
||
|
Angerszhuuuu
|
9861bebca1 |
[KYUUBI #5739][Bug] Fix spark extension pom import issue
# 🔍 Description ## Issue References 🔗 To close #5739 This pull request fixes # ## Describe Your Solution 🔧 Fix a spark extension import issue ## Types of changes 🔖 - [x] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 #### Behavior Without This Pull Request ⚰️ #### Behavior With This Pull Request 🎉 #### Related Unit Tests --- # Checklists ## 📝 Author Self Checklist - [ ] My code follows the [style guidelines](https://kyuubi.readthedocs.io/en/master/contributing/code/style.html) of this project - [ ] I have performed a self-review - [ ] I have commented my code, particularly in hard-to-understand areas - [ ] I have made corresponding changes to the documentation - [ ] My changes generate no new warnings - [ ] I have added tests that prove my fix is effective or that my feature works - [ ] New and existing unit tests pass locally with my changes - [ ] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) ## 📝 Committer Pre-Merge Checklist - [x] Pull request title is okay. - [x] No license issues. - [x] Milestone correctly set? - [x] Test coverage is ok - [x] Assignees are selected. - [x] Minimum number of approvals - [x] No changes are requested **Be nice. Be informative.** Closes #5740 from AngersZhuuuu/KYUUBI-5739. Closes #5739 cdb824c70 [Angerszhuuuu] [KYUUBI #5739][Bug] Fix spark extension pom import issue Authored-by: Angerszhuuuu <angers.zhu@gmail.com> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
Bowen Liang
|
c2e90a9e9e |
[KYUUBI #5395] Bump netty from 4.1.93.Final to 4.1.100.Final
Bumps [io.netty:netty-codec-http2](https://github.com/netty/netty) from 4.1.93.Final to 4.1.100.Final. <details> <summary>Commits</summary> <ul> <li><a href=" |
||
|
Bowen Liang
|
b1953e877b |
[KYUUBI #5676] Bump Apache parent pom from 30 to 31
### _Why are the changes needed?_ - Apache parent pom version 31 release note: https://github.com/apache/maven-apache-parent/releases/tag/apache-31 ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [ ] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request ### _Was this patch authored or co-authored using generative AI tooling?_ Closes #5676 from bowenliang123/apache-parent-31. Closes #5676 064fc9da8 [Bowen Liang] bump apache parent pom version from 30 to 31 Authored-by: Bowen Liang <liangbowen@gf.com.cn> Signed-off-by: Bowen Liang <liangbowen@gf.com.cn> |
||
|
zhaoyangming
|
456b3c3f06 |
[KYUUBI #5375] JDBC Engine supports PostgreSQL
### _Why are the changes needed?_ Close #5375 ### _How was this patch tested?_ - [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [x] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request ### _Was this patch authored or co-authored using generative AI tooling?_ No Closes #5416 from ymZhao1001/jdbc-pg-dialect. Closes #5375 d81988d84 [zhaoyangming] postgreSQL 915f9fb0a [yangming] change to like d8da12af5 [yangming] reformat 29c63e38e [zhaoyangming] add postgresql dependency ec328ad93 [zhaoyangming] add postgresql dependency a8944fed5 [zhaoyangming] update postgresql to postgreSQL cf7b69107 [zhaoyangming] Merge remote-tracking branch 'origin/jdbc-pg-dialect' into jdbc-pg-dialect c127aa3d3 [zhaoyangming] update postgresql to postgreSQL a693d6c34 [yangming] reformat 0d12a6ceb [zhaoyangming] add postgresql dependency c7d3fa3da [yangming] fix conflict dde1564b6 [zhaoyangming] add test info 2a49b338a [zhaoyangming] style c8ce15f29 [zhaoyangming] StringBuilder is redundant. 5d70173cf [yangming] JDBC Engine supports PostgreSQL Lead-authored-by: zhaoyangming <zhaoyangming@deepexi.com> Co-authored-by: yangming <261635393@qq.com> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
Xianxun Ye
|
d4320e7a6b |
[KYUUBI #5505][FLINK] Support HELP command
### _Why are the changes needed?_ resolve: #5505 Show available commands when users type 'HELP;' in the beeline. #### Solution: - Using `ExtendedParser` parse statement and return Operation of Flink engine. - Check whether the operation is HelpOperation or not. - dependency on `flink-table-planner-loader.jar`. #### **Why not using Flink SQL Client Parser(SqlCommandParserImpl) to obtain the Command enum?** Flink 1.16's approach: ``` val opt:Optional[Operation] = org.apache.flink.table.client.cli.SqlCommandParserImpl.parseCommand() check opt.get() instance of HelpOperation or not if yes return CliStrings.MESSAGE_HELP ``` Flink 1.17 & 1.18 ``` val opt: Optional[Command] = org.apache.flink.table.client.cli.parser.SqlCommandParserImpl.parseStatement() check opt.get() is Command.HELP or not if yes return CliStrings.MESSAGE_HELP ``` The `Command` class is added from Flink1.17; The `SqlCommandParserImpl` package is changed, and the method name is changed from Flink1.17; This approach requires distinguishing between different Flink versions and maintaining both implementations. It's more complicated, so abandoned. ### _How was this patch tested?_ - [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [x] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request ### _Was this patch authored or co-authored using generative AI tooling?_ Closes #5585 from YesOrNo828/help. Closes #5505 e73b15e43 [Xianxun Ye] [KYUUBI #5505] [FLINK] Add job,update,delete,truncate and call statements 5943dd072 [Xianxun Ye] [KYUUBI #5505] [FLINK] Add help messages fdc2db6ab [Xianxun Ye] [KYUUBI #5505] [FLINK] Support HELP command, fixed Pan's comments a728048fc [Xianxun Ye] [KYUUBI #5505] [FLINK] Support HELP command, fixed Pan's comments 6323cfb85 [Xianxun Ye] [KYUUBI #5505] [FLINK] Support HELP command Authored-by: Xianxun Ye <yesorno828423@gmail.com> Signed-off-by: Paul Lin <paullin3280@gmail.com> |
||
|
Kent Yao
|
ceb8453783
|
[KYUUBI #5501] Update codecov token and fix codecov reporting on PRs
### _Why are the changes needed?_ Update codecov token to fix stale code coverage action ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [ ] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request ### _Was this patch authored or co-authored using generative AI tooling?_ no Closes #5501 from yaooqinn/token. Closes #5501 1f4053231 [Kent Yao] java-17 fcd8391e7 [Kent Yao] java-17 5ccead77d [Kent Yao] upgrade jacoco 5cb4a8374 [Kent Yao] Revert "rm" 45d7a2134 [Kent Yao] rm 0a3dd2f42 [Kent Yao] Update codecov token Authored-by: Kent Yao <yao@apache.org> Signed-off-by: Kent Yao <yao@apache.org> |
||
|
Rojin Raju
|
7517f8c011 |
[KYUUBI #5508] Upgrade download-maven-plugin from 1.6.8 to 1.7.1
### _Why are the changes needed?_ Updated the download maven plugin from 1.6.8 to 1.7.1 to solve #5508 - release note: https://github.com/maven-download-plugin/maven-download-plugin/releases/tag/1.7.1 ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [ ] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request ### _Was this patch authored or co-authored using generative AI tooling?_ NO Closes #5525 from rojin254/patch-1. Closes #5508 2a628b40e [Rojin Raju] Update download maven plugin version to 1.7.1 in pom.xml Lead-authored-by: Rojin Raju <rojinraju7@gmail.com> Co-authored-by: Rojin Raju <46747837+rojin254@users.noreply.github.com> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
liangbowen
|
ab4dfa3688 |
[KYUUBI #5486] Bump Kafka client version from 3.4.0 to 3.5.1
### _Why are the changes needed?_ - Bump Kafka client version from 3.4.0 to 3.5.1 - Bump Docker image for Kafka 3 to 3.5.0 (equivalent to Confluent Platform 7.5.x) - https://docs.confluent.io/platform/current/installation/versions-interoperability.html#cp-and-apache-ak-compatibility ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [x] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request ### _Was this patch authored or co-authored using generative AI tooling?_ No. Closes #5486 from bowenliang123/bump-kafka. Closes #5486 017ea860d [Bowen Liang] update dependencyList 20ad988ed [liangbowen] bump kafka client version 3.5.1 Lead-authored-by: liangbowen <liangbowen@gf.com.cn> Co-authored-by: Bowen Liang <liangbowen@gf.com.cn> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
Xianxun Ye
|
3646ae08bd
|
[KYUUBI #5405] [FLINK] Support Flink 1.18
### _Why are the changes needed?_ Resolve: #5405 Support the Flink 1.18 ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [x] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request ### _Was this patch authored or co-authored using generative AI tooling?_ No Closes #5465 from YesOrNo828/flink-1.18. Closes #5405 a0010ca14 [Xianxun Ye] [KYUUBI #5405] [FLINK] Remove flink1.18 rc repo 2a4ae365c [Xianxun Ye] Update .github/workflows/master.yml d4d458dc7 [Xianxun Ye] [KYUUBI #5405] [FLINK] Update the flink1.18-rc3 repo 99172e3da [Xianxun Ye] [KYUUBI #5405] [FLINK] Using the staging repo during the RC stage 4c0cf887b [Xianxun Ye] [KYUUBI #5405] [FLINK] Using the staging repo during the RC stage c74f5c31b [Xianxun Ye] [KYUUBI #5405] [FLINK] fixed Pan's comments. 1933ebadd [Xianxun Ye] [KYUUBI #5405] [FLINK] Support Flink 1.18 Authored-by: Xianxun Ye <yesorno828423@gmail.com> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
Cheng Pan
|
75428bb979
|
[KYUUBI #5484] Remove legacy Web UI
### _Why are the changes needed?_ Close https://github.com/apache/kyuubi/issues/5484 Kyuubi provides a basic new Web UI which is built on top of Vue3, we can remove the legacy dummy Web UI in 1.8. The new UI hosts at `http://<host>:<port>/ui/` and the legacy UI hosts at `http://<host>:<port>/`, we should 1. Remove the legacy UI routing from Jetty 2. Remove all files related to legacy UI 3. Redirect `http://<host>:<port>/` to `http://<host>:<port>/ui/` ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [x] Add screenshots for manual tests if appropriate building with the command `build/dist --web-ui`, then `cd dist` and perform `bin/kyuubi run` access http://0.0.0.0:10099 could correctly redirect to http://0.0.0.0:10099/ui/ <img width="1428" alt="image" src="https://github.com/apache/kyuubi/assets/26535726/1e8a67f6-e4db-415e-8a47-dd7c41b487cf"> swagger is render correctly too. <img width="1428" alt="image" src="https://github.com/apache/kyuubi/assets/26535726/1cb4ba31-9965-4468-b7c3-b0319ba959e6"> - [ ] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request ### _Was this patch authored or co-authored using generative AI tooling?_ No. Closes #5516 from pan3793/5484. Closes #5484 9d58ef758 [Cheng Pan] address comment and fix test 6d4c0981b [Cheng Pan] [KYUUBI #5484] Remove legacy Web UI Authored-by: Cheng Pan <chengpan@apache.org> Signed-off-by: Kent Yao <yao@apache.org> |
||
|
yikaifei
|
59c25b9851
|
[KYUUBI #5427] [AUTHZ] Shade spark authz plugin
### _Why are the changes needed?_ This PR aims to shade the kyuubi spark authz plugin to simplify the user's use. ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [x] Add screenshots for manual tests if appropriate - [ ] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request ### _Was this patch authored or co-authored using generative AI tooling?_ No Closes #5427 from Yikf/shade-authz. Closes #5427 d2f7ea8d1 [yikaifei] fix 695133de4 [Kent Yao] Update docs/security/authorization/spark/install.md f3a653133 [Kent Yao] Update docs/security/authorization/spark/build.md 963cab372 [yikaifei] bundle 2068c98fc [yikaifei] relocation 6c6e50ea7 [yikaifei] Shade spark authz plugin Lead-authored-by: yikaifei <yikaifei@apache.org> Co-authored-by: Kent Yao <yao@apache.org> Signed-off-by: yikaifei <yikaifei@apache.org> |
||
|
Bowen Liang
|
d68507d239 |
[KYUUBI #5462] [AUTHZ] Support create table command for Paimon
### _Why are the changes needed?_ Apache Paimon is an incubating Apache project of data lake platform for high-speed data ingestion, changelog tracking and efficient real-time analytics. - Initial support for Paimon tables in Authz plugin - Create Table Command: https://paimon.apache.org/docs/master/engines/spark3/#create-table - Paimon `0.5.0-incubating` supports Spark 3.1/3.2/3.3/3.4. ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [x] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request ### _Was this patch authored or co-authored using generative AI tooling?_ Closes #5462 from bowenliang123/authz-paimon-createtable. Closes #5462 8393f6ecc [liangbowen] remove spark-authz-paimon-test profile, use 3.4 as spark binary version for Paimon a4e01a2a8 [liangbowen] update workflow inclusions f372882aa [liangbowen] update workflow exclusions 7785dec52 [liangbowen] update workflow include 64ee20106 [liangbowen] update 73edea38f [liangbowen] add spark-authz-paimon-test profile and excluded for Spark 3.5 de58605bb [liangbowen] nit 81a4a4370 [liangbowen] nit eb2de8359 [Bowen Liang] exclude paimon tests for spark-3.5 4f58d7727 [Bowen Liang] fix typo cf360e6da [Bowen Liang] drop database af8ffda14 [Bowen Liang] drop database dc3ee9462 [Bowen Liang] support Paimon create table Lead-authored-by: Bowen Liang <liangbowen@gf.com.cn> Co-authored-by: liangbowen <liangbowen@gf.com.cn> Signed-off-by: Bowen Liang <liangbowen@gf.com.cn> |
||
|
zml1206
|
8d2c8d1009
|
[KYUUBI #5449] Bump Delta Lake 3.0.0
### _Why are the changes needed?_ close [#5449](https://github.com/apache/kyuubi/issues/5449). Unlike the initial preview release, Delta Spark 3.0.0 is now built on top of Apache Spark™ 3.5. Delta Spark maven artifact has been renamed from delta-core to delta-spark. https://github.com/delta-io/delta/releases/tag/v3.0.0 ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [ ] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request ### _Was this patch authored or co-authored using generative AI tooling?_ No Closes #5450 from zml1206/5449. Closes #5449 a7969ed6a [zml1206] bump Delta Lake 3.0.0 Authored-by: zml1206 <zhuml1206@gmail.com> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
Bowen Liang
|
dcaacc3ed5 |
[KYUUBI #4916] [AUTHZ] Support ReplaceData and compatible Spark 3.4 and 3.5
### _Why are the changes needed?_ - Iceberg 1.3.0 use Spark's `ReplaceData` since 3.4 as Logical plan for "DELETE FROM", instead of Iceberg's `DeleteFromTable` in Spark3.4 - Requiring select privilege for input table, even it's the same with output table - compatible Spark 3.4 and 3.5, subquies in the plan - enable iceberg test for authz plugin on Spark 3.4 and 3.5 ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [x] [Run test](https://kyuubi.readthedocs.io/en/master/develop_tools/testing.html#running-tests) locally before make a pull request Closes #4916 from bowenliang123/authz-replacedata. Closes #4916 658917752 [Bowen Liang] Merge branch 'master' into authz-replacedata 17f5d84dd [liangbowen] update 25009908a [Bowen Liang] ut of user with select only for DELETE FROM fa77cea15 [Bowen Liang] ut fd9bb8f3a [Bowen Liang] update f9cfb98a9 [Bowen Liang] assertion for Spark 3.5 f574e0da3 [Bowen Liang] assertion for Spark 3.5 2449c27de [Bowen Liang] bring back single call ut for someone 78786988d [Bowen Liang] bring back single call ut for someone b8e4a6319 [wforget] fix style 0e26c08b4 [wforget] fix IcebergCatalogRangerSparkExtensionSuite with spark-3.5 02781781f [wforget] enable iceberg tests in spark-3.5 215e1b861 [wforget] fix TableCommands d019b1632 [wforget] followup ae17e076b [wforget] Merge remote-tracking branch 'origin/master' into authz-replacedata b88f77355 [Bowen Liang] update febcb3ee5 [Bowen Liang] isSparkV34OrGreater 91d41b438 [Bowen Liang] replace data Lead-authored-by: Bowen Liang <liangbowen@gf.com.cn> Co-authored-by: wforget <643348094@qq.com> Co-authored-by: Bowen Liang <bowenliang@apache.org> Co-authored-by: liangbowen <liangbowen@gf.com.cn> Signed-off-by: Bowen Liang <liangbowen@gf.com.cn> |
||
|
Angerszhuuuu
|
143b26b6e8
|
[KYUUBI #5284] Support Hudi Alter Table Command in Authz
### _Why are the changes needed?_ To close #5284. Hudi also is a common used data format, since kyuubi already support iceberg and delta, we should also support hudi. In this pr we support hoodie sql about ALTER COMMAND in authz In this PR we use default Hudi version 0.14.0. We support from spark 3.1 to spark 3.4, since Hudi don't support spark 3.5 yet - [x] spark 3.1 - [x] spark 3.2 - [x] spark 3.3 - [x] spark 3.4 - [ ] spark 3.5 Also since Hudi only supports Scala 2.12, I also made Hudi as a separate profile to avoid importing Hudi when enable Scala 2.13 ### _How was this patch tested?_ - [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [ ] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request ### _Was this patch authored or co-authored using generative AI tooling?_ No Closes #5287 from AngersZhuuuu/KYUUBI-5284. Closes #5284 f171e11af [Angerszhuuuu] Update pom.xml 3f57a3dc5 [Angerszhuuuu] follow comment f6c764028 [Angerszhuuuu] follow comment 51797e25c [Angerszhuuuu] trigger b3c059af9 [Angerszhuuuu] Update HudiCatalogRangerSparkExtensionSuite.scala 3510e7601 [liangbowen] remove scope in dependencyManagement 14ea0d498 [liangbowen] change to use `spark.binary.version` for hudi dependency by default 354260eb0 [liangbowen] remove the abbreviation tite 658bddbab [liangbowen] remove clarification and use ALTERTABLE_PROPERTIES for opType 150edcd40 [Angerszhuuuu] update 30c417b19 [Angerszhuuuu] trigger 56e5cb17b [Angerszhuuuu] Update HudiCatalogRangerSparkExtensionSuite.scala fe9b75270 [Angerszhuuuu] update 888943831 [Angerszhuuuu] Update HudiCatalogRangerSparkExtensionSuite.scala db749a277 [Angerszhuuuu] update 9b09e78c2 [Angerszhuuuu] Update HudiCommands.scala 87de62e52 [Angerszhuuuu] follow comment 2d551d112 [Angerszhuuuu] Update master.yml 89082e06b [Angerszhuuuu] Update master.yml 7c7846378 [Angerszhuuuu] Merge branch 'KYUUBI-5284' of https://github.com/AngersZhuuuu/incubator-kyuubi into KYUUBI-5284 d32ca9839 [Angerszhuuuu] Update master.yml ec43e2a7b [Angerszhuuuu] Merge branch 'master' into KYUUBI-5284 b3611fd3e [Angerszhuuuu] update 2a0dfa74f [Angerszhuuuu] Update AuthZUtils.scala 45ee9e251 [Angerszhuuuu] update 0560a5e14 [Angerszhuuuu] Update pom.xml 97c50f622 [Angerszhuuuu] update f57ee0093 [Angerszhuuuu] Update table_command_spec.json fb72197e6 [Angerszhuuuu] update 2154cf928 [Angerszhuuuu] trigger 44469359f [Angerszhuuuu] trigger b0e768cb8 [Angerszhuuuu] Update HoodieCatalogRangerSparkExtensionSuite.scala 83795ed63 [Angerszhuuuu] Update pom.xml eed190f92 [Angerszhuuuu] update 361660145 [Angerszhuuuu] update 1ed1f3ab6 [Angerszhuuuu] Update 7ee3c7dd5 [Angerszhuuuu] Merge branch 'KYUUBI-5284' of https://github.com/AngersZhuuuu/incubator-kyuubi into KYUUBI-5284 ee0916f63 [Angerszhuuuu] Update HoodieCatalogRangerSparkExtensionSuite.scala 010260fa4 [Angerszhuuuu] Merge branch 'master' into KYUUBI-5284 c11d02def [Angerszhuuuu] update b84f91f65 [Angerszhuuuu] update 42fbb0ffa [Angerszhuuuu] Update HoodieCatalogRangerSparkExtensionSuite.scala c1346adb1 [Angerszhuuuu] update 2ec63ae94 [Angerszhuuuu] Update pom.xml 39bce7468 [Angerszhuuuu] update c70b0ea2f [Angerszhuuuu] Update pom.xml e1d85ff77 [Angerszhuuuu] Update pom.xml 59012ac25 [Angerszhuuuu] Update pom.xml a46de65b5 [Angerszhuuuu] Update HoodieTest.java b8173b893 [Angerszhuuuu] update 055713329 [Angerszhuuuu] Update table_command_spec.json d7b21e820 [Angerszhuuuu] Update HoodieCatalogRangerSparkExtensionSuite.scala 0a93ff794 [Angerszhuuuu] [KYUUBI #5284] Kyuubi authz support Hoodie Alter Table Command Lead-authored-by: Angerszhuuuu <angers.zhu@gmail.com> Co-authored-by: liangbowen <liangbowen@gf.com.cn> Signed-off-by: Kent Yao <yao@apache.org> |
||
|
Bowen Liang
|
e33df9ce66 |
[KYUUBI #5196] Enable CI Test on Scala 2.13 and support custom or spark-core extracted Scala version for Spark's engine
### _Why are the changes needed?_ - enable CI test on Scala-2.13 for all modules except Flink SQL engine - For testing, choose available Spark engine home in `download` module by `SCALA_COMPILE_VERSION` of Kyuubi server - Choose the Scala version of Spark engine main resource Jar in the following order: 1. `SPARK_SCALA_VERSION` system env 2. Extract Scala version from Spark home's `spark-core` jar filename - Fixed 1 assertion error of kyuubi-spark-lineage module, as Spark on Scala 2.12 and 2.13 show different order of column linage output in `MergeIntoTable` ut ``` SparkSQLLineageParserHelperSuite: - columns lineage extract - MergeIntoTable *** FAILED *** inputTables(List(v2_catalog.db.source_t)) outputTables(List(v2_catalog.db.target_t)) columnLineage(List(ColumnLineage(v2_catalog.db.target_t.name,Set(v2_catalog.db.source_t.name)), ColumnLineage(v2_catalog.db.target_t.price,Set(v2_catalog.db.source_t.price)), ColumnLineage(v2_catalog.db.target_t.id,Set(v2_catalog.db.source_t.id)))) did not equal inputTables(List(v2_catalog.db.source_t)) outputTables(List(v2_catalog.db.target_t)) columnLineage(List(ColumnLineage(v2_catalog.db.target_t.id,Set(v2_catalog.db.source_t.id)), ColumnLineage(v2_catalog.db.target_t.name,Set(v2_catalog.db.source_t.name)), ColumnLineage(v2_catalog.db.target_t.price,Set(v2_catalog.db.source_t.price)))) (SparkSQLLineageParserHelperSuite.scala:182) ``` - Fixed other tests relying on Scala scripting results ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [x] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request ### _Was this patch authored or co-authored using generative AI tooling?_ Closes #5196 from bowenliang123/scala213-test. Closes #5196 97fafacd3 [liangbowen] prevent repeated compilation for regrex pattern 76b99d423 [Bowen Liang] test on scala-2.13 Lead-authored-by: Bowen Liang <liangbowen@gf.com.cn> Co-authored-by: liangbowen <liangbowen@gf.com.cn> Signed-off-by: Bowen Liang <liangbowen@gf.com.cn> |
||
|
wforget
|
d2c072b7c2
|
[KYUUBI #5336] Spark extension supports Spark 3.5
### _Why are the changes needed?_ It is basically copied from `kyuubi-extension-spark-3-4`. ### _How was this patch tested?_ Compiled successfully: ``` build/mvn clean install -DskipTests -Pflink-provided,spark-provided,hive-provided,spark-3.5 ``` - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [ ] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request ### _Was this patch authored or co-authored using generative AI tooling?_ No Closes #5336 from wForget/dev_spark_3_5. Closes #5336 7ba99804a [wforget] remove iceberg.version in spark-3.5 profile a18ce166a [wforget] Regenerate KyuubiEnsureRequirements based on EnsureRequirements in spark 3.5 4725c4701 [wforget] fix iceberg version f5a8ea934 [wforget] Bump iceberg 1.4.0 06558dcfa [wforget] make kyuubi-spark-authz plugin compatible with Spark3.5 90d0e4c70 [wforget] make kyuubi-spark-authz plugin compatible with Spark3.5 4bc8d24d6 [wforget] add ci 1b3f2d916 [wforget] Make kyuubi spark extension compatible with Spark3.5 Authored-by: wforget <643348094@qq.com> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
wforget
|
34bf47cab3
|
[KYUUBI #5358] Bump iceberg 1.4.0
### _Why are the changes needed?_ https://github.com/apache/iceberg/releases/tag/apache-iceberg-1.4.0 ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [ ] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request ### _Was this patch authored or co-authored using generative AI tooling?_ No Closes #5358 from wForget/bump_iceberg_1_4. Closes #5358 e03d8d672 [wforget] comment db0b6b978 [wforget] Bump iceberg 1.4.0 Authored-by: wforget <643348094@qq.com> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
Cheng Pan
|
83bbefe847
|
[KYUUBI #5318] Pin maven-source-plugin 3.2.1
### _Why are the changes needed?_ The current maven-source-plugin version(3.3.0) inherits from `org.apache:parent:pom:30`, unfortunately, MSOURCES-121 breaks shaded modules to create source artifacts. ``` [ERROR] We have duplicated artifacts attached. [ERROR] Failed to execute goal org.apache.maven.plugins:maven-source-plugin:3.3.0:jar-no-fork (attach-sources) on project kyuubi-hive-jdbc-shaded: Presumably you have configured maven-source-plugn to execute twice times in your build. You have to configure a classifier for at least on of them. -> [Help 1] org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.maven.plugins:maven-source-plugin:3.3.0:jar-no-fork (attach-sources) on project kyuubi-hive-jdbc-shaded: Presumably you have configured maven-source-plugn to execute twice times in your build. You have to configure a classifier for at least on of them. ``` We should skip upgrading until MSOURCES-141 gets fixed. ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [x] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request ### _Was this patch authored or co-authored using generative AI tooling?_ No. Closes #5318 from pan3793/mvn-source. Closes #5318 7d12d12e3 [Cheng Pan] [KYUUBI #5318] Pin maven-source-plugin 3.2.1 Authored-by: Cheng Pan <chengpan@apache.org> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
pengqli
|
9b93e874a0 |
[KYUUBI #5293] upgrade snakeyaml from 1.33 to 2.2
### _Why are the changes needed?_ upgrade snakeyaml from 1.33 to 2.2 reducing direct CVE vulnerabilities, see (https://bitbucket.org/snakeyaml/snakeyaml/wiki/Changes) [CVE-2022-1471](https://nvd.nist.gov/vuln/detail/CVE-2022-1471) SnakeYaml's Constructor() class does not restrict types which can be instantiated during deserialization. Deserializing yaml content provided by an attacker can lead to remote code execution. We recommend using SnakeYaml's SafeConsturctor when parsing untrusted content to restrict deserialization. We recommend upgrading to version 2.0 and beyond. ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [x] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request ### _Was this patch authored or co-authored using generative AI tooling?_ No Closes #5293 from dev-lpq/snakeyaml_critical. Closes #5293 5b2412d8e [pengqli] upgrade snakeyaml from 1.33 to 2.2 Authored-by: pengqli <pengqli@cisco.com> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
senmiaoliu
|
086cf1fe66
|
[KYUUBI #5253] Upgrade testcontainers-scala from 0.40.12 to 0.41.0
### _Why are the changes needed?_
close #5253
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [ ] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request
### _Was this patch authored or co-authored using generative AI tooling?_
NO
Closes #5254 from lsm1/branch-kyuubi-5253.
Closes #5253
b5c407671 [senmiaoliu] bump testcontainers 0.41.0
Authored-by: senmiaoliu <senmiaoliu@trip.com>
Signed-off-by: Cheng Pan <chengpan@apache.org>
(cherry picked from commit
|
||
|
Cheng Pan
|
c3b7af0b54
|
Revert "[KYUUBI #5253] Upgrade testcontainers-scala from 0.40.12 to 0.41.0"
This reverts commit
|
||
|
senmiaoliu
|
6158599c4f
|
[KYUUBI #5253] Upgrade testcontainers-scala from 0.40.12 to 0.41.0
### _Why are the changes needed?_ close #5253 ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [ ] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request ### _Was this patch authored or co-authored using generative AI tooling?_ NO Closes #5254 from lsm1/branch-kyuubi-5253. Closes #5253 b5c407671 [senmiaoliu] bump testcontainers 0.41.0 Authored-by: senmiaoliu <senmiaoliu@trip.com> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
Sidhant Nagpal
|
5abc2625f1
|
[KYUUBI #5234] Upgrade Jetty version from 9.4.51.v20230217 to 9.4.52.v20230823
Fixes #5234 Closes #5239 from sidhant-nagpal/fix#5234/jetty-upgraded-from-9.4.51.v20230217-to-9.4.52.v20230823. Closes #5234 cbd4b4990 [Sidhant Nagpal] Merge branch 'master' of https://github.com/sidhant-nagpal/kyuubi into fix#5234/jetty-upgraded-from-9.4.51.v20230217-to-9.4.52.v20230823 608a510a9 [Sidhant Nagpal] Merge branch 'master' of https://github.com/sidhant-nagpal/kyuubi into fix#5234/jetty-upgraded-from-9.4.51.v20230217-to-9.4.52.v20230823 d2ac35e08 [Sidhant Nagpal] Revert "#5234 Upgrade Jetty from 9.4.51.v20230217 to 9.4.52.v20230823" f15af280d [Sidhant Nagpal] #5234 Upgrade Jetty from 9.4.51.v20230217 to 9.4.52.v20230823 2498302b4 [Sidhant Nagpal] #5234 Upgrade Jetty from 9.4.51.v20230217 to 9.4.52.v20230823 Authored-by: Sidhant Nagpal <sidnagpal2000@gmail.com> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
chenliang.lu
|
ea44fb88ea
|
[KYUUBI #5250] [TEST] Bump Iceberg from 1.3.0 to 1.3.1
### _Why are the changes needed?_ https://github.com/apache/iceberg/releases/tag/apache-iceberg-1.3.1 ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [x] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request ### _Was this patch authored or co-authored using generative AI tooling?_ No Closes #5250 from yabola/auto_ci. Closes #5250 85f2625a5 [chenliang.lu] [minor] update iceberg version Authored-by: chenliang.lu <chenlianglu@tencent.com> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
Bowen Liang
|
be93d89744 |
[KYUUBI #5241] Bump Commons Lang3 from 3.12.0 to 3.13.0
### _Why are the changes needed?_ - Apache Commons Lang 3.13.0 release note: https://commons.apache.org/proper/commons-lang/changes-report.html#a3.13.0 ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [x] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request ### _Was this patch authored or co-authored using generative AI tooling?_ No. Closes #5241 from bowenliang123/commonslang3-3.13. Closes #5241 99e5ffbd9 [Bowen Liang] update dependencyList f2bf9c554 [Bowen Liang] bump commons lang3 to 3.13.0 Authored-by: Bowen Liang <liangbowen@gf.com.cn> Signed-off-by: Bowen Liang <liangbowen@gf.com.cn> |
||
|
Cheng Pan
|
6061a05f24
|
Bump 1.9.0-SNAPSHOT | ||
|
liangbowen
|
a01d7092ea |
[KYUUBI #5222] [FLINK] Remove unused provided dependencies in Flink SQL engine
### _Why are the changes needed?_
- Remove the provided dependency `flink-table-planner_${scala.binary.version}` which provides a legacy table planner API on Scala, but is never used in Kyuubi's source code or in runtime directly.
- `** The legacy planner is deprecated and will be dropped in Flink 1.14.**` according to [Flink 1.13's doc of Legacy Planner](https://nightlies.apache.org/flink/flink-docs-release-1.13/docs/dev/table/legacy_planner/)
- Kyuubi has dropped support for Flink 1.14 and before in #4588
- Remove the unused provided dependency `flink-sql-parser`
- All tests on Scala 2.12 work fine without them, as `flink-table-runtime` dependency provides enough Java API for usage.
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [x] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request
### _Was this patch authored or co-authored using generative AI tooling?_
No.
Closes #5222 from bowenliang123/flink-remove-planner.
Closes #5222
716ec06e9 [liangbowen] remove flink-sql-parser dependency
0922ba5af [liangbowen] Remove unnecessary dependency flink-table-planner
Authored-by: liangbowen <liangbowen@gf.com.cn>
Signed-off-by: Bowen Liang <liangbowen@gf.com.cn>
|
||
|
liangbowen
|
b3b58f0460 |
[KYUUBI #5209] Reformat Scala source code crossing versions
### _Why are the changes needed?_ - adding source code in `src/main/scala-2.12/**/*.scala` and `src/main/scala-2.13/**/*.scala` to including paths for Scala spotless styling ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [x] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request ### _Was this patch authored or co-authored using generative AI tooling?_ No. Closes #5209 from bowenliang123/scala-reformat. Closes #5209 84b4205e9 [liangbowen] use wildcard for scala versions 0c32c582d [liangbowen] reformat scala-2.12 specific code Authored-by: liangbowen <liangbowen@gf.com.cn> Signed-off-by: liangbowen <liangbowen@gf.com.cn> |
||
|
fwang12
|
b1eef09dce |
[KYUUBI #5205] [BUILD][k8s] Upgrade kubernetes-client to 6.8.1
### _Why are the changes needed?_ This PR aims to upgrade kubernetes-client to 6.8.1. https://github.com/fabric8io/kubernetes-client/releases/tag/v6.8.0 https://github.com/fabric8io/kubernetes-client/releases/tag/v6.8.1 ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [x] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request ### _Was this patch authored or co-authored using generative AI tooling?_ Closes #5205 from turboFei/k8s_client_version_upgrade. Closes #5205 3d8d06ca3 [fwang12] Upgrade kubernetes client version to 6.8.1 Authored-by: fwang12 <fwang12@ebay.com> Signed-off-by: fwang12 <fwang12@ebay.com> |
||
|
Cheng Pan
|
3a06cc3637
|
[KYUUBI #5202] Switch to Spark 3.4 by default
### _Why are the changes needed?_ Kyuubi fully supports Spark 3.4 now, it's time to move forward. ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [x] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request ### _Was this patch authored or co-authored using generative AI tooling?_ Closes #5202 from pan3793/default-3.4. Closes #5202 a0efccdbf [Cheng Pan] nit 30456dbb9 [Cheng Pan] nit 1cc83c871 [Cheng Pan] enable lineage test d8ca7c7d8 [Cheng Pan] Switch to Spark 3.4 by default Authored-by: Cheng Pan <chengpan@apache.org> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
Cheng Pan
|
d4d79b4716 |
[KYUUBI #5150] Bump Spark 3.3.3
### _Why are the changes needed?_ https://spark.apache.org/news/spark-3-3-3-released.html ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [x] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request Closes #5150 from pan3793/spark-3.3.3. Closes #5150 61583609b [Cheng Pan] image 3021dd80b [Cheng Pan] remove staging repo 71b8aa843 [Cheng Pan] Revert "tgz" d9125e63e [Cheng Pan] tgz ebe3107c9 [Cheng Pan] Bump Spark 3.3.3 Authored-by: Cheng Pan <chengpan@apache.org> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|
liangbowen
|
0b1a0cb4f2 |
[KYUUBI #5183] Introducing profile scala-2.13 for development use
### _Why are the changes needed?_ - introducing `scala-2.13` for development use only - adapt the common modules compilable on Scala 2.13, including - kyuubi-common - kyuubi-ctl - kyuubi-ha - use separate compile options for Scala 2.13 , skipping deprecated scala compiler option `-Yno-adapted-args` ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [ ] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request ### _Was this patch authored or co-authored using generative AI tooling?_ Closes #5183 from bowenliang123/scala213-common. Closes #5183 1e65a5d03 [Bowen Liang] Align scala 2.13 version with Spark to 2.13.8 0003c8bed [liangbowen] duplicate scala-maven-plugin configs in profile 8b448a5f0 [liangbowen] 2.13.11 36d2284c4 [liangbowen] comment 28b515a0c [liangbowen] comment 865c5e55b [liangbowen] update 52e381200 [liangbowen] ensure kyuubi-ctl module compilable on scala 2.13 70dbc7ae2 [liangbowen] ensure kyuubi-ha module compilable on scala 2.13 84c1e4b4d [liangbowen] ensure kyuubi-common module compilable on scala 2.13 e116d77f5 [liangbowen] skip deprecated compiler option "-Yno-adapted-args" in 2.13 26c27a2ee [liangbowen] introduce new profile scala-2.13 Lead-authored-by: liangbowen <liangbowen@gf.com.cn> Co-authored-by: Bowen Liang <liangbowen@gf.com.cn> Signed-off-by: liangbowen <liangbowen@gf.com.cn> |
||
|
Cheng Pan
|
ea16606596
|
[KYUUBI #5116] Bump Hadoop 3.3.6
### _Why are the changes needed?_ https://hadoop.apache.org/release/3.3.6.html ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [x] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request Closes #5116 from pan3793/hadoop-3.3.6. Closes #5116 c3717e7fb [Cheng Pan] Bump Hadoop 3.3.6 Authored-by: Cheng Pan <chengpan@apache.org> Signed-off-by: Cheng Pan <chengpan@apache.org> |