apache/kyuubi
1
0
Fork 0
Code Issues Pull Requests Actions 5 Packages Projects Releases Wiki Activity
703 Commits 23 Branches 0 Tags 65 MiB
a4d507a9c6
Commit Graph

88 Commits

Author SHA1 Message Date
Kent Yao
efdd9fafc8
[KYUUBI #307]GetCatalogs supports DSv2 and keeps its backward compatibility (#307) 
![yaooqinn](https://badgen.net/badge/Hello/yaooqinn/green) [![PR 307](https://badgen.net/badge/Preview/PR%20307/blue)](https://github.com/yaooqinn/kyuubi/pull/307) ![Feature](https://badgen.net/badge/Label/Feature/) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!  Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->

### Please add issue ID here?
<!-- replace ${issue ID} with the actual issue id -->
Fixes #307

### Why are the changes needed?
<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the user case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->

GetCatalogs supports DSv2 and keeps its backward compatibility

### Test Plan:
- [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [x] Add screenshots for manual tests if appropriate
![image](https://user-images.githubusercontent.com/8326978/106161043-7259c400-61c1-11eb-9beb-3326f6093284.png)

- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

* GetCatalogs supports DSv2

* pr template

* nit

* nit

* shim

* add iceberg tests

* nit
 2021-01-29 10:27:48 +08:00
Kent Yao
eadca7589c
[KYUUBI #296] Add spark 2.4 profile and shade hive-sevice-rpc to engine jar to fix thrift build err (#296) 
* add spark 2.4.7 profile

* nit

* nit

* scala versions for profile spark-2.4
 2021-01-18 14:23:31 +08:00
Cheng Pan
50f86b3659
[KYUUBI#282] Downgrade libthrift:0.9.3 due to THRIFT-4805 
fixes #282
Squashed commit of the following:

commit 6b6f75ce5d0171fc58472d21876ad5fd2a571aa0
Author: Cheng Pan <379377944@qq.com>
Date:   Thu Jan 14 00:25:38 2021 +0800

    downgrade libthrift:0.9.3 due to THRIFT-4805
 2021-01-14 16:56:44 +08:00
fwang12
bf793f4b7a
Remove unused setting in pom 
fixes #281
Squashed commit of the following:

commit 209729719e0f18b94377de8c126cc94cb14d1839
Author: fwang12 <fwang12@ebay.com>
Date:   Wed Jan 13 20:56:39 2021 +0800

    remove also

commit afdd72b7d39acfb286769a0f991d3437786f4341
Author: fwang12 <fwang12@ebay.com>
Date:   Wed Jan 13 20:31:47 2021 +0800

    Remove unused setting in pom
 2021-01-13 21:11:34 +08:00
Cheng Pan
24b8b22e33
exclude hbase-* from hive-jdbc 
fixes #275
Squashed commit of the following:

commit 6429ef117150087e8232ea73eb5b4a3668a1f017
Author: Cheng Pan <379377944@qq.com>
Date:   Sun Jan 10 00:53:41 2021 +0800

    exclude hbase-* from hive-jdbc
 2021-01-10 01:21:41 +08:00
Kent Yao
61a2da4943
Merge pull request #272 from yaooqinn/dependabot/maven/org.apache.zookeeper-zookeeper-3.4.14 
Bump zookeeper from 3.4.6 to 3.4.14
 2021-01-10 00:23:17 +08:00
dependabot[bot]
4d1d3a49f8
Bump libthrift from 0.9.3 to 0.12.0 
fixes #273

Squashed commit of the following:

commit b6a8d787ede228246af7b9d142f2edbd08e07eac
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date:   Sat Jan 9 15:34:57 2021 +0000

    Bump libthrift from 0.9.3 to 0.12.0

    Bumps [libthrift](https://github.com/apache/thrift) from 0.9.3 to 0.12.0.
    - [Release notes](https://github.com/apache/thrift/releases)
    - [Changelog](https://github.com/apache/thrift/blob/master/CHANGES.md)
    - [Commits](https://github.com/apache/thrift/compare/0.9.3...v0.12.0)

    Signed-off-by: dependabot[bot] <support@github.com>
 2021-01-10 00:15:08 +08:00
dependabot[bot]
da2b22eedb
Bump zookeeper from 3.4.6 to 3.4.14 
Bumps zookeeper from 3.4.6 to 3.4.14.

Signed-off-by: dependabot[bot] <support@github.com>
 2021-01-09 15:34:54 +00:00
Cheng Pan
0eeb99774f
Tune pom 
fixes #271
Squashed commit of the following:

commit fe0f469b2068865398d6e5be1957fdf6c6f5eb87
Author: Cheng Pan <379377944@qq.com>
Date:   Sat Jan 9 22:28:43 2021 +0800

    followup

commit 527e32419ecb2ae584d1251cb345e3fc870965a9
Author: Cheng Pan <379377944@qq.com>
Date:   Sat Jan 9 22:21:29 2021 +0800

    revert some stuffs

commit 82f188972b8491c5d381ba076a53f84a2fbc1898
Author: Cheng Pan <379377944@qq.com>
Date:   Sat Jan 9 16:49:14 2021 +0800

    remove unused dependencies

commit c7eb27228d2749ab9100102467e94d3a6a98cf44
Author: Cheng Pan <379377944@qq.com>
Date:   Sat Jan 9 15:41:59 2021 +0800

    minimize dependencies in kyuubi-spark-sql-engine

commit da902b1b1e02c7e93810ca832f6c9e7109cf95b9
Author: Cheng Pan <379377944@qq.com>
Date:   Sat Jan 9 13:26:34 2021 +0800

    exclude hive dependencies

commit 55ae7f025a5ffcec402919e28b7b3af5987dfe16
Author: Cheng Pan <379377944@qq.com>
Date:   Sat Jan 9 01:08:09 2021 +0800

    pin versions and excludes in <dependencyManagement>

commit 9ef84a5f62afd66fb4b817d593ba1b13ff8348ed
Author: Cheng Pan <379377944@qq.com>
Date:   Sat Jan 9 14:12:04 2021 +0800

    trigger kyuubi-spark-sql-engine package

commit d492e3fdce64e6554fe0db1d810c6f4bea198baa
Author: Cheng Pan <379377944@qq.com>
Date:   Sat Jan 9 13:44:13 2021 +0800

    trigger kyuubi-download

commit 050281b8fc400f3ae5fa1d43d56da49846664ea4
Author: Cheng Pan <379377944@qq.com>
Date:   Sat Jan 9 15:30:58 2021 +0800

    pin modules version in dependencyManagement

commit 1655fc453ded4626ae5e12e7b17af6f10c30a0dd
Author: Cheng Pan <379377944@qq.com>
Date:   Fri Jan 8 19:45:27 2021 +0800

    tune modules in alphabetical order

commit 7f3f4d987336d71d73eab059e93f3d008cfcd1a6
Author: Cheng Pan <379377944@qq.com>
Date:   Sat Jan 9 00:09:49 2021 +0800

    change dependencies scope to test
 2021-01-09 23:30:46 +08:00
Cheng Pan
90c120759e
Improve pom.xml 
fixes #268
Squashed commit of the following:

commit d40d0831d578af23559ea2a2544ceebc47f6df50
Author: Cheng Pan <379377944@qq.com>
Date:   Fri Jan 8 18:30:51 2021 +0800

    remove unused mockito

commit 386e7e4eb1c93006e302c41ffbc04d0acfaf9a9b
Author: Cheng Pan <379377944@qq.com>
Date:   Fri Jan 8 17:35:44 2021 +0800

    extract versions to properties
 2021-01-08 19:04:48 +08:00
Kent Yao
ca1b452e9a
Prepare Kyuubi v1.1.0 2020-12-31 15:51:12 +08:00
Kent Yao
bb2b3038e1
Improve Session Share Level 2020-12-27 02:09:57 +08:00
Kent Yao
a8b70d0841
Add a one-click tpcds generating tool (#262) 
* Add a one click tpcds generating tool

* nit
 2020-12-12 03:04:42 +08:00
Kent Yao
87e243c596 support query log for async exec 2020-11-27 16:40:07 +08:00
Kent Yao
9bd4139453 Remove Kyuubi useless deps 2020-11-16 20:52:45 +08:00
Kent Yao
91f622f94f Remove Kyuubi 0.8 and before 2020-11-16 20:12:08 +08:00
Kent Yao
7157370ef6 Add Building Doc 2020-11-05 19:05:26 +08:00
Kent Yao
53205a43cc Revert "Revert "fix"" 
This reverts commit 9f4ccdd70c.
 2020-09-23 05:08:26 +08:00
Kent Yao
9f4ccdd70c Revert "fix" 
This reverts commit d97f71456b.
 2020-09-22 18:33:11 +08:00
Kent Yao
f4cef062dc update maven plugins 2020-09-22 14:48:20 +08:00
Kent Yao
d97f71456b fix 2020-09-22 14:15:58 +08:00
Kent Yao
f7a5549f6c refine SparkProcessBuilder 2020-09-11 16:22:39 +08:00
Kent Yao
83d1ab7450 bump up spark to 3.0.1 2020-09-10 10:58:52 +08:00
dependabot[bot]
8e4e136aff
Bump libthrift from 0.9.3 to 0.12.0 (#241) 
Bumps [libthrift](https://github.com/apache/thrift) from 0.9.3 to 0.12.0.
- [Release notes](https://github.com/apache/thrift/releases)
- [Changelog](https://github.com/apache/thrift/blob/master/CHANGES.md)
- [Commits](https://github.com/apache/thrift/compare/0.9.3...v0.12.0)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2020-09-08 14:49:10 +08:00
Kent Yao
06178e52fe KyuubiServer Part 1 2020-09-08 14:45:40 +08:00
Kent Yao
e8ab5ab4a0 Some build staff 2020-08-21 14:39:33 +08:00
Kent Yao
0468fd4d4e Implementaton of KyuubiOperationManager 2020-08-21 10:51:55 +08:00
Kent Yao
86e1a7aac3 SparkProcessBuilder 2020-08-18 17:22:08 +08:00
Kent Yao
3617657bed Add support for operation_log 2020-08-13 10:41:46 +08:00
Kent Yao
7682225145
Add github action for pull request and commit (#240) 
* Add github action for pull request and commit

* fix

* ut
 2020-08-11 10:23:53 +08:00
Kent Yao
eea65272e2 Add Operation for spark engine 2020-07-31 11:09:11 +08:00
Kent Yao
934a9d3158 Support RowSet 2020-07-08 11:38:48 +08:00
Kent Yao
e3e1a8f00b Add OperationState 2020-06-30 15:29:59 +08:00
Kent Yao
1a3e886627 drop module kyuubi-hive-thrift 2020-06-23 17:32:43 +08:00
Kent Yao
c2271ac05b Bumpup Spark to 3.0.0 from 3.0.0-preview2 2020-06-18 17:41:43 +08:00
Kent Yao
7fb0b1a32f Enable EmbeddedZkServer for KyuubiServer 2020-06-17 22:42:19 +08:00
Kent Yao
e1d55f8351 Introduce ServiceDiscovery 2020-06-17 16:14:20 +08:00
Kent Yao
5100d8a519 Support EmbeddedZkServer 2020-06-12 17:18:46 +08:00
Kent Yao
15d179507f Create Kyuubi Project Spark SQL Engine 2020-06-09 10:34:47 +08:00
konradqcharczyk
85689b6b64 Squashed commit of the following: 
commit cd39627e46666c80bcf155fed647d2a84328af99
Merge: aae0cef 9b03db7
Author: konradqcharczyk <konradqcharczyk@gmail.com>
Date:   Sun Jun 7 16:16:00 2020 +0200

    apache mirror and spark version changed

commit aae0cef4347c55a68f74f426b98378b39d0b8bdb
Author: konradqcharczyk <konradqcharczyk@gmail.com>
Date:   Sun Jun 7 14:51:16 2020 +0200

    apache mirror and spark version changed

commit 9b03db77aebb73fe3587478c36c282a750116164
Author: konradqcharczyk <konradqcharczyk@gmail.com>
Date:   Sun Jun 7 14:51:16 2020 +0200

    spark 2.4.3 changes
 2020-06-07 22:30:14 +08:00
Kent Yao
651db99866
HIVE_CLI_SERVICE_PROTOCOL_V11 (#235) 
* HIVE_CLI_SERVICE_PROTOCOL_V11

* pom

* style

* tests

* travis

* code cover
 2020-05-26 16:07:41 +08:00
Kent Yao
b9a50d62ee new scripts for new framework 2020-05-22 19:16:04 +08:00
Kent Yao
17c3c054b7
[KYUUBI-233] Make master branch target apache spark 2.4 #233 (#234) 2020-05-18 11:54:20 +08:00
Kent Yao
191b8171d6
[KYUUBI-216]Make thrift IDL a separate sub module fix #216 (#217) 
* [KYUUBI-216]Make thrift IDL a separate sub module fix #216

* typo
 2019-09-25 11:38:35 +08:00
Kent Yao
5edf961a44
[KYUUBI-204]Apache Kudu Integration Guide fix #204 (#205) 
* [KYUUBI-204]Apache Kudu Integration Guide fix #204

* references
 2019-07-09 16:47:20 +08:00
Kent Yao
e295995959
[KYUUBI-194]Add a server side metrics system (#195) 
* fix #194 add server side metrics system

* add spark session cache size

* add ut

* add ut

* add doc
 2019-06-12 11:12:18 +08:00
Kent Yao
d7f95775de [BUILD]Bump up to v0.7.0-SNAPSHOT 2019-05-10 11:58:22 +08:00
Kent Yao
1f0bc742e4
[KYUUBI-167][FOLLOWUP]populate tokens via spark session cache mgr (#183) 
* Prepare releasing v0.6.0

* fix #KYUUBI-167 populate token via spark session cache mgr

* typo

* fix ut

* code cov
 2019-05-07 10:32:04 +08:00
Kent Yao
13c68b5550
[KYUUBI-167]Handling ApplicationMaster token expiry to support long caching sparkcontext with dynamic executor allocation (#168) 
* [KYUUBI-167]Handling ApplicationMaster token expiry to support long caching sparkcontext with dynamic executor allocation - fix #167

* fix ut

* add ut

* fix ut

* add doc

* fix https://github.com/apache/spark/pull/24120

* logger

* typo

* comment/dist jar

* fix ut

* typo
 2019-03-19 13:51:08 +08:00
Kent Yao
7401ca3c6e
[KYUUBI-135][KYUUBI-142]add support for spark 2.4.0 release (#157) 
* fix #135 spark 2.4.0 support

* fix #142

* import

* add ut

* fix ut

* fix ut

* fix ut

* fix ut
 2019-03-02 01:16:50 +08:00