Commit Graph

472 Commits

Author SHA1 Message Date
Kent Yao
46d6dda3f3 Improve spark sql engine test 2020-09-08 21:19:21 +08:00
Kent Yao
3c9d4cc2f1 Improve KyuubiConf test 2020-09-08 18:21:14 +08:00
Kent Yao
790c3d73c0 Improve HA test 2020-09-08 16:32:49 +08:00
Kent Yao
13cf498d4f Improve HA test 2020-09-08 16:20:09 +08:00
dependabot[bot]
8e4e136aff
Bump libthrift from 0.9.3 to 0.12.0 (#241)
Bumps [libthrift](https://github.com/apache/thrift) from 0.9.3 to 0.12.0.
- [Release notes](https://github.com/apache/thrift/releases)
- [Changelog](https://github.com/apache/thrift/blob/master/CHANGES.md)
- [Commits](https://github.com/apache/thrift/compare/0.9.3...v0.12.0)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2020-09-08 14:49:10 +08:00
Kent Yao
06178e52fe KyuubiServer Part 1 2020-09-08 14:45:40 +08:00
Kent Yao
6dc41157c5 disable before_deploy for travis 2020-08-21 16:13:25 +08:00
Kent Yao
fa100b43f3 improve test coverage 2020-08-21 15:34:04 +08:00
Kent Yao
a49660e769 fix 2020-08-21 14:58:35 +08:00
Kent Yao
e8ab5ab4a0 Some build staff 2020-08-21 14:39:33 +08:00
Kent Yao
0468fd4d4e Implementaton of KyuubiOperationManager 2020-08-21 10:51:55 +08:00
Kent Yao
86e1a7aac3 SparkProcessBuilder 2020-08-18 17:22:08 +08:00
Kent Yao
3617657bed Add support for operation_log 2020-08-13 10:41:46 +08:00
Kent Yao
7682225145
Add github action for pull request and commit (#240)
* Add github action for pull request and commit

* fix

* ut
2020-08-11 10:23:53 +08:00
Kent Yao
a3891b3c53 Implementaion of Spark SQL engine 2020-08-10 17:52:10 +08:00
Kent Yao
eea65272e2 Add Operation for spark engine 2020-07-31 11:09:11 +08:00
Kent Yao
4d2ec8a00a Add new FrontendService 2020-07-21 15:26:48 +08:00
Kent Yao
eacaa608e1 Support Spark StructType to TTableSchema 2020-07-08 21:15:12 +08:00
Kent Yao
934a9d3158 Support RowSet 2020-07-08 11:38:48 +08:00
Kent Yao
65f4d17948 Add SessionHandle 2020-07-02 16:57:29 +08:00
Kent Yao
7428ee1f33 Add OperationHandle 2020-07-02 15:56:38 +08:00
Kent Yao
e3e1a8f00b Add OperationState 2020-06-30 15:29:59 +08:00
Kent Yao
1a3e886627 drop module kyuubi-hive-thrift 2020-06-23 17:32:43 +08:00
Kent Yao
829da50ab5 Add fully Retry Policy 2020-06-19 16:51:09 +08:00
Kent Yao
c2271ac05b Bumpup Spark to 3.0.0 from 3.0.0-preview2 2020-06-18 17:41:43 +08:00
Kent Yao
7fb0b1a32f Enable EmbeddedZkServer for KyuubiServer 2020-06-17 22:42:19 +08:00
Kent Yao
e1d55f8351 Introduce ServiceDiscovery 2020-06-17 16:14:20 +08:00
Kent Yao
5100d8a519 Support EmbeddedZkServer 2020-06-12 17:18:46 +08:00
Kent Yao
15d179507f Create Kyuubi Project Spark SQL Engine 2020-06-09 10:34:47 +08:00
konradqcharczyk
85689b6b64 Squashed commit of the following:
commit cd39627e46666c80bcf155fed647d2a84328af99
Merge: aae0cef 9b03db7
Author: konradqcharczyk <konradqcharczyk@gmail.com>
Date:   Sun Jun 7 16:16:00 2020 +0200

    apache mirror and spark version changed

commit aae0cef4347c55a68f74f426b98378b39d0b8bdb
Author: konradqcharczyk <konradqcharczyk@gmail.com>
Date:   Sun Jun 7 14:51:16 2020 +0200

    apache mirror and spark version changed

commit 9b03db77aebb73fe3587478c36c282a750116164
Author: konradqcharczyk <konradqcharczyk@gmail.com>
Date:   Sun Jun 7 14:51:16 2020 +0200

    spark 2.4.3 changes
2020-06-07 22:30:14 +08:00
Kent Yao
651db99866
HIVE_CLI_SERVICE_PROTOCOL_V11 (#235)
* HIVE_CLI_SERVICE_PROTOCOL_V11

* pom

* style

* tests

* travis

* code cover
2020-05-26 16:07:41 +08:00
Kent Yao
b9a50d62ee new scripts for new framework 2020-05-22 19:16:04 +08:00
Kent Yao
7d389c44b2 Merge branch 'master' of https://github.com/yaooqinn/kyuubi 2020-05-19 14:13:33 +08:00
Kent Yao
17c3c054b7
[KYUUBI-233] Make master branch target apache spark 2.4 #233 (#234) 2020-05-18 11:54:20 +08:00
Kent Yao
30ab05a4d0 Merge pull request #232 from yaooqinn/dependabot/maven/kyuubi-thrift/org.apache.thrift-libthrift-0.12.0
Bump libthrift from 0.9.3 to 0.12.0 in /kyuubi-thrift

Signed-off-by: Kent Yao <yaooqinn@hotmail.com>
2020-05-18 11:48:52 +08:00
Kent Yao
d16d5b335c
Merge pull request #232 from yaooqinn/dependabot/maven/kyuubi-thrift/org.apache.thrift-libthrift-0.12.0
Bump libthrift from 0.9.3 to 0.12.0 in /kyuubi-thrift
2020-05-18 11:35:39 +08:00
dependabot[bot]
266c883daf
Bump libthrift from 0.9.3 to 0.12.0 in /kyuubi-thrift
Bumps [libthrift](https://github.com/apache/thrift) from 0.9.3 to 0.12.0.
- [Release notes](https://github.com/apache/thrift/releases)
- [Changelog](https://github.com/apache/thrift/blob/master/CHANGES.md)
- [Commits](https://github.com/apache/thrift/compare/0.9.3...v0.12.0)

Signed-off-by: dependabot[bot] <support@github.com>
2020-05-18 02:42:23 +00:00
Kent Yao
af9801beb8
[KYUUBI-230] Re-implement OperationLog (#231) 2020-05-18 10:42:00 +08:00
QianChao
d227e616b2 [KYUUBI-221] Optimise FetchResults speed when maxRows is large fix #221
Squashed commit of the following:

commit f103b8d5dcbdb838b9dc1d46faec8e93c10af865
Author: QianChao <chaoqian@advance.ai>
Date:   Fri Oct 25 10:14:30 2019 +0800

    UPD: add more test cases for ColumnBaseSet

commit eabd5d4341a0ceabce9f68e20fe173415ecae981
Author: QianChao <chaoqian@advance.ai>
Date:   Thu Oct 17 15:16:40 2019 +0800

    FIX: ColumnBaseSet nulls with stream issue

commit 14c04820db2c6a22413e4b775ca71bae55d51aaf
Author: QianChao <chaoqian@advance.ai>
Date:   Wed Oct 16 15:04:22 2019 +0800

    FIX: stream access issue
2019-10-25 11:34:29 +08:00
Kent Yao
c6ef20089e
[KYUUBI-219]Fix NPE in HiveTokenCollector (#220) 2019-10-23 16:02:23 +08:00
Kent Yao
191b8171d6
[KYUUBI-216]Make thrift IDL a separate sub module fix #216 (#217)
* [KYUUBI-216]Make thrift IDL a separate sub module fix #216

* typo
2019-09-25 11:38:35 +08:00
Kent Yao
947394350f
[KYUUBI-213] Check and wait the old spark context completely stopped before create a new one (#214)
* [KYUUBI-213] Check and wait the old spark context completely stopped before create a new one #213

* stop to not stop
2019-08-26 15:04:04 +08:00
Kent Yao
6621d361af
add user info and statement id in executing log (#212)
* add user info and statement id in executing log

* add ut

* update conf

* long max

* modify log

* modify log

* unpersit

* typo

* add ut

* fix ut

* typo

* code cov

* add log

* ex order

* rm some ex

* none get

* Revert "none get"

This reverts commit 6792e33db11619ec4fa7c075706da1500fb229e3.

* rm debug
2019-08-16 16:51:12 +08:00
Kent Yao
552bb100c1
[KYUUBI-208] add delegation tokens to hive session state's dfs client (#209)
* [KYUUBI-208] add delegation tokens to hive session state's dfs client

* add ut

* handle exception

* should wrap in do as

fix #208
2019-07-25 10:39:45 +08:00
Kent Yao
7729ff0ba5
[KYUUBI-206] Initialize external catalog ahead during open session for a user fix #206 (#207)
* [KYUUBI-206] Initialize external catalog ahead during open session for a user fix #206

* code cov

* code cov
2019-07-15 11:42:12 +08:00
Kent Yao
5edf961a44
[KYUUBI-204]Apache Kudu Integration Guide fix #204 (#205)
* [KYUUBI-204]Apache Kudu Integration Guide fix #204

* references
2019-07-09 16:47:20 +08:00
Kent Yao
abc58c4ee3
[KYUUBI-201]Add some user friendly spark configurations (#202)
fix #201
2019-06-25 18:40:03 +08:00
Kent Yao
f4c08c6f52
[KUUBI-198][FOLLOWUP]Fix SparkSessionCache unit test occasionally fails (#200)
* fix travis occasionally fails

* ad ut
2019-06-20 21:46:55 +08:00
Kent Yao
b6591d3314
[KYUUBI-198] Failover mode ha service disconnects from zk after lost leader ship (#199)
* fxi #198 Failover mode ha service disconnects from zk after losts leader ship

* reset leader latch

* add ut

* add some ut back
2019-06-20 17:56:22 +08:00
Kent Yao
26663c5d8b
[KYUUBI][FOLLOWUP]fix travis 2019-06-17 12:37:15 +08:00