Commit Graph

163 Commits

Author SHA1 Message Date
Kent Yao
e59a751b04 PlainSASLServerSuite 2020-10-26 14:21:49 +08:00
Kent Yao
50f2d85954 LdapAuthenticationProviderImplSuite 2020-10-23 17:59:13 +08:00
Kent Yao
7eb84b1800 add more tests 2020-10-23 17:31:04 +08:00
Kent Yao
76a7d55685 add ServiceUtilsSuite 2020-10-23 10:34:44 +08:00
Kent Yao
1f52dbd656 FrontendServiceSuite nit 2020-10-22 18:48:31 +08:00
Kent Yao
64cfb8cd95 FrontendServiceSuite get catalogs 2020-10-22 10:34:30 +08:00
Kent Yao
69b2d55d24 Thread Suites 2020-10-19 11:03:25 +08:00
Kent Yao
0b07dfd6dd improve test cov 2020-10-14 11:33:56 +08:00
Kent Yao
164a984b97 rm useless test compile version info 2020-09-25 19:33:02 +08:00
Kent Yao
53205a43cc Revert "Revert "fix""
This reverts commit 9f4ccdd70c.
2020-09-23 05:08:26 +08:00
Kent Yao
9f4ccdd70c Revert "fix"
This reverts commit d97f71456b.
2020-09-22 18:33:11 +08:00
Kent Yao
d97f71456b fix 2020-09-22 14:15:58 +08:00
Kent Yao
eb2a7050d9 build info 2020-09-21 21:26:16 +08:00
Kent Yao
e22dda7dbd Add more build infomation 2020-09-11 09:55:11 +08:00
Kent Yao
83d1ab7450 bump up spark to 3.0.1 2020-09-10 10:58:52 +08:00
Kent Yao
0468fd4d4e Implementaton of KyuubiOperationManager 2020-08-21 10:51:55 +08:00
Kent Yao
86e1a7aac3 SparkProcessBuilder 2020-08-18 17:22:08 +08:00
Kent Yao
3617657bed Add support for operation_log 2020-08-13 10:41:46 +08:00
Kent Yao
7682225145
Add github action for pull request and commit (#240)
* Add github action for pull request and commit

* fix

* ut
2020-08-11 10:23:53 +08:00
Kent Yao
a3891b3c53 Implementaion of Spark SQL engine 2020-08-10 17:52:10 +08:00
Kent Yao
eea65272e2 Add Operation for spark engine 2020-07-31 11:09:11 +08:00
Kent Yao
4d2ec8a00a Add new FrontendService 2020-07-21 15:26:48 +08:00
Kent Yao
934a9d3158 Support RowSet 2020-07-08 11:38:48 +08:00
Kent Yao
e3e1a8f00b Add OperationState 2020-06-30 15:29:59 +08:00
Kent Yao
1a3e886627 drop module kyuubi-hive-thrift 2020-06-23 17:32:43 +08:00
Kent Yao
c2271ac05b Bumpup Spark to 3.0.0 from 3.0.0-preview2 2020-06-18 17:41:43 +08:00
Kent Yao
e1d55f8351 Introduce ServiceDiscovery 2020-06-17 16:14:20 +08:00
Kent Yao
5100d8a519 Support EmbeddedZkServer 2020-06-12 17:18:46 +08:00
Kent Yao
15d179507f Create Kyuubi Project Spark SQL Engine 2020-06-09 10:34:47 +08:00
konradqcharczyk
85689b6b64 Squashed commit of the following:
commit cd39627e46666c80bcf155fed647d2a84328af99
Merge: aae0cef 9b03db7
Author: konradqcharczyk <konradqcharczyk@gmail.com>
Date:   Sun Jun 7 16:16:00 2020 +0200

    apache mirror and spark version changed

commit aae0cef4347c55a68f74f426b98378b39d0b8bdb
Author: konradqcharczyk <konradqcharczyk@gmail.com>
Date:   Sun Jun 7 14:51:16 2020 +0200

    apache mirror and spark version changed

commit 9b03db77aebb73fe3587478c36c282a750116164
Author: konradqcharczyk <konradqcharczyk@gmail.com>
Date:   Sun Jun 7 14:51:16 2020 +0200

    spark 2.4.3 changes
2020-06-07 22:30:14 +08:00
Kent Yao
651db99866
HIVE_CLI_SERVICE_PROTOCOL_V11 (#235)
* HIVE_CLI_SERVICE_PROTOCOL_V11

* pom

* style

* tests

* travis

* code cover
2020-05-26 16:07:41 +08:00
Kent Yao
b9a50d62ee new scripts for new framework 2020-05-22 19:16:04 +08:00
Kent Yao
17c3c054b7
[KYUUBI-233] Make master branch target apache spark 2.4 #233 (#234) 2020-05-18 11:54:20 +08:00
Kent Yao
af9801beb8
[KYUUBI-230] Re-implement OperationLog (#231) 2020-05-18 10:42:00 +08:00
QianChao
d227e616b2 [KYUUBI-221] Optimise FetchResults speed when maxRows is large fix #221
Squashed commit of the following:

commit f103b8d5dcbdb838b9dc1d46faec8e93c10af865
Author: QianChao <chaoqian@advance.ai>
Date:   Fri Oct 25 10:14:30 2019 +0800

    UPD: add more test cases for ColumnBaseSet

commit eabd5d4341a0ceabce9f68e20fe173415ecae981
Author: QianChao <chaoqian@advance.ai>
Date:   Thu Oct 17 15:16:40 2019 +0800

    FIX: ColumnBaseSet nulls with stream issue

commit 14c04820db2c6a22413e4b775ca71bae55d51aaf
Author: QianChao <chaoqian@advance.ai>
Date:   Wed Oct 16 15:04:22 2019 +0800

    FIX: stream access issue
2019-10-25 11:34:29 +08:00
Kent Yao
c6ef20089e
[KYUUBI-219]Fix NPE in HiveTokenCollector (#220) 2019-10-23 16:02:23 +08:00
Kent Yao
191b8171d6
[KYUUBI-216]Make thrift IDL a separate sub module fix #216 (#217)
* [KYUUBI-216]Make thrift IDL a separate sub module fix #216

* typo
2019-09-25 11:38:35 +08:00
Kent Yao
947394350f
[KYUUBI-213] Check and wait the old spark context completely stopped before create a new one (#214)
* [KYUUBI-213] Check and wait the old spark context completely stopped before create a new one #213

* stop to not stop
2019-08-26 15:04:04 +08:00
Kent Yao
6621d361af
add user info and statement id in executing log (#212)
* add user info and statement id in executing log

* add ut

* update conf

* long max

* modify log

* modify log

* unpersit

* typo

* add ut

* fix ut

* typo

* code cov

* add log

* ex order

* rm some ex

* none get

* Revert "none get"

This reverts commit 6792e33db11619ec4fa7c075706da1500fb229e3.

* rm debug
2019-08-16 16:51:12 +08:00
Kent Yao
552bb100c1
[KYUUBI-208] add delegation tokens to hive session state's dfs client (#209)
* [KYUUBI-208] add delegation tokens to hive session state's dfs client

* add ut

* handle exception

* should wrap in do as

fix #208
2019-07-25 10:39:45 +08:00
Kent Yao
7729ff0ba5
[KYUUBI-206] Initialize external catalog ahead during open session for a user fix #206 (#207)
* [KYUUBI-206] Initialize external catalog ahead during open session for a user fix #206

* code cov

* code cov
2019-07-15 11:42:12 +08:00
Kent Yao
5edf961a44
[KYUUBI-204]Apache Kudu Integration Guide fix #204 (#205)
* [KYUUBI-204]Apache Kudu Integration Guide fix #204

* references
2019-07-09 16:47:20 +08:00
Kent Yao
abc58c4ee3
[KYUUBI-201]Add some user friendly spark configurations (#202)
fix #201
2019-06-25 18:40:03 +08:00
Kent Yao
f4c08c6f52
[KUUBI-198][FOLLOWUP]Fix SparkSessionCache unit test occasionally fails (#200)
* fix travis occasionally fails

* ad ut
2019-06-20 21:46:55 +08:00
Kent Yao
b6591d3314
[KYUUBI-198] Failover mode ha service disconnects from zk after lost leader ship (#199)
* fxi #198 Failover mode ha service disconnects from zk after losts leader ship

* reset leader latch

* add ut

* add some ut back
2019-06-20 17:56:22 +08:00
Kent Yao
63245dd691
[KYUUBI-196]Refactoring SparkSessionWithUGI‘s get and create SparkContext logic (#197)
* fxit 194 Refactoring SparkSessionWithUGI‘s get and create sc logic

* upgrade scala-maven-plugin to 3.4.6

* fix travis

* fix travis again

* fix travis open jdk8

* fix travis open jdk8

* fix travis open jdk8

* fix travis open jdk8

* fix travis open jdk8

* add state to get yarn applications

* promise complete

* fix #69 capture spark exceptions

* typo

* fix #196 add ut and log

* typo

* typo

* add ut
2019-06-17 11:47:13 +08:00
Kent Yao
e295995959
[KYUUBI-194]Add a server side metrics system (#195)
* fix #194 add server side metrics system

* add spark session cache size

* add ut

* add ut

* add doc
2019-06-12 11:12:18 +08:00
Kent Yao
f8a4775365
[KYUUBI-180]add a sync execute statement operation (#192)
* fix #180 add sync execute statement operation

* fix ut
2019-06-04 18:51:07 +08:00
Kent Yao
cf4ee6afb6
[KYUUBI-156][KYUUBI-185] Implementing all meta operations support by spark (#191)
* [KYUUBI-156][KYUUBI-185] Implementing all meta operations support by spark

* rm used metastore client fix #156 fix #185

* add more uts

* add more uts

* fix bugs and add show functions

* meta operation method abstraction

* readme
2019-06-04 13:19:23 +08:00
Kent Yao
71eea2ba1f
[KYUUBI-189]Add an OOM Hook to shutdown server when OutOfMemoryError occurs (#190)
fix #189 

* [KYUUBI-189]Add an OOM Hook to shutdown server when OutOfMemoryError occurs

* add ut

* fit ut

* fit ut

* typo
2019-05-25 16:42:13 +08:00