Kent Yao
9ca23bcf20
Support ansynchronous exec for Spark SQL engine
2020-11-20 19:52:57 +08:00
Zen
6637c58273
followup [add SparkSQLEngine idle check] fix #251
...
Squashed commit of the following:
commit 808ccb738f8774e465d12dfb04a6d37256545e78
Author: Zen <xinjingziranchan@gmail.com>
Date: Wed Nov 18 14:18:46 2020 +0800
Fixed duplicate issues with the Jars directory when packaging Kyuubi
commit 91ca0a0f8a5a260b1ae29a31c323f69d37a14bfe
Author: zen <xinjingziranchan@gmail.com>
Date: Wed Nov 18 14:01:56 2020 +0800
fix log print and SparkSQLEngine timeoutChecker concurrent issue.
commit 15343d9cd07b48d3909c1085836687a4cc7f05c3
Author: zen <xinjingziranchan@gmail.com>
Date: Tue Nov 17 21:21:03 2020 +0800
消除打印dehug日志时，重复判断是否开启debug模式
commit eecc0bf01144b3f2601e6a821bedf786e5aafb22
Author: zen <xinjingziranchan@gmail.com>
Date: Tue Nov 17 15:08:13 2020 +0800
Revert "修复打包时kyuubi依赖jars目录重复，导致启动时找不到org.apache.kyuubi.server.KyuubiServer启动类"
This reverts commit 29e9dd45
commit 29e9dd45e90b1549b68e96024b1ee866429bf40d
Author: zen <xinjingziranchan@gmail.com>
Date: Tue Nov 17 14:36:23 2020 +0800
修复打包时kyuubi依赖jars目录重复，导致启动时找不到org.apache.kyuubi.server.KyuubiServer启动类
commit 44364ecd289ca40181bd150998cce76762b145be
Author: zen <xinjingziranchan@gmail.com>
Date: Tue Nov 17 13:48:21 2020 +0800
修复SparkSQLEngine停止时没有关闭timeoutChecker线程池，以及增加timeoutChecker打印日志
commit 63a67e2c487a5418a056ff4f797b46185ed4c17b
Merge: 6028f55 64b83a4fb4bace7bfc470#1 from yaooqinn/master
同步更新
2020-11-18 16:41:43 +08:00
zen
7fd225b098
add SparkSQLEngine idle check
...
fix #250
Squashed commit of the following:
commit 6028f55504cbc3d522bf061fde71608019243d3e
Author: 金晶(000538) <jinjing@fcbox.com>
Date: Mon Nov 16 16:26:09 2020 +0800
测试代码SparkOperationSuite格式调整
commit 0b14c69183691e3601aef3a9d56c545edef44499
Author: 金晶(000538) <jinjing@fcbox.com>
Date: Mon Nov 16 14:49:42 2020 +0800
1.新增SparkSQLEngine空闲定时检测任务
2.修复SparkSQLEngine关闭session时未移除SparkSQLOperationManager中缓存的sparkSession
commit 8fdb6b7cec70f32dc05bfeeedcc233d0f6fb4017
Merge: fb4bace7bfc470#1 from yaooqinn/master
同步更新
2020-11-16 19:28:33 +08:00
Kent Yao
b3d996917d
fix static and core conf via hiveconf or hivevar
2020-11-13 16:08:47 +08:00
Kent Yao
fb4bace6a5
Ignore static and other unmodifiable settting in session
2020-11-11 11:15:09 +08:00
Kent Yao
574c119712
JDBCTests added and some related bugs fixed
2020-11-10 21:24:02 +08:00
Kent Yao
a67d485951
Missing version in readMessageBegin, old client
...
2020-11-10 10:15:42,001 [61208289] - ERROR [FrontendServiceHandler-Pool: Thread-449:TThreadPoolServer$WorkerProcess@315] - Thrift error occurred during processing of message.
org.apache.thrift.protocol.TProtocolException: Missing version in readMessageBegin, old client?
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:234)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:27)
at org.apache.kyuubi.service.authentication.TSetIpAddressProcessor.process(TSetIpAddressProcessor.scala:36)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:310)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2020-11-10 17:21:17 +08:00
Kent Yao
f8dc5a9ca3
Using ha.zookeeper.acl.enabled to control ZK acl
2020-11-09 17:34:55 +08:00
Kent Yao
7157370ef6
Add Building Doc
2020-11-05 19:05:26 +08:00
Kent Yao
642b52e965
nit
2020-10-30 16:04:20 +08:00
Kent Yao
6efa589a74
FrontendServiceSuite
2020-10-21 20:22:42 +08:00
Kent Yao
53b3fdb616
OperationStatus
2020-10-21 16:06:38 +08:00
Kent Yao
0849678453
Hive JDBC Database MetaData API Auditing
2020-10-20 18:08:28 +08:00
Kent Yao
6ad06f66e9
UtilsSuite
2020-10-16 15:21:35 +08:00
Kent Yao
e7a1054fd2
fix work dir bug
2020-10-14 14:59:49 +08:00
Kent Yao
5d1ea8547a
Make SparkSQLEngine be able to self teminate
2020-10-13 20:49:54 +08:00
Kent Yao
396e06a3bb
nit
2020-09-29 10:11:34 +08:00
Kent Yao
f60a6d37a7
log time cost for operation
2020-09-24 16:47:22 +08:00
Kent Yao
ff7a1221e0
handle client ip properly
2020-09-24 11:59:55 +08:00
Kent Yao
f8b8c6c172
Print spark engine dignosis at client side
2020-09-23 17:41:51 +08:00
Kent Yao
c673235a42
finish cancel operation test
2020-09-22 18:00:58 +08:00
Kent Yao
efa78a92f1
improve get schemas test
2020-09-22 17:43:41 +08:00
Kent Yao
470d7ca90d
Make man service work
2020-09-21 14:05:34 +08:00
Kent Yao
07204dbef5
add test for close and cancel operation
2020-09-15 14:36:02 +08:00
Kent Yao
d8a27c914f
spark-sql-engine: enable session configuration
2020-09-14 18:05:08 +08:00
Kent Yao
07c9d9578d
style
2020-09-14 10:59:47 +08:00
Kent Yao
31cbee72ef
add some test for execute statement operation
2020-09-11 19:28:38 +08:00
Kent Yao
f7a5549f6c
refine SparkProcessBuilder
2020-09-11 16:22:39 +08:00
Kent Yao
bd536cd9c5
Remove KyuubiThriftBinaryCliService
2020-09-10 21:05:21 +08:00
Kent Yao
4ee3577944
improve test for operation log
2020-09-10 18:22:48 +08:00
Kent Yao
13706c3c3a
improve test for operation log
2020-09-10 16:59:57 +08:00
Kent Yao
ee315c6963
fix test
2020-09-10 14:09:36 +08:00
Kent Yao
59b7c3a09e
add more tests
2020-09-10 12:01:58 +08:00
Kent Yao
83d1ab7450
bump up spark to 3.0.1
2020-09-10 10:58:52 +08:00
Kent Yao
01d50d3ec7
add tests for meta operations
2020-09-09 16:15:45 +08:00
Kent Yao
42e92e41b6
add test for get null column
2020-09-09 11:25:18 +08:00
Kent Yao
0a43b82400
fix GetColumns
2020-09-09 10:06:15 +08:00
Kent Yao
46d6dda3f3
Improve spark sql engine test
2020-09-08 21:19:21 +08:00
Kent Yao
06178e52fe
KyuubiServer Part 1
2020-09-08 14:45:40 +08:00
Kent Yao
e8ab5ab4a0
Some build staff
2020-08-21 14:39:33 +08:00
Kent Yao
0468fd4d4e
Implementaton of KyuubiOperationManager
2020-08-21 10:51:55 +08:00
Kent Yao
86e1a7aac3
SparkProcessBuilder
2020-08-18 17:22:08 +08:00
