Commit Graph

407 Commits

Author SHA1 Message Date
Kent Yao
13c68b5550
[KYUUBI-167]Handling ApplicationMaster token expiry to support long caching sparkcontext with dynamic executor allocation (#168)
* [KYUUBI-167]Handling ApplicationMaster token expiry to support long caching sparkcontext with dynamic executor allocation - fix #167

* fix ut

* add ut

* fix ut

* add doc

* fix https://github.com/apache/spark/pull/24120

* logger

* typo

* comment/dist jar

* fix ut

* typo
2019-03-19 13:51:08 +08:00
Kent Yao
56fa56a880
[KYUUBI-164]display root casue of statement failure on client size (#165)
* [KYUUBI-164]display root casue of statement failure on client size

* fix ut

* fix ut
2019-03-12 17:05:50 +08:00
Kent Yao
0ab29e5d64
[KYUUBI-162]use login user to impersonation fix #162 (#163) 2019-03-11 15:35:27 +08:00
Kent Yao
70c5c6d97a
[KYUUBI-160]create spark context thread-safely (#161)
* fix #160 create spark context thread-safely

* using object wait
2019-03-06 23:13:19 +08:00
Kent Yao
7631ac3a8b
fix#158 do not delete session resouces dir in close session (#159) 2019-03-05 20:14:13 +08:00
Kent Yao
7401ca3c6e
[KYUUBI-135][KYUUBI-142]add support for spark 2.4.0 release (#157)
* fix #135 spark 2.4.0 support

* fix #142

* import

* add ut

* fix ut

* fix ut

* fix ut

* fix ut
2019-03-02 01:16:50 +08:00
Kent Yao
185d60a273
fix #153 hive serde orc file reader has a thread pool for parallel splits gathering which case token issue in kerberized clusters (#155)
* fix #153 hive serde orc file reader has a threadpool for parallel splits gathering which case token issue in kerberized clusters

* ut

*  fix ut
2019-02-28 17:51:14 +08:00
Kent Yao
51e7a5d480
Prepare for developing v0.6.0 (#154) 2019-02-27 13:40:29 +08:00
Kent Yao
ae85c245d2
Prepare releasing v0.5.0 (#152)
* Prepare releasing 0.5.0

* update documentations
2019-02-25 12:33:48 +08:00
Kent Yao
9dd22c7216
Update log4j.xml 2019-02-23 02:10:00 +08:00
Kent Yao
72e664fced
[KYUUBI-116][Experimental] Support long cache spark session in kerberized cluster (#117)
* fixes @116 Support long caching SparkSession/SparkContext for secured hadoop cluster

* handle sub classes of coarse grained scheduler backend

* fix ut for spark 2.2

* updating doc
2019-02-23 01:10:05 +08:00
Kent Yao
6352c6aeb3
Merge pull request #151 from yaooqinn/KYUUBI-150
[KYUUBI-150]Localize remote jars to support add jar and create function cmd
2019-02-21 22:03:12 +08:00
Kent Yao
a0a21f4eb3 fix ut 2019-02-21 18:46:16 +08:00
Kent Yao
128928b2fc typo 2019-02-21 17:46:19 +08:00
Kent Yao
443ef11fce add more uts 2019-02-21 16:53:29 +08:00
Kent Yao
0495a55f9b ut 2019-02-21 11:15:58 +08:00
Kent Yao
bf309017c9 dectect associate plans in parse phase 2019-02-20 11:56:20 +08:00
Kent Yao
2cfb2ae180 fix resource local path 2019-02-20 11:15:33 +08:00
Kent Yao
2f3c582369 set hdfs to be downloadable 2019-02-20 10:57:18 +08:00
Kent Yao
694e3ef791 localize remote jars to add them into classpath 2019-02-20 10:21:18 +08:00
Kent Yao
05653d91f6 fixes #150 un-recognized class while using add jar & create functions 2019-02-18 15:34:05 +08:00
Kent Yao
9c606c1c67
Merge pull request #148 from yaooqinn/KYUUBI-147
User Latest Logout information should be cleaned after backend session is stopped by session cache manager
2019-01-25 12:37:33 +08:00
Kent Yao
df773045cb fix ci 2019-01-25 11:47:20 +08:00
Kent Yao
69276defa3 improve code cov 2019-01-25 11:30:03 +08:00
Kent Yao
bc48b02666 fix #147 User Latest Logout information should be cleaned after backend session is stopped by session cache manager 2019-01-23 16:44:44 +08:00
Kent Yao
8979fc5e73
Merge pull request #146 from Neilxzn/master
修复可能存在并发opensession的时候,realUser 可能会获取另一个session 的user
2019-01-21 11:07:15 +08:00
maxxie
003da4d8dd 修复可能存在并发opensession的时候,realUser 可能会获取另一个session 的user 2019-01-20 23:31:08 +08:00
Kent Yao
293265e56e
Merge pull request #144 from yaooqinn/KYUUBI-143
[KYUUBI-143] Set active SparkContext in KyuubiOperation
2019-01-15 09:55:28 +08:00
Kent Yao
4f4480b07e fix ut 2019-01-14 18:37:14 +08:00
Kent Yao
a80d69a655 fix #143 Set active SparkContext in KyuubiOperation 2019-01-14 17:56:18 +08:00
Kent Yao
b3ab6be6e1
Merge pull request #141 from yaooqinn/KYUUBI-140
[KYUUBI-140]Add a server side configuration to limit the query result size
2019-01-11 17:46:51 +08:00
Kent Yao
48655f89d1 typo 2019-01-11 16:38:11 +08:00
Kent Yao
7171f77d7a fix #140 Add a server side configuration to limit the query result size 2019-01-11 15:37:17 +08:00
Kent Yao
37625fd4dc
Merge pull request #136 from yaooqinn/asciifun
ascii map for fun
2018-12-29 14:15:05 +08:00
Kent Yao
07a744d486 add logofor kyuubi 2018-12-29 11:38:30 +08:00
Kent Yao
d028049b5d asc ii map for fun 2018-12-28 18:17:20 +08:00
Kent Yao
5fe0a34ea4 Preparing v0.5.0 developing 2018-12-21 14:48:05 +08:00
Kent Yao
6fbc4b4225
Merge pull request #134 from yaooqinn/KYUUBI-133
[KYUUBI-133]fix #133 token expiration in HadoopRDD getPartitions
2018-12-20 19:07:45 +08:00
Kent Yao
203f61589e rm unrelated change 2018-12-20 16:03:53 +08:00
Kent Yao
40ac044500 turn off union rdd parallel lising 2018-12-20 15:56:00 +08:00
Kent Yao
4b7f2c5b1e [KYUUBI-133]fix #133 token expiration in HadoopRDD getPartitions 2018-12-13 22:02:39 +08:00
Kent Yao
e960540c32
Merge pull request #131 from yaooqinn/KYUUBI-128
[KYUUBI-128]add ldap authenticate support
2018-12-12 10:42:24 +08:00
Kent Yao
942762b929 minor doc 2018-12-12 10:00:24 +08:00
Kent Yao
672fba544a add ui 2018-12-11 18:10:13 +08:00
Kent Yao
6886529822
Merge pull request #132 from yaooqinn/KYUUBI-125
[KYUUBI-125][FOLLOWUP]session ugi is not wrapping sparkcontext initializing
2018-12-11 17:47:06 +08:00
Kent Yao
48a15c620e fix ut 2018-12-11 16:44:52 +08:00
Kent Yao
be33573e3f reviewed by dockerzhang 2018-12-11 16:25:42 +08:00
Kent Yao
9556edd9b4 add ut 2018-12-11 15:52:26 +08:00
Kent Yao
2b172a2cba fix #125 hotfix session ugi not wrapping sparkcontext initializing 2018-12-11 11:59:10 +08:00
Kent Yao
a4f5910138 fixes #128 add ldap authenticate support 2018-12-11 10:46:52 +08:00