Commit Graph

99 Commits

Author SHA1 Message Date
Kent Yao
185d60a273
fix #153 hive serde orc file reader has a thread pool for parallel splits gathering which case token issue in kerberized clusters (#155)
* fix #153 hive serde orc file reader has a threadpool for parallel splits gathering which case token issue in kerberized clusters

* ut

*  fix ut
2019-02-28 17:51:14 +08:00
Kent Yao
51e7a5d480
Prepare for developing v0.6.0 (#154) 2019-02-27 13:40:29 +08:00
Kent Yao
ae85c245d2
Prepare releasing v0.5.0 (#152)
* Prepare releasing 0.5.0

* update documentations
2019-02-25 12:33:48 +08:00
Kent Yao
9dd22c7216
Update log4j.xml 2019-02-23 02:10:00 +08:00
Kent Yao
72e664fced
[KYUUBI-116][Experimental] Support long cache spark session in kerberized cluster (#117)
* fixes @116 Support long caching SparkSession/SparkContext for secured hadoop cluster

* handle sub classes of coarse grained scheduler backend

* fix ut for spark 2.2

* updating doc
2019-02-23 01:10:05 +08:00
Kent Yao
a0a21f4eb3 fix ut 2019-02-21 18:46:16 +08:00
Kent Yao
128928b2fc typo 2019-02-21 17:46:19 +08:00
Kent Yao
443ef11fce add more uts 2019-02-21 16:53:29 +08:00
Kent Yao
0495a55f9b ut 2019-02-21 11:15:58 +08:00
Kent Yao
bf309017c9 dectect associate plans in parse phase 2019-02-20 11:56:20 +08:00
Kent Yao
2cfb2ae180 fix resource local path 2019-02-20 11:15:33 +08:00
Kent Yao
2f3c582369 set hdfs to be downloadable 2019-02-20 10:57:18 +08:00
Kent Yao
694e3ef791 localize remote jars to add them into classpath 2019-02-20 10:21:18 +08:00
Kent Yao
05653d91f6 fixes #150 un-recognized class while using add jar & create functions 2019-02-18 15:34:05 +08:00
Kent Yao
df773045cb fix ci 2019-01-25 11:47:20 +08:00
Kent Yao
69276defa3 improve code cov 2019-01-25 11:30:03 +08:00
Kent Yao
bc48b02666 fix #147 User Latest Logout information should be cleaned after backend session is stopped by session cache manager 2019-01-23 16:44:44 +08:00
maxxie
003da4d8dd 修复可能存在并发opensession的时候,realUser 可能会获取另一个session 的user 2019-01-20 23:31:08 +08:00
Kent Yao
4f4480b07e fix ut 2019-01-14 18:37:14 +08:00
Kent Yao
a80d69a655 fix #143 Set active SparkContext in KyuubiOperation 2019-01-14 17:56:18 +08:00
Kent Yao
48655f89d1 typo 2019-01-11 16:38:11 +08:00
Kent Yao
7171f77d7a fix #140 Add a server side configuration to limit the query result size 2019-01-11 15:37:17 +08:00
Kent Yao
d028049b5d asc ii map for fun 2018-12-28 18:17:20 +08:00
Kent Yao
5fe0a34ea4 Preparing v0.5.0 developing 2018-12-21 14:48:05 +08:00
Kent Yao
203f61589e rm unrelated change 2018-12-20 16:03:53 +08:00
Kent Yao
40ac044500 turn off union rdd parallel lising 2018-12-20 15:56:00 +08:00
Kent Yao
4b7f2c5b1e [KYUUBI-133]fix #133 token expiration in HadoopRDD getPartitions 2018-12-13 22:02:39 +08:00
Kent Yao
e960540c32
Merge pull request #131 from yaooqinn/KYUUBI-128
[KYUUBI-128]add ldap authenticate support
2018-12-12 10:42:24 +08:00
Kent Yao
942762b929 minor doc 2018-12-12 10:00:24 +08:00
Kent Yao
672fba544a add ui 2018-12-11 18:10:13 +08:00
Kent Yao
48a15c620e fix ut 2018-12-11 16:44:52 +08:00
Kent Yao
be33573e3f reviewed by dockerzhang 2018-12-11 16:25:42 +08:00
Kent Yao
9556edd9b4 add ut 2018-12-11 15:52:26 +08:00
Kent Yao
2b172a2cba fix #125 hotfix session ugi not wrapping sparkcontext initializing 2018-12-11 11:59:10 +08:00
Kent Yao
a4f5910138 fixes #128 add ldap authenticate support 2018-12-11 10:46:52 +08:00
Kent Yao
df1abd4702
Merge pull request #127 from hustfeiwang/KYUUBI-125
KYUUBI-125 fix the error when create session in SparkSessionWithUGI fix #125
2018-12-06 17:52:28 +08:00
Kent Yao
989068ba24
Merge pull request #123 from yaooqinn/KYUUBI-122
[KYUUBI-122]obtain delegation tokens from possible kerberized services
2018-12-06 14:51:23 +08:00
Kent Yao
0a166e71ae fix ut 2018-12-06 11:02:15 +08:00
hustfeiwang
6de108ee9a KYUUBI-129 kyuubi throws java.lang.UnsupportedOperationException when starting 2018-12-06 10:56:20 +08:00
Kent Yao
cf617ee5a6 fix ut 2018-12-06 10:26:20 +08:00
Kent Yao
5f5f85d6b6 add it 2018-12-05 18:33:54 +08:00
Kent Yao
3779e55e65 hdfs no host 2018-12-05 15:53:10 +08:00
hustfeiwang
1e204ba35d KYUUBI-125 fix code style 2018-11-28 09:45:52 +08:00
hustfeiwang
e60f10b927 KYUUBI-125 fix the error when create session in SparkSessionWithUGI 2018-11-27 19:45:55 +08:00
Kent Yao
bea9ebd0e7 add log 2018-11-16 17:03:58 +08:00
Kent Yao
188bb69147 add creds to current ugi directly 2018-11-16 14:33:02 +08:00
Kent Yao
e5ed088181 use session ugi to collect tokens 2018-11-16 14:02:31 +08:00
Kent Yao
6368cb1ebe fix #122 Obtain tokens for kerberized Hive/HDFS services 2018-11-16 11:30:14 +08:00
Kent Yao
d1d34e5856
Merge pull request #119 from yaooqinn/KYUUBI-118
[KYUUBI-118]fix npe bug with incremental result collection
2018-11-07 17:37:24 +08:00
Kent Yao
5a957ef5d8 ignore SparkEnv code cov 2018-11-07 17:13:39 +08:00