Commit Graph

657 Commits

Author SHA1 Message Date
Cheng Pan
57ec15d09e
[MINOR] fix typo
fixes #277

Squashed commit of the following:

commit 291cb2c9baaf4072689231a9534c41a5eafd9a7e
Author: Cheng Pan <379377944@qq.com>
Date:   Tue Jan 12 23:42:47 2021 +0800

    update doc

commit 9f706c49f6c59d67c64d93c197cc963217636444
Author: Cheng Pan <379377944@qq.com>
Date:   Tue Jan 12 22:04:30 2021 +0800

    [MINOR] fix typo
2021-01-13 11:25:19 +08:00
Kent Yao
1903c03d71
readme 2021-01-12 21:38:28 +08:00
Kent Yao
09bd2bd174
Handle InvocationTargetException and UndeclaredThrowableException in KSE (#274)
* Handle InvocationTargetException and UndeclaredThrowableException

* nit
2021-01-10 02:21:45 +08:00
Cheng Pan
24b8b22e33
exclude hbase-* from hive-jdbc
fixes #275
Squashed commit of the following:

commit 6429ef117150087e8232ea73eb5b4a3668a1f017
Author: Cheng Pan <379377944@qq.com>
Date:   Sun Jan 10 00:53:41 2021 +0800

    exclude hbase-* from hive-jdbc
2021-01-10 01:21:41 +08:00
Kent Yao
61a2da4943
Merge pull request #272 from yaooqinn/dependabot/maven/org.apache.zookeeper-zookeeper-3.4.14
Bump zookeeper from 3.4.6 to 3.4.14
2021-01-10 00:23:17 +08:00
dependabot[bot]
4d1d3a49f8
Bump libthrift from 0.9.3 to 0.12.0
fixes #273

Squashed commit of the following:

commit b6a8d787ede228246af7b9d142f2edbd08e07eac
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date:   Sat Jan 9 15:34:57 2021 +0000

    Bump libthrift from 0.9.3 to 0.12.0

    Bumps [libthrift](https://github.com/apache/thrift) from 0.9.3 to 0.12.0.
    - [Release notes](https://github.com/apache/thrift/releases)
    - [Changelog](https://github.com/apache/thrift/blob/master/CHANGES.md)
    - [Commits](https://github.com/apache/thrift/compare/0.9.3...v0.12.0)

    Signed-off-by: dependabot[bot] <support@github.com>
2021-01-10 00:15:08 +08:00
dependabot[bot]
da2b22eedb
Bump zookeeper from 3.4.6 to 3.4.14
Bumps zookeeper from 3.4.6 to 3.4.14.

Signed-off-by: dependabot[bot] <support@github.com>
2021-01-09 15:34:54 +00:00
Cheng Pan
0eeb99774f
Tune pom
fixes #271
Squashed commit of the following:

commit fe0f469b2068865398d6e5be1957fdf6c6f5eb87
Author: Cheng Pan <379377944@qq.com>
Date:   Sat Jan 9 22:28:43 2021 +0800

    followup

commit 527e32419ecb2ae584d1251cb345e3fc870965a9
Author: Cheng Pan <379377944@qq.com>
Date:   Sat Jan 9 22:21:29 2021 +0800

    revert some stuffs

commit 82f188972b8491c5d381ba076a53f84a2fbc1898
Author: Cheng Pan <379377944@qq.com>
Date:   Sat Jan 9 16:49:14 2021 +0800

    remove unused dependencies

commit c7eb27228d2749ab9100102467e94d3a6a98cf44
Author: Cheng Pan <379377944@qq.com>
Date:   Sat Jan 9 15:41:59 2021 +0800

    minimize dependencies in kyuubi-spark-sql-engine

commit da902b1b1e02c7e93810ca832f6c9e7109cf95b9
Author: Cheng Pan <379377944@qq.com>
Date:   Sat Jan 9 13:26:34 2021 +0800

    exclude hive dependencies

commit 55ae7f025a5ffcec402919e28b7b3af5987dfe16
Author: Cheng Pan <379377944@qq.com>
Date:   Sat Jan 9 01:08:09 2021 +0800

    pin versions and excludes in <dependencyManagement>

commit 9ef84a5f62afd66fb4b817d593ba1b13ff8348ed
Author: Cheng Pan <379377944@qq.com>
Date:   Sat Jan 9 14:12:04 2021 +0800

    trigger kyuubi-spark-sql-engine package

commit d492e3fdce64e6554fe0db1d810c6f4bea198baa
Author: Cheng Pan <379377944@qq.com>
Date:   Sat Jan 9 13:44:13 2021 +0800

    trigger kyuubi-download

commit 050281b8fc400f3ae5fa1d43d56da49846664ea4
Author: Cheng Pan <379377944@qq.com>
Date:   Sat Jan 9 15:30:58 2021 +0800

    pin modules version in dependencyManagement

commit 1655fc453ded4626ae5e12e7b17af6f10c30a0dd
Author: Cheng Pan <379377944@qq.com>
Date:   Fri Jan 8 19:45:27 2021 +0800

    tune modules in alphabetical order

commit 7f3f4d987336d71d73eab059e93f3d008cfcd1a6
Author: Cheng Pan <379377944@qq.com>
Date:   Sat Jan 9 00:09:49 2021 +0800

    change dependencies scope to test
2021-01-09 23:30:46 +08:00
Kent Yao
6292b51ec8
Support launch SparkProcessBuilder with keytab and principal (#269)
* Support launch SparkProcessBuilder with keytab and principal

* fix tests
2021-01-08 23:43:14 +08:00
Cheng Pan
90c120759e
Improve pom.xml
fixes #268
Squashed commit of the following:

commit d40d0831d578af23559ea2a2544ceebc47f6df50
Author: Cheng Pan <379377944@qq.com>
Date:   Fri Jan 8 18:30:51 2021 +0800

    remove unused mockito

commit 386e7e4eb1c93006e302c41ffbc04d0acfaf9a9b
Author: Cheng Pan <379377944@qq.com>
Date:   Fri Jan 8 17:35:44 2021 +0800

    extract versions to properties
2021-01-08 19:04:48 +08:00
ulysses-you
7b56bb27f9
Fix EmbeddedZkServerSuite embedded zookeeper server NPE problem
fixes #267
Squashed commit of the following:

commit 38b3278e2bd4285dabeee093df855a1497ad35f8
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Fri Jan 8 12:43:14 2021 +0800

    user name

commit 76c5691f4a9dc419668d8610f5cf148d266ff46c
Author: cathy <cathy@cathydeMacBook-Pro.local>
Date:   Fri Jan 8 12:11:31 2021 +0800

    move to stop

commit 15e0ca8f7ec5e3fa27fda3572dc44ab3fa83c9ac
Author: cathy <cathy@cathydeMacBook-Pro.local>
Date:   Fri Jan 8 11:50:49 2021 +0800

    init
2021-01-08 13:09:44 +08:00
Kent Yao
80f81b20ab
ignore (#265) 2021-01-04 16:32:15 +08:00
Kent Yao
94f8bded65
Serverable suites 2021-01-04 16:11:35 +08:00
Kent Yao
37b8abfa62
FrontendService tests fix 2021-01-04 15:43:13 +08:00
Kent Yao
4c433fc59a
Add SparkSQLEngineListener 2021-01-03 02:09:25 +08:00
Kent Yao
aaaeddeb48
Refine documentaion architecture 2021-01-01 02:43:05 +08:00
Kent Yao
ca1b452e9a
Prepare Kyuubi v1.1.0 2020-12-31 15:51:12 +08:00
Kent Yao
d70aec651d
Spark Conf temp 2020-12-31 15:02:21 +08:00
Kent Yao
a1bfcc1273 Kyuubi Architecture documentation 2020-12-30 13:21:13 +08:00
Kent Yao
5d0ec40ac1 Kyuubi Architecture documentation 2020-12-29 16:27:50 +08:00
Kent Yao
6925712798 Kyuubi Architecture documentation 2020-12-29 16:17:56 +08:00
Kent Yao
c6ef275146 Kyuubi Architecture documentation 2020-12-29 16:13:22 +08:00
Kent Yao
ad9c0562ad Kyuubi Architecture documentation 2020-12-29 16:13:07 +08:00
Kent Yao
3eb47c7546 nit 2020-12-28 16:02:46 +08:00
Kent Yao
067d01a6f7 nit 2020-12-28 13:55:01 +08:00
Kent Yao
17fe83778e
ServiceDiscovery for kyuubi servver 2020-12-28 13:05:35 +08:00
Kent Yao
a0f900a629
Reformat ServiceDiscovery 2020-12-28 00:10:31 +08:00
Kent Yao
bb2b3038e1
Improve Session Share Level 2020-12-27 02:09:57 +08:00
Kent Yao
3ec0db6a40
Improve Session Share Level 2020-12-27 00:05:07 +08:00
Zen
7a79b16cdf
fix #259 engine scope
Squashed commit of the following:

commit bb598b101da43b145bd4c95976e8decd39a02210
Merge: 54e730c c4cf523
Author: zen <xinjingziranchan@gmail.com>
Date:   Thu Dec 24 10:53:42 2020 +0800

    Merge remote-tracking branch 'origin/pr2-engine-scope' into pr2-engine-scope

    # Conflicts:
    #	externals/kyuubi-spark-sql-engine/src/main/scala/org/apache/kyuubi/engine/spark/SparkSQLEngine.scala

commit 54e730c5b26ffb147e5c1266bdd036460cc20d82
Merge: 62d1575 512fbc5
Author: zen <xinjingziranchan@gmail.com>
Date:   Thu Dec 24 10:51:21 2020 +0800

    Merge branch 'master' into pr2-engine-scope

    # Conflicts:
    #	externals/kyuubi-spark-sql-engine/src/main/scala/org/apache/kyuubi/engine/spark/SparkSQLEngine.scala

commit c4cf523dc5bc409ea7ac742292d5e6e2d6421b8a
Author: zen <xinjingziranchan@gmail.com>
Date:   Mon Dec 21 23:10:12 2020 +0800

    merge master and fix the conflicts

commit c53b166f1eb3e8a698f498e1d123c815cef5d665
Merge: 62d1575 e8bc44c
Author: zen <xinjingziranchan@gmail.com>
Date:   Mon Dec 21 23:02:26 2020 +0800

    Merge branch 'master' into pr2-engine-scope

    # Conflicts:
    #	externals/kyuubi-spark-sql-engine/src/main/scala/org/apache/kyuubi/engine/spark/SparkSQLEngine.scala

commit 62d15751ea6b213319501bcfac442d21d0cd5ca6
Author: zen <xinjingziranchan@gmail.com>
Date:   Thu Dec 10 15:40:48 2020 +0800

    fix zkNamespace

commit 7e3e432318ed931b1ad16c839c4a027e00bc6ef9
Author: zen <xinjingziranchan@gmail.com>
Date:   Thu Dec 10 14:34:34 2020 +0800

    Support for configuring the session scope of SparkSQLEngine.
2020-12-24 19:02:40 +08:00
Zen
512fbc50cf
Support Spark YARN cluster deployment mode fix #264
Squashed commit of the following:

commit 3c875db5dd245b4f978afec92e1d02ac831c94bf
Author: zen <xinjingziranchan@gmail.com>
Date:   Wed Dec 23 19:51:22 2020 +0800

    remove unnecessary code

commit c2487ee7ca4bb4271c7ae6a6263e32e040c4c159
Merge: 67bf250 d8e5c5a
Author: zen <xinjingziranchan@gmail.com>
Date:   Wed Dec 23 10:58:16 2020 +0800

    Merge branch 'master' into pr4-deploy-mode-with-cluster

    # Conflicts:
    #	externals/kyuubi-spark-sql-engine/src/main/scala/org/apache/kyuubi/engine/spark/SparkSQLEngine.scala

commit 67bf25062d3cb38ccf3831b2e73561e16c4f8576
Author: zen <xinjingziranchan@gmail.com>
Date:   Wed Dec 23 10:51:46 2020 +0800

    delete unit test

commit 053834808f37c18a777a923d989a9b4d62d8419c
Author: zen <xinjingziranchan@gmail.com>
Date:   Wed Dec 23 10:34:05 2020 +0800

    Support Spark YARN cluster deployment mode

commit 61b24d0e3246f319b8d2cf70932a5b71cbf4a28a
Author: zen <xinjingziranchan@gmail.com>
Date:   Tue Dec 15 15:10:31 2020 +0800

    fix null exception and add unit test

commit 363cf93a77294485e7093716b6cb1cd58b4dba45
Author: zen <xinjingziranchan@gmail.com>
Date:   Tue Dec 15 14:21:19 2020 +0800

    Support Spark YARN cluster deployment mode
2020-12-23 20:45:09 +08:00
Kent Yao
d8e5c5aa4a
get the lastOption of serverList 2020-12-21 16:31:54 +08:00
Zen
e8bc44c2ad
[#258] delete the engine's timeoutChecker scheduler and merge it to sessionManager's scheduler
fix #258
Squashed commit of the following:

commit 5b0a4d1f77b32cef00f55b80b8562752c1f462d7
Author: zen <xinjingziranchan@gmail.com>
Date:   Wed Dec 16 10:15:16 2020 +0800

    fix closing session log

commit c0fe24d06638f9be18d91a4ad05943a023967c62
Author: zen <xinjingziranchan@gmail.com>
Date:   Sat Dec 12 22:08:25 2020 +0800

    move this check task to SparkSQLSessionManager.

commit 1968913702872f0ba433679596596f114f2e16d1
Author: zen <xinjingziranchan@gmail.com>
Date:   Thu Dec 10 15:55:32 2020 +0800

    add log when close session

commit 26a944787c63666813a0d64e67a36b671640d493
Author: zen <xinjingziranchan@gmail.com>
Date:   Thu Dec 10 11:32:45 2020 +0800

    delete the engine's timeoutChecker scheduler and merge it to  sessionManager's scheduler.
2020-12-21 11:01:31 +08:00
Kent Yao
b11a9d4172
Support _HOST 2020-12-14 20:47:11 +08:00
Kent Yao
f5eab9bf32 README Update 2020-12-13 02:57:16 +08:00
Kent Yao
671b8c668f README Update 2020-12-13 02:42:44 +08:00
Kent Yao
a8b70d0841
Add a one-click tpcds generating tool (#262)
* Add a one click tpcds generating tool

* nit
2020-12-12 03:04:42 +08:00
Zen
7fd6f71271 ZkClient should close when the session is opened
fixes #260

Squashed commit of the following:

commit ed4fa0cad9f8ad0053035b44a3ca703dd49ba362
Author: zen <xinjingziranchan@gmail.com>
Date:   Fri Dec 11 11:13:32 2020 +0800

    release the zkClient after session established.

commit add46a6acaa19942fcea3175ae253fdae2ef525b
Author: zen <xinjingziranchan@gmail.com>
Date:   Thu Dec 10 14:49:26 2020 +0800

    ZkClient should close when the session is opened.
2020-12-11 15:49:34 +08:00
Kent Yao
d357203b0e Add authentication guide 2020-11-30 17:45:20 +08:00
Kent Yao
5374398050 Stringlify exception for better client debugging 2020-11-27 22:20:51 +08:00
Kent Yao
2d5d58cb9f Fix Kerberos Auth Error 2020-11-27 21:22:09 +08:00
Kent Yao
87e243c596 support query log for async exec 2020-11-27 16:40:07 +08:00
Kent Yao
575e9c9599 Add support for user defaults 2020-11-25 21:37:25 +08:00
Kent Yao
dd4fb44d40 Kinit Auxiliary Service should be scheduled w/o delay during starting 2020-11-25 14:38:21 +08:00
Kent Yao
6a62ba165f Simplify log direcotries 2020-11-24 14:33:16 +08:00
Kent Yao
f8ef7c8997 Support ansynchronous exec for Kyuubi Server 2020-11-24 10:55:29 +08:00
Kent Yao
9ca23bcf20 Support ansynchronous exec for Spark SQL engine 2020-11-20 19:52:57 +08:00
Kent Yao
f5900b052f reorder doc 2020-11-19 11:32:29 +08:00
Kent Yao
91d0ce302e add HADOOP_CONF_DIR to classpath 2020-11-19 00:30:25 +08:00
Kent Yao
8843513496 Add full stacktrace if the spark proc crash 2020-11-18 17:57:05 +08:00