Commit Graph

686 Commits

Author SHA1 Message Date
Kent Yao
fcea17bc83
[KYUUBI #318] [KYUUBI #311]GetSchemas supports DSv2 and keeps its backward compatibility
![yaooqinn](https://badgen.net/badge/Hello/yaooqinn/green) [![Closes%20#318](https://badgen.net/badge/Preview/Closes%2520%23318/blue)](https://github.com/yaooqinn/kyuubi/pull/318) ![135](https://badgen.net/badge/%2B/135/red) ![45](https://badgen.net/badge/-/45/green) ![1](https://badgen.net/badge/commits/1/yellow) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!

Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines:
     https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->

### _Which issue are you going to fix?_
<!--
Replace ${ID} below with the actual issue id from
https://github.com/yaooqinn/kyuubi/issues,
so that the issue will be linked and automatically closed after merging
-->

Fixes #311

### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the user case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->

GetSchemas supports DSv2 and keeps its backward compatibility

we currently support only one part namespaces in this PR
### _How was this patch tested?_
- [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible

   add new tests
- [x] Add screenshots for manual tests if appropriate
![image](https://user-images.githubusercontent.com/8326978/106288487-15bedd80-6283-11eb-893f-0d55ad9a2f44.png)

- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

Closes #318 from yaooqinn/311.

1dec0e0 [Kent Yao] GetSchemas supports DSv2 and keeps its backward compatibility

Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-29 22:44:01 +08:00
Kent Yao
aa4c8bb6e5
[KYUUBI #317] [KYUUBI #317] merge pr script
![yaooqinn](https://badgen.net/badge/Hello/yaooqinn/green) [![Closes%20#317](https://badgen.net/badge/Preview/Closes%2520%23317/blue)](https://github.com/yaooqinn/kyuubi/pull/317) ![289](https://badgen.net/badge/%2B/289/red) ![0](https://badgen.net/badge/-/0/green) ![1](https://badgen.net/badge/commits/1/yellow) ![Test Plan](https://badgen.net/badge/Missing/Test%20Plan/ff0000) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!

Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines:
     https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->

### _Which issue are you going to fix?_
<!--
Replace ${ID} below with the actual issue id from
https://github.com/yaooqinn/kyuubi/issues,
so that the issue will be linked and automatically closed after merging
-->

Fixes #317

### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the user case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->

### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

Closes #317 from yaooqinn/mergepr.

4588d32 [Kent Yao] [KYUUBI #317] merge pr script

Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-29 16:26:58 +08:00
ulysses-you
3147d7c5b8
[KYUUBI #316] Nit remove some unnecessary blank
![ulysses-you](https://badgen.net/badge/Hello/ulysses-you/green) [![Closes%20#316](https://badgen.net/badge/Preview/Closes%2520%23316/blue)](https://github.com/yaooqinn/kyuubi/pull/316) ![0](https://badgen.net/badge/%2B/0/red) ![5](https://badgen.net/badge/-/5/green) ![1](https://badgen.net/badge/commits/1/yellow) ![Test Plan](https://badgen.net/badge/Missing/Test%20Plan/ff0000) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!

Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines:
     https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->

### _Which issue are you going to fix?_
<!--
Replace ${ID} below with the actual issue id from
https://github.com/yaooqinn/kyuubi/issues,
so that the issue will be linked and automatically closed after merging
-->

Fixes #316

### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the user case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->
Nit.

### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

Closes #316 from ulysses-you/nit.

e692b55 [ulysses-you] nit

Authored-by: ulysses-you <ulyssesyou18@gmail.com>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-29 16:23:40 +08:00
Kent Yao
cdde092c5d
[KYUUBI #315] Update README.md
![yaooqinn](https://badgen.net/badge/Hello/yaooqinn/green) [![Closes%20#315](https://badgen.net/badge/Preview/Closes%2520%23315/blue)](https://github.com/yaooqinn/kyuubi/pull/315) ![2](https://badgen.net/badge/%2B/2/red) ![2](https://badgen.net/badge/-/2/green) ![1](https://badgen.net/badge/commits/1/yellow) ![Test Plan](https://badgen.net/badge/Missing/Test%20Plan/ff0000) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!

Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines:
     https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->

### _Which issue are you going to fix?_
<!--
Replace ${ID} below with the actual issue id from
https://github.com/yaooqinn/kyuubi/issues,
so that the issue will be linked and automatically closed after merging
-->

Fixes #${ID}

### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the user case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->

### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

Closes #315 from yaooqinn/yaooqinn-patch-1.

8feb614 [Kent Yao] Update README.md

Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-29 16:22:23 +08:00
ulysses-you
2126565595
[KYUUBI #314] Add statement error msg in user log
![ulysses-you](https://badgen.net/badge/Hello/ulysses-you/green) [![Closes%20#314](https://badgen.net/badge/Preview/Closes%2520%23314/blue)](https://github.com/yaooqinn/kyuubi/pull/314) ![1](https://badgen.net/badge/%2B/1/red) ![0](https://badgen.net/badge/-/0/green) ![2](https://badgen.net/badge/commits/2/yellow) ![Test Plan](https://badgen.net/badge/Missing/Test%20Plan/ff0000) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!

Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines:
     https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->

<!--
Replace ${ID} below with the actual issue id from
https://github.com/yaooqinn/kyuubi/issues,
so that the issue will be linked and automatically closed after merging
-->

Fixes #314

<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the user case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->
Help to find problem

- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request
Squashed commit of the following:

commit e90840028848b1d307d11fd81b23f76f4a00ccf6
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Fri Jan 29 11:20:03 2021 +0800

    fix

commit 4a2136aa59b35bbd7997f0a59c466830ec665b4f
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Fri Jan 29 11:15:29 2021 +0800

    init
2021-01-29 15:23:04 +08:00
hzxiongyinke
277adc65db
[KYUUBI #313][MINOR] Fix README.md
![hzxiongyinke](https://badgen.net/badge/Hello/hzxiongyinke/green) [![Closes%20#313](https://badgen.net/badge/Preview/Closes%2520%23313/blue)](https://github.com/yaooqinn/kyuubi/pull/313) ![1](https://badgen.net/badge/%2B/1/red) ![1](https://badgen.net/badge/-/1/green) ![1](https://badgen.net/badge/commits/1/yellow) ![Target Issue](https://badgen.net/badge/Missing/Target%20Issue/ff0000) ![Test Plan](https://badgen.net/badge/Missing/Test%20Plan/ff0000) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!

Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines:
     https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->

<!--
Replace ${ID} below with the actual issue id from
https://github.com/yaooqinn/kyuubi/issues,
so that the issue will be linked and automatically closed after merging
-->

<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the user case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->

- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

Squashed commit of the following:

commit 9eb30ff89b164ccd49c9f59b91dd6717c26046f8
Author: hzxiongyinke <1062376716@qq.com>
Date:   Fri Jan 29 10:35:59 2021 +0800

    modify README.md
2021-01-29 10:54:57 +08:00
Kent Yao
efdd9fafc8
[KYUUBI #307]GetCatalogs supports DSv2 and keeps its backward compatibility (#307)
![yaooqinn](https://badgen.net/badge/Hello/yaooqinn/green) [![PR 307](https://badgen.net/badge/Preview/PR%20307/blue)](https://github.com/yaooqinn/kyuubi/pull/307) ![Feature](https://badgen.net/badge/Label/Feature/) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!  Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->

### Please add issue ID here?
<!-- replace ${issue ID} with the actual issue id -->
Fixes #307

### Why are the changes needed?
<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the user case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->

GetCatalogs supports DSv2 and keeps its backward compatibility

### Test Plan:
- [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [x] Add screenshots for manual tests if appropriate
![image](https://user-images.githubusercontent.com/8326978/106161043-7259c400-61c1-11eb-9beb-3326f6093284.png)

- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

* GetCatalogs supports DSv2

* pr template

* nit

* nit

* shim

* add iceberg tests

* nit
2021-01-29 10:27:48 +08:00
ulysses-you
05c64feaf2
[KYUUBI #303][FOLLOWUP] Fix test
fix #305
Squashed commit of the following:

commit f67ca84bafcd7fa43ae62a13edc6b044e9e7916f
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Tue Jan 26 20:36:10 2021 +0800

    init
2021-01-26 21:54:22 +08:00
ulysses-you
d44afdb346
[KYUUBI #303] Add host:port msg if we failed to initialize
![ulysses-you](https://badgen.net/badge/Hello/ulysses-you/green) [![PR 303](https://badgen.net/badge/Preview/PR%20303/blue)](https://github.com/yaooqinn/kyuubi/pull/303) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!  Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->

<!-- replace ${issue ID} with the actual issue id -->
Fixes #303

<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the user case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->

Before this PR, if we start Kyuubi with an already used port, we will get this error msg.
It's better to print host:port which we bind.
```
Exception in thread "main" org.apache.kyuubi.KyuubiException: Failed to initialize frontend service
	at org.apache.kyuubi.service.FrontendService.initialize(FrontendService.scala:102)
	at org.apache.kyuubi.service.CompositeService.$anonfun$initialize$1(CompositeService.scala:40)
	at org.apache.kyuubi.service.CompositeService.$anonfun$initialize$1$adapted(CompositeService.scala:40)
	at scala.collection.mutable.ResizableArray.foreach(ResizableArray.scala:62)
	at scala.collection.mutable.ResizableArray.foreach$(ResizableArray.scala:55)
	at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:49)
	at org.apache.kyuubi.service.CompositeService.initialize(CompositeService.scala:40)
	at org.apache.kyuubi.service.Serverable.initialize(Serverable.scala:37)
	at org.apache.kyuubi.server.KyuubiServer.initialize(KyuubiServer.scala:88)
	at org.apache.kyuubi.server.KyuubiServer$.startServer(KyuubiServer.scala:45)
	at org.apache.kyuubi.server.KyuubiServer$.main(KyuubiServer.scala:74)
	at org.apache.kyuubi.server.KyuubiServer.main(KyuubiServer.scala)
Caused by: java.net.BindException: Address already in use
	at java.net.PlainSocketImpl.socketBind(Native Method)
	at java.net.AbstractPlainSocketImpl.bind(AbstractPlainSocketImpl.java:387)
	at java.net.ServerSocket.bind(ServerSocket.java:375)
	at java.net.ServerSocket.<init>(ServerSocket.java:237)
	at org.apache.kyuubi.service.FrontendService.initialize(FrontendService.scala:77)
	... 11 more
```

- Add some test cases that check the changes thoroughly including negative and positive cases if possible
- Add screenshots for manual tests if appropriate
- [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request
Squashed commit of the following:

commit c3f5ffa3dae5d9822ae9b0d8eec879e971ccdea2
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Tue Jan 26 18:23:40 2021 +0800

    fix

commit 42d333de2c1edc0373c737053ff6c28b48a41cf7
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Tue Jan 26 14:44:35 2021 +0800

    err msg
2021-01-26 18:39:19 +08:00
ulysses-you
666593c426
[KYUUBI #302]fix zk client not release if open session failed
![ulysses-you](https://badgen.net/badge/Hello/ulysses-you/green) [![PR 302](https://badgen.net/badge/Preview/PR%20302/blue)](https://github.com/yaooqinn/kyuubi/pull/302) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!  Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->

<!-- replace ${issue ID} with the actual issue id -->
Fixes #302

<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the user case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->
Fix zk client leak problem.

- Add some test cases that check the changes thoroughly including negative and positive cases if possible
- Add screenshots for manual tests if appropriate
- [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request
2021-01-20 14:43:17 +08:00
fwang12
5eed2f7b50
[KYUUBI #300][TEST] Extract basic jdbc tests to prevent long time UT
fixies #300
Squashed commit of the following:

commit 8a08ef3fd798243c841d16fd14f8b900236f0373
Author: fwang12 <fwang12@ebay.com>
Date:   Tue Jan 19 20:20:33 2021 +0800

    rename SharedKyuubiOperationContext to WithKyuubiServer

commit f923eaffd709cb05b6f3928efaeb09925b63f6a5
Author: fwang12 <fwang12@ebay.com>
Date:   Tue Jan 19 19:45:54 2021 +0800

    style

commit 3dbba6a25d848b265fdfdf29f7bb173a70a12e68
Author: fwang12 <fwang12@ebay.com>
Date:   Tue Jan 19 19:43:33 2021 +0800

    fix ut

commit c5b41d9dd21e416452f46e80c7e4f25a9eb90595
Author: fwang12 <fwang12@ebay.com>
Date:   Tue Jan 19 19:30:43 2021 +0800

    just save

commit f9a53ba4ee7a6e36131cdf986a9de395c9bd8378
Author: fwang12 <fwang12@ebay.com>
Date:   Mon Jan 18 19:29:53 2021 +0800

    style

commit 660d6ff0d9c9a070ffafa697e5259e83cf8da266
Author: fwang12 <fwang12@ebay.com>
Date:   Mon Jan 18 18:40:17 2021 +0800

    Extract basic jdbc tests
2021-01-19 21:26:30 +08:00
fwang12
4e637c62de
[KYUUBI #297] Remove unused property from build properties file
fixes #297
Squashed commit of the following:

commit 26df4c44a57f92dd16efe69898e9e969c22093fa
Author: fwang12 <fwang12@ebay.com>
Date:   Mon Jan 18 13:09:13 2021 +0800

    remove unused properties in build info
2021-01-18 14:26:11 +08:00
Kent Yao
eadca7589c
[KYUUBI #296] Add spark 2.4 profile and shade hive-sevice-rpc to engine jar to fix thrift build err (#296)
* add spark 2.4.7 profile

* nit

* nit

* scala versions for profile spark-2.4
2021-01-18 14:23:31 +08:00
Cheng Pan
6f8564ce59
[KYUUBI #280] Align Operation GET_SCHEMAS * behavior with Hive #292
![pan3793](https://badgen.net/badge/Hello/pan3793/green) [![PR 292](https://badgen.net/badge/Preview/PR%20292/blue)](https://github.com/yaooqinn/kyuubi/pull/292) ![Bug](https://badgen.net/badge/Label/Bug/) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!  Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->

<!-- replace ${issue ID} with the actual issue id -->
Fixes #280
closes #292

<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the user case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->
Before this PR, Kyuubi treat Operation GET_SCHEMAS * as an invalid Operation then cause HUE list databases failed, but HiveServer2 will return all databases on same request.

- [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [x] Add screenshots for manual tests if appropriate
- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

After PR:
![201610862635_ pic](https://user-images.githubusercontent.com/26535726/104832256-032fc600-58cb-11eb-839b-6ece5328245a.jpg)
Squashed commit of the following:

commit f56fdc3fe35b4aa5a7b6f09cbbaa023ec713e2fe
Author: Cheng Pan <379377944@qq.com>
Date:   Sun Jan 17 23:27:03 2021 +0800

    [KYUUBI-280] code style and ut

commit ff74dbaf3e6d5606e5a2171e6dcc3628aa631eea
Author: Cheng Pan <379377944@qq.com>
Date:   Sun Jan 17 23:08:59 2021 +0800

    [KYUUBI-280] remove comments and handle schema * in other place

commit a8bcf98cd70e36903ece654e1c37d08e868b1c5b
Author: Cheng Pan <379377944@qq.com>
Date:   Sun Jan 17 13:47:24 2021 +0800

    [KYUUBI-280] Align Operation GET_SCHEMAS * behavior with Hive
2021-01-18 11:21:59 +08:00
Kent Yao
3a147f834b
Remove dulicated error msg for open sessions at engine side (#293) 2021-01-18 10:25:22 +08:00
fwang12
4b098bb7a5
[KYUUBI #295][INFRA] Add licenses for some yml files
fixed #295
Squashed commit of the following:

commit 4c8fbd3c1a14f4b01294aa07b1d603e1d0ded44a
Author: fwang12 <fwang12@ebay.com>
Date:   Mon Jan 18 00:34:11 2021 +0800

    Add licenses for some yml files
2021-01-18 10:24:13 +08:00
fwang12
cdee74747e
[KYUUBI #294][TEST] Enable UT for CONNECTION level engine shared.
fixes #294
Squashed commit of the following:

commit 6d6f78a202eae3ccad2ed0cf49942c06a22b2908
Author: fwang12 <fwang12@ebay.com>
Date:   Mon Jan 18 01:10:34 2021 +0800

    [TESTS] Enable UT for CONNECTION level engine shared.
2021-01-18 10:21:20 +08:00
Kent Yao
086bfab8b3
[KYUUBI #291] Add a quick start guide for DBeaver (#291)
![yaooqinn](https://badgen.net/badge/Hello/yaooqinn/green) [![PR 291](https://badgen.net/badge/Preview/PR%20291/blue)](https://github.com/yaooqinn/kyuubi/pull/291) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!  Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->

### Please add issue ID here?
<!-- replace ${issue ID} with the actual issue id -->
fixes #291

### Why are the changes needed?
<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the user case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->

add documentation for dbeaver database tool

### Test Plan:
- Add some test cases that check the changes thoroughly including negative and positive cases if possible
- Add screenshots for manual tests if appropriate
![image](https://user-images.githubusercontent.com/8326978/104806362-d9669880-5811-11eb-9e9f-97d630c345a7.png)

- [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

* dbeaver

* dbeaver

* nit
2021-01-16 16:04:15 +08:00
Kent Yao
60408dba19
[MINOR] Show Github Actions build status in readme 2021-01-15 15:40:43 +08:00
ulysses-you
ed585770f9
[KYUUBI #284][FOLLOWUP] Fix a race condition in engine redirect log file initialization
![ulysses-you](https://badgen.net/badge/Hello/ulysses-you/green) [![PR 289](https://badgen.net/badge/Preview/PR%20289/blue)](https://github.com/yaooqinn/kyuubi/pull/289) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!  Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->

fixes #284
closes #289

<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the user case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->
Fix the problem if some thread overwrite the same file.

- Add some test cases that check the changes thoroughly including negative and positive cases if possible
- Add screenshots for manual tests if appropriate
- [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

Squashed commit of the following:

commit 64445287c9522d33a797dd123b0683732cd50ebe
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Fri Jan 15 15:22:41 2021 +0800

    fix

commit e74229a614e727eef605d4ab496631972174c3cc
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Fri Jan 15 14:30:33 2021 +0800

    change

commit 91e94d4a11d343a5b833a99b9970f14c29981c04
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Fri Jan 15 11:56:24 2021 +0800

    nit
2021-01-15 15:38:56 +08:00
Kent Yao
0d0ea734f6
minor 2021-01-14 20:53:10 +08:00
ulysses-you
c83ea54e00
[KYUUBI #286] Add PR template
fixe #286
I believe it should be simple for now and we can update it when need.

     manually

Squashed commit of the following:

commit b618f82056e1b4c003dbde2b9eb9f01358dc3497
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Thu Jan 14 20:40:44 2021 +0800

    merge

commit 8c76e7b5ce159c4e088c66dfc60ab50f821b8c78
Merge: 7f37def c6bf6eb
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Thu Jan 14 20:37:30 2021 +0800

    Merge branch 'master' of https://github.com/yaooqinn/kyuubi into pr-template

commit 7f37def09273a7c28613b926189467e1364c8952
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Thu Jan 14 20:03:35 2021 +0800

    add pr template
2021-01-14 20:48:13 +08:00
ulysses-you
6dd78652d8
[KYUUBI #284] Sesson submit log should be overwritten
fixes #284
We will create and write a log during submit a new session (like spark-submit) but we don't delete or overwrite it. This PR aims to add a time config to decide if we need to overwrite a session submit log.

The log path template is `KYUUBI_WORD_DIR/user/$engine-log.$index`. We will increase the `index` automatically if a user create some session concurrently.

After this PR. The log path template is `KYUUBI_WORD_DIR/user/$engine.log.$index`.

Squashed commit of the following:

commit 7794406098df0a3129ccd2ab04a445d2155bef8e
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Thu Jan 14 19:52:10 2021 +0800

    fix

commit 13fd3bbb577c8bdad0ef73851262344d2870fd4d
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Thu Jan 14 19:02:36 2021 +0800

    fix docs

commit 82c192bc6bccf749f7d7232ed4f03f3c0a56c65f
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Thu Jan 14 18:04:50 2021 +0800

    fix

commit 134ea4389b0b9fddc777c79b1a9f43fc59ec3f7e
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Thu Jan 14 17:20:55 2021 +0800

    docs

commit 921ac11b27c028c508e834b88f9f9d9e17eb104a
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Thu Jan 14 17:16:09 2021 +0800

    fix config

commit bfcbd9633a18e9a4cf0b5b2308855ad8af7f7efd
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Thu Jan 14 16:36:00 2021 +0800

    prefix

commit bceb8c59cbd7d7757b2c30058f845fa1e3c7ee9d
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Thu Jan 14 16:14:20 2021 +0800

    doc

commit 4dd556333c7e6e8181f595293bb3877473c00ee7
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Thu Jan 14 16:11:00 2021 +0800

    init
2021-01-14 20:42:11 +08:00
Kent Yao
c6bf6ebf9e
PR ISSUE and Contribution Guide (#287) 2021-01-14 20:28:30 +08:00
ulysses-you
23a7c2a690
[KYUUBI #285] Add comment to remind develop if config updated
fixes #285

Squashed commit of the following:

commit 2bc1ae81fe58c538a2f9715562a6ae4587f1c91b
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Thu Jan 14 17:27:49 2021 +0800

    comment
2021-01-14 18:33:39 +08:00
Cheng Pan
50f86b3659
[KYUUBI#282] Downgrade libthrift:0.9.3 due to THRIFT-4805
fixes #282
Squashed commit of the following:

commit 6b6f75ce5d0171fc58472d21876ad5fd2a571aa0
Author: Cheng Pan <379377944@qq.com>
Date:   Thu Jan 14 00:25:38 2021 +0800

    downgrade libthrift:0.9.3 due to THRIFT-4805
2021-01-14 16:56:44 +08:00
fwang12
bf793f4b7a
Remove unused setting in pom
fixes #281
Squashed commit of the following:

commit 209729719e0f18b94377de8c126cc94cb14d1839
Author: fwang12 <fwang12@ebay.com>
Date:   Wed Jan 13 20:56:39 2021 +0800

    remove also

commit afdd72b7d39acfb286769a0f991d3437786f4341
Author: fwang12 <fwang12@ebay.com>
Date:   Wed Jan 13 20:31:47 2021 +0800

    Remove unused setting in pom
2021-01-13 21:11:34 +08:00
Kent Yao
776994471b
[DOC] Add v1.0.2 Documentation 2021-01-13 17:50:16 +08:00
ulysses-you
c34619eb63
[KYUUBI#209][Server] Fix high cpu load due to log capture thread not release
fixes #279
Squashed commit of the following:

commit adc811370380a74783cc22c21c02de0d15ea73fd
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Wed Jan 13 14:26:38 2021 +0800

    remove sleep

commit 41ad1172e9be59a9d88d0cdf22d5462690308b06
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Wed Jan 13 11:58:43 2021 +0800

    comment

commit fa7a7e90637818662aadc59c4f349316d66aa0a7
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Wed Jan 13 11:54:46 2021 +0800

    add test

commit 9f579e89a999aca9c98f424f5a748f2cd0fae3fb
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Wed Jan 13 11:54:38 2021 +0800

    release log capture thread
2021-01-13 17:34:28 +08:00
Cheng Pan
57ec15d09e
[MINOR] fix typo
fixes #277

Squashed commit of the following:

commit 291cb2c9baaf4072689231a9534c41a5eafd9a7e
Author: Cheng Pan <379377944@qq.com>
Date:   Tue Jan 12 23:42:47 2021 +0800

    update doc

commit 9f706c49f6c59d67c64d93c197cc963217636444
Author: Cheng Pan <379377944@qq.com>
Date:   Tue Jan 12 22:04:30 2021 +0800

    [MINOR] fix typo
2021-01-13 11:25:19 +08:00
Kent Yao
1903c03d71
readme 2021-01-12 21:38:28 +08:00
Kent Yao
09bd2bd174
Handle InvocationTargetException and UndeclaredThrowableException in KSE (#274)
* Handle InvocationTargetException and UndeclaredThrowableException

* nit
2021-01-10 02:21:45 +08:00
Cheng Pan
24b8b22e33
exclude hbase-* from hive-jdbc
fixes #275
Squashed commit of the following:

commit 6429ef117150087e8232ea73eb5b4a3668a1f017
Author: Cheng Pan <379377944@qq.com>
Date:   Sun Jan 10 00:53:41 2021 +0800

    exclude hbase-* from hive-jdbc
2021-01-10 01:21:41 +08:00
Kent Yao
61a2da4943
Merge pull request #272 from yaooqinn/dependabot/maven/org.apache.zookeeper-zookeeper-3.4.14
Bump zookeeper from 3.4.6 to 3.4.14
2021-01-10 00:23:17 +08:00
dependabot[bot]
4d1d3a49f8
Bump libthrift from 0.9.3 to 0.12.0
fixes #273

Squashed commit of the following:

commit b6a8d787ede228246af7b9d142f2edbd08e07eac
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date:   Sat Jan 9 15:34:57 2021 +0000

    Bump libthrift from 0.9.3 to 0.12.0

    Bumps [libthrift](https://github.com/apache/thrift) from 0.9.3 to 0.12.0.
    - [Release notes](https://github.com/apache/thrift/releases)
    - [Changelog](https://github.com/apache/thrift/blob/master/CHANGES.md)
    - [Commits](https://github.com/apache/thrift/compare/0.9.3...v0.12.0)

    Signed-off-by: dependabot[bot] <support@github.com>
2021-01-10 00:15:08 +08:00
dependabot[bot]
da2b22eedb
Bump zookeeper from 3.4.6 to 3.4.14
Bumps zookeeper from 3.4.6 to 3.4.14.

Signed-off-by: dependabot[bot] <support@github.com>
2021-01-09 15:34:54 +00:00
Cheng Pan
0eeb99774f
Tune pom
fixes #271
Squashed commit of the following:

commit fe0f469b2068865398d6e5be1957fdf6c6f5eb87
Author: Cheng Pan <379377944@qq.com>
Date:   Sat Jan 9 22:28:43 2021 +0800

    followup

commit 527e32419ecb2ae584d1251cb345e3fc870965a9
Author: Cheng Pan <379377944@qq.com>
Date:   Sat Jan 9 22:21:29 2021 +0800

    revert some stuffs

commit 82f188972b8491c5d381ba076a53f84a2fbc1898
Author: Cheng Pan <379377944@qq.com>
Date:   Sat Jan 9 16:49:14 2021 +0800

    remove unused dependencies

commit c7eb27228d2749ab9100102467e94d3a6a98cf44
Author: Cheng Pan <379377944@qq.com>
Date:   Sat Jan 9 15:41:59 2021 +0800

    minimize dependencies in kyuubi-spark-sql-engine

commit da902b1b1e02c7e93810ca832f6c9e7109cf95b9
Author: Cheng Pan <379377944@qq.com>
Date:   Sat Jan 9 13:26:34 2021 +0800

    exclude hive dependencies

commit 55ae7f025a5ffcec402919e28b7b3af5987dfe16
Author: Cheng Pan <379377944@qq.com>
Date:   Sat Jan 9 01:08:09 2021 +0800

    pin versions and excludes in <dependencyManagement>

commit 9ef84a5f62afd66fb4b817d593ba1b13ff8348ed
Author: Cheng Pan <379377944@qq.com>
Date:   Sat Jan 9 14:12:04 2021 +0800

    trigger kyuubi-spark-sql-engine package

commit d492e3fdce64e6554fe0db1d810c6f4bea198baa
Author: Cheng Pan <379377944@qq.com>
Date:   Sat Jan 9 13:44:13 2021 +0800

    trigger kyuubi-download

commit 050281b8fc400f3ae5fa1d43d56da49846664ea4
Author: Cheng Pan <379377944@qq.com>
Date:   Sat Jan 9 15:30:58 2021 +0800

    pin modules version in dependencyManagement

commit 1655fc453ded4626ae5e12e7b17af6f10c30a0dd
Author: Cheng Pan <379377944@qq.com>
Date:   Fri Jan 8 19:45:27 2021 +0800

    tune modules in alphabetical order

commit 7f3f4d987336d71d73eab059e93f3d008cfcd1a6
Author: Cheng Pan <379377944@qq.com>
Date:   Sat Jan 9 00:09:49 2021 +0800

    change dependencies scope to test
2021-01-09 23:30:46 +08:00
Kent Yao
6292b51ec8
Support launch SparkProcessBuilder with keytab and principal (#269)
* Support launch SparkProcessBuilder with keytab and principal

* fix tests
2021-01-08 23:43:14 +08:00
Cheng Pan
90c120759e
Improve pom.xml
fixes #268
Squashed commit of the following:

commit d40d0831d578af23559ea2a2544ceebc47f6df50
Author: Cheng Pan <379377944@qq.com>
Date:   Fri Jan 8 18:30:51 2021 +0800

    remove unused mockito

commit 386e7e4eb1c93006e302c41ffbc04d0acfaf9a9b
Author: Cheng Pan <379377944@qq.com>
Date:   Fri Jan 8 17:35:44 2021 +0800

    extract versions to properties
2021-01-08 19:04:48 +08:00
ulysses-you
7b56bb27f9
Fix EmbeddedZkServerSuite embedded zookeeper server NPE problem
fixes #267
Squashed commit of the following:

commit 38b3278e2bd4285dabeee093df855a1497ad35f8
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Fri Jan 8 12:43:14 2021 +0800

    user name

commit 76c5691f4a9dc419668d8610f5cf148d266ff46c
Author: cathy <cathy@cathydeMacBook-Pro.local>
Date:   Fri Jan 8 12:11:31 2021 +0800

    move to stop

commit 15e0ca8f7ec5e3fa27fda3572dc44ab3fa83c9ac
Author: cathy <cathy@cathydeMacBook-Pro.local>
Date:   Fri Jan 8 11:50:49 2021 +0800

    init
2021-01-08 13:09:44 +08:00
Kent Yao
80f81b20ab
ignore (#265) 2021-01-04 16:32:15 +08:00
Kent Yao
94f8bded65
Serverable suites 2021-01-04 16:11:35 +08:00
Kent Yao
37b8abfa62
FrontendService tests fix 2021-01-04 15:43:13 +08:00
Kent Yao
4c433fc59a
Add SparkSQLEngineListener 2021-01-03 02:09:25 +08:00
Kent Yao
aaaeddeb48
Refine documentaion architecture 2021-01-01 02:43:05 +08:00
Kent Yao
ca1b452e9a
Prepare Kyuubi v1.1.0 2020-12-31 15:51:12 +08:00
Kent Yao
d70aec651d
Spark Conf temp 2020-12-31 15:02:21 +08:00
Kent Yao
a1bfcc1273 Kyuubi Architecture documentation 2020-12-30 13:21:13 +08:00
Kent Yao
5d0ec40ac1 Kyuubi Architecture documentation 2020-12-29 16:27:50 +08:00
Kent Yao
6925712798 Kyuubi Architecture documentation 2020-12-29 16:17:56 +08:00