Commit Graph

706 Commits

Author SHA1 Message Date
Cheng Pan
2dc580456a
[KYUUBI #340] Swtich to commons-lang3
![pan3793](https://badgen.net/badge/Hello/pan3793/green) [![Closes #341](https://badgen.net/badge/Preview/Closes%20%23341/blue)](https://github.com/yaooqinn/kyuubi/pull/341) ![15](https://badgen.net/badge/%2B/15/red) ![3](https://badgen.net/badge/-/3/green) ![1](https://badgen.net/badge/commits/1/yellow) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!

Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
  2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
  3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->

### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the use case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->
close #340

### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

Closes #341 from pan3793/KYUUBI-340.

e014fe9 [Cheng Pan] swtich to commons-lang3

Authored-by: Cheng Pan <379377944@qq.com>
Signed-off-by: Kent Yao <yao@apache.org>
2021-02-02 20:47:45 +08:00
Kent Yao
7deb2f7fd7
[KYUUBI #336] Fix a race in Kyuubi start and stop
![yaooqinn](https://badgen.net/badge/Hello/yaooqinn/green) [![Closes #336](https://badgen.net/badge/Preview/Closes%20%23336/blue)](https://github.com/yaooqinn/kyuubi/pull/336) ![29](https://badgen.net/badge/%2B/29/red) ![36](https://badgen.net/badge/-/36/green) ![10](https://badgen.net/badge/commits/10/yellow) ![Target Issue](https://badgen.net/badge/Missing/Target%20Issue/ff0000) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!

Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
  2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
  3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->

### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the use case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->
there is something wrong with Travis these days due to some newly added test cases

### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

Closes #336 from yaooqinn/travisagain.

0285f5a [Kent Yao] fix a race
3624889 [Kent Yao] fix a race
895b4d5 [Kent Yao] fix a race
e253b9c [Kent Yao] fix a race
75d699a [Kent Yao] fix a race
7bde6b9 [Kent Yao] nit
6959e42 [Kent Yao] nit
062a151 [Kent Yao] nit
ca8af10 [Kent Yao] kyuubi-common
6e4b8b6 [jhx1008] Try to restore travis

Lead-authored-by: Kent Yao <yao@apache.org>
Co-authored-by: jhx1008 <jhx1008@gmail.com>
Signed-off-by: Kent Yao <yao@apache.org>
2021-02-02 20:46:06 +08:00
ulysses-you
6a4697019c
[KYUUBI #339] Add JDK8 bug troubleshootint
![ulysses-you](https://badgen.net/badge/Hello/ulysses-you/green) [![Closes #339](https://badgen.net/badge/Preview/Closes%20%23339/blue)](https://github.com/yaooqinn/kyuubi/pull/339) ![39](https://badgen.net/badge/%2B/39/red) ![0](https://badgen.net/badge/-/0/green) ![1](https://badgen.net/badge/commits/1/yellow) ![Target Issue](https://badgen.net/badge/Missing/Target%20Issue/ff0000) ![Test Plan](https://badgen.net/badge/Missing/Test%20Plan/ff0000) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!

Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
  2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
  3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->

### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the use case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->
Help user to find the resolution.

### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

Closes #339 from ulysses-you/jdk8-bug.

b25a629 [ulysses-you] init

Authored-by: ulysses-you <ulyssesyou18@gmail.com>
Signed-off-by: Kent Yao <yao@apache.org>
2021-02-02 18:05:37 +08:00
Kent Yao
a4d507a9c6
[KYUUBI #337] [FOLLOWUP]GetSchemas supports DSv2 multipart namespaces with dot backtick
![yaooqinn](https://badgen.net/badge/Hello/yaooqinn/green) [![Closes #337](https://badgen.net/badge/Preview/Closes%20%23337/blue)](https://github.com/yaooqinn/kyuubi/pull/337) ![23](https://badgen.net/badge/%2B/23/red) ![5](https://badgen.net/badge/-/5/green) ![3](https://badgen.net/badge/commits/3/yellow) ![Target Issue](https://badgen.net/badge/Missing/Target%20Issue/ff0000) ![Bug](https://badgen.net/badge/Label/Bug/) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!

Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
  2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
  3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->

### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the use case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->

add support for '.' and '`' in a namespace part

for instance, cases like https://github.com/yaooqinn/kyuubi/pull/337/files#diff-bcd0dfb958c3943a58a9705ac7053374c796449fefd6be7e9f014f9dd14b558fR94 produce the below catalog tree, we should treat `a.b`.c and a.`b.c` differently.
```
/var/folders/01/h81cs4sn3dq2dd_k4j6fhrmc0000gn/T/kyuubi-94c946f7-a64b-4980-9dd1-a63a573244dd
├── a
│   └── b.c
├── a.b
│   └── c
├── a.b.c
├── a.b`.c
├── db1
│   └── db2
│       └── db3
└── db4
```
### _How was this patch tested?_
- [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [x] Add screenshots for manual tests if appropriate

- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

Closes #337 from yaooqinn/getschema3.

fdb8b19 [Kent Yao] [FOLLOWUP]GetSchemas supports DSv2 multipart namespaces
0091cfc [Kent Yao] [FOLLOWUP]GetSchemas supports DSv2 multipart namespaces
5ccee06 [Kent Yao] [FOLLOWUP]GetSchemas supports DSv2 multipart namespaces

Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
2021-02-02 09:54:47 +08:00
Kent Yao
c9d44b482c
[KYUUBI #334] GetSchemas supports DSv2 multipart namespaces
![yaooqinn](https://badgen.net/badge/Hello/yaooqinn/green) [![Closes #334](https://badgen.net/badge/Preview/Closes%20%23334/blue)](https://github.com/yaooqinn/kyuubi/pull/334) ![39](https://badgen.net/badge/%2B/39/red) ![8](https://badgen.net/badge/-/8/green) ![2](https://badgen.net/badge/commits/2/yellow) ![Target Issue](https://badgen.net/badge/Missing/Target%20Issue/ff0000) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!

Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
  2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
  3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->

### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the use case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->

This PR adds support for using Spark DSv2 to get Schemas with multipart namespaces under multiple catalogs.

The current works are all based on Apache Iceberg.

TODOS:
    next step we will support get tables operation for multiple catalogs and namespaces.

### _How was this patch tested?_
- [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [x] Add screenshots for manual tests if appropriate

![image](https://user-images.githubusercontent.com/8326978/106436479-176ce900-64af-11eb-9152-7fb65645e0de.png)

- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

Closes #334 from yaooqinn/getschema2.

5994170 [Kent Yao] update
188258a [Kent Yao] GetSchemas supports DSv2 multipart namespaces

Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
2021-02-01 20:55:45 +08:00
Honglun
c169c861ff
[KYUUBI #306] SparkProcessBuilder support Windows
![Honglun](https://badgen.net/badge/Hello/Honglun/green) [![Closes #335](https://badgen.net/badge/Preview/Closes%20%23335/blue)](https://github.com/yaooqinn/kyuubi/pull/335) ![10](https://badgen.net/badge/%2B/10/red) ![2](https://badgen.net/badge/-/2/green) ![1](https://badgen.net/badge/commits/1/yellow) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!

Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
  2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
  3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->

### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the use case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->
SparkProcessBuilder support Windows. Easy to test for developers using Windows.

### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [x] Add screenshots for manual tests if appropriate

- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request
![image](https://user-images.githubusercontent.com/3722800/106450705-7f77fb00-64c0-11eb-98c1-895b18bb6eb0.png)

Closes #335 from Honglun/master.

00eb48e [Honglun] SparkProcessBuilder support Windows

Authored-by: Honglun <283471011@qq.com>
Signed-off-by: Kent Yao <yao@apache.org>
2021-02-01 20:48:29 +08:00
jhx1008
9db0088ae1
[KYUUBI #333] Fix hanging due to disordered service stopping
![yaooqinn](https://badgen.net/badge/Hello/yaooqinn/green) [![Closes #333](https://badgen.net/badge/Preview/Closes%20%23333/blue)](https://github.com/yaooqinn/kyuubi/pull/333) ![10](https://badgen.net/badge/%2B/10/red) ![6](https://badgen.net/badge/-/6/green) ![1](https://badgen.net/badge/commits/1/yellow) ![Target Issue](https://badgen.net/badge/Missing/Target%20Issue/ff0000) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!

Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
  2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
  3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->

### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the use case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->

the service discovery should stop before the embedded zk server.

### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [x] Add screenshots for manual tests if appropriate

```before
2021-01-31 11:26:15.800 ERROR server.KyuubiServer: RECEIVED SIGNAL 15: TERM
2021-01-31 11:26:15.801 INFO server.NIOServerCnxn: Closed socket connection for client /127.0.0.1:58707 which had sessionid 0x1000fbbfad70002
2021-01-31 11:26:15.801 INFO server.NIOServerCnxn: Closed socket connection for client /127.0.0.1:58490 which had sessionid 0x1000fbbfad70000
2021-01-31 11:26:15.801 INFO server.NIOServerCnxnFactory: NIOServerCnxn factory exited run method
2021-01-31 11:26:15.801 INFO zookeeper.ClientCnxn: Unable to read additional data from server sessionid 0x1000fbbfad70000, likely server has closed socket, closing socket connection and attempting reconnect
2021-01-31 11:26:15.801 INFO server.ZooKeeperServer: shutting down
2021-01-31 11:26:15.801 INFO server.SessionTrackerImpl: Shutting down
2021-01-31 11:26:15.801 INFO server.PrepRequestProcessor: Shutting down
2021-01-31 11:26:15.802 INFO server.KyuubiServer: Service: [ServiceDiscovery] is stopping.
2021-01-31 11:26:15.802 INFO server.SyncRequestProcessor: Shutting down
2021-01-31 11:26:15.802 INFO server.PrepRequestProcessor: PrepRequestProcessor exited loop!
2021-01-31 11:26:15.802 INFO server.SyncRequestProcessor: SyncRequestProcessor exited!
2021-01-31 11:26:15.802 INFO server.FinalRequestProcessor: shutdown of request processor complete
2021-01-31 11:26:15.804 INFO server.EmbeddedZkServer: Service[EmbeddedZkServer] is stopped.
2021-01-31 11:26:15.906 INFO state.ConnectionStateManager: State change: SUSPENDED
2021-01-31 11:26:15.907 INFO client.ServiceDiscovery: Zookeeper client connection state changed to: SUSPENDED
2021-01-31 11:26:17.615 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2021-01-31 11:26:17.615 INFO zookeeper.ClientCnxn: Socket error occurred: localhost/127.0.0.1:2181: Connection refused
2021-01-31 11:26:18.793 INFO server.SessionTrackerImpl: SessionTrackerImpl exited loop!
2021-01-31 11:26:19.126 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2021-01-31 11:26:19.126 INFO zookeeper.ClientCnxn: Socket error occurred: localhost/127.0.0.1:2181: Connection refused
2021-01-31 11:26:20.815 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2021-01-31 11:26:20.815 INFO zookeeper.ClientCnxn: Socket error occurred: localhost/127.0.0.1:2181: Connection refused
2021-01-31 11:26:21.947 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2021-01-31 11:26:21.948 INFO zookeeper.ClientCnxn: Socket error occurred: localhost/127.0.0.1:2181: Connection refused
2021-01-31 11:26:23.288 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2021-01-31 11:26:23.289 INFO zookeeper.ClientCnxn: Socket error occurred: localhost/127.0.0.1:2181: Connection refused
2021-01-31 11:26:25.075 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2021-01-31 11:26:25.075 INFO zookeeper.ClientCnxn: Socket error occurred: localhost/127.0.0.1:2181: Connection refused
2021-01-31 11:26:26.965 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2021-01-31 11:26:26.965 INFO zookeeper.ClientCnxn: Socket error occurred: localhost/127.0.0.1:2181: Connection refused
2021-01-31 11:26:28.412 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2021-01-31 11:26:28.412 INFO zookeeper.ClientCnxn: Socket error occurred: localhost/127.0.0.1:2181: Connection refused
2021-01-31 11:26:30.356 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2021-01-31 11:26:30.356 INFO zookeeper.ClientCnxn: Socket error occurred: localhost/127.0.0.1:2181: Connection refused
2021-01-31 11:26:31.751 ERROR curator.ConnectionState: Connection timed out for connection string (127.0.0.1:2181) and timeout (15000) / elapsed (15841)
org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss
```
```after
2021-01-31 11:49:15.070 ERROR server.KyuubiServer: RECEIVED SIGNAL 15: TERM
2021-01-31 11:49:15.071 INFO server.KyuubiServer: Service: [ServiceDiscovery] is stopping.
2021-01-31 11:49:15.074 INFO server.PrepRequestProcessor: Processed session termination for sessionid: 0x1000fd1db370000
2021-01-31 11:49:15.074 WARN client.ServiceDiscovery: This Kyuubi instance localhost:10009 is now de-registered from ZooKeeper. The server will be shut down after the last client session completes.
2021-01-31 11:49:15.074 INFO client.ServiceDiscovery: Service[ServiceDiscovery] is stopped.
2021-01-31 11:49:15.075 INFO server.NIOServerCnxn: Closed socket connection for client /127.0.0.1:63940 which had sessionid 0x1000fd1db370000
2021-01-31 11:49:15.075 INFO zookeeper.ZooKeeper: Session: 0x1000fd1db370000 closed
2021-01-31 11:49:15.076 WARN client.ServiceDiscovery: Service[ServiceDiscovery] is not started(STOPPED) yet.
2021-01-31 11:49:15.076 INFO server.KyuubiServer: Service: [FrontendService] is stopping.
2021-01-31 11:49:15.078 INFO service.FrontendService: FrontendService has stopped
2021-01-31 11:49:15.078 INFO service.FrontendService: Service[FrontendService] is stopped.
2021-01-31 11:49:15.078 INFO server.KyuubiServer: Service: [KyuubiBackendService] is stopping.
2021-01-31 11:49:15.078 INFO server.KyuubiBackendService: Service: [KyuubiSessionManager] is stopping.
2021-01-31 11:49:15.078 INFO session.KyuubiSessionManager: Service: [KyuubiOperationManager] is stopping.
2021-01-31 11:49:15.078 INFO operation.KyuubiOperationManager: Service[KyuubiOperationManager] is stopped.
2021-01-31 11:49:15.078 INFO session.KyuubiSessionManager: Service[KyuubiSessionManager] is stopped.
2021-01-31 11:49:15.079 INFO server.KyuubiBackendService: Service[KyuubiBackendService] is stopped.
2021-01-31 11:49:15.079 INFO server.KyuubiServer: Service: [KinitAuxiliaryService] is stopping.
2021-01-31 11:49:15.079 INFO service.KinitAuxiliaryService: Service[KinitAuxiliaryService] is stopped.
2021-01-31 11:49:15.079 INFO server.KyuubiServer: Service[KyuubiServer] is stopped.
2021-01-31 11:49:15.079 INFO server.NIOServerCnxn: Closed socket connection for client /127.0.0.1:64039 which had sessionid 0x1000fd1db370002
2021-01-31 11:49:15.079 INFO server.NIOServerCnxnFactory: NIOServerCnxn factory exited run method
2021-01-31 11:49:15.079 INFO server.ZooKeeperServer: shutting down
2021-01-31 11:49:15.079 INFO server.SessionTrackerImpl: Shutting down
2021-01-31 11:49:15.079 INFO server.PrepRequestProcessor: Shutting down
2021-01-31 11:49:15.080 INFO server.SyncRequestProcessor: Shutting down
2021-01-31 11:49:15.080 INFO server.PrepRequestProcessor: PrepRequestProcessor exited loop!
2021-01-31 11:49:15.080 INFO server.SyncRequestProcessor: SyncRequestProcessor exited!
2021-01-31 11:49:15.080 INFO server.FinalRequestProcessor: shutdown of request processor complete
2021-01-31 11:49:15.081 INFO server.EmbeddedZkServer: Service[EmbeddedZkServer] is stopped.
```

- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

Closes #333 from yaooqinn/hang.

945e1ba [jhx1008] Fix hanging due to disordered service stopping

Authored-by: jhx1008 <jhx1008@gmail.com>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-31 13:30:36 +08:00
Zac Zhou
b77ff07e6f
[KYUUBI #331] Try to fix some minor issues in README.
![yuanzac](https://badgen.net/badge/Hello/yuanzac/green) [![Closes #332](https://badgen.net/badge/Preview/Closes%20%23332/blue)](https://github.com/yaooqinn/kyuubi/pull/332) ![2](https://badgen.net/badge/%2B/2/red) ![2](https://badgen.net/badge/-/2/green) ![1](https://badgen.net/badge/commits/1/yellow) ![Test Plan](https://badgen.net/badge/Missing/Test%20Plan/ff0000) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!

Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
  2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
  3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->

### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the use case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->

### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

Closes #332 from yuanzac/master_zq.

d0ddf88 [Zac Zhou] Try to fix some minor issues in README.

Authored-by: Zac Zhou <“zhouquan@apache.org”>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-31 11:31:44 +08:00
jhx1008
7d2c7299c2
[KYUUBI #330] PR template Update
![yaooqinn](https://badgen.net/badge/Hello/yaooqinn/green) [![Closes%20#330](https://badgen.net/badge/Preview/Closes%2520%23330/blue)](https://github.com/yaooqinn/kyuubi/pull/330) ![6](https://badgen.net/badge/%2B/6/red) ![2](https://badgen.net/badge/-/2/green) ![1](https://badgen.net/badge/commits/1/yellow) ![Target Issue](https://badgen.net/badge/Missing/Target%20Issue/ff0000) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!

Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
  2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
  3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->

### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the use case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->

### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

Closes #330 from yaooqinn/prtemp2.

aca60e4 [jhx1008] PR template Update

Authored-by: jhx1008 <jhx1008@gmail.com>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-31 03:07:28 +08:00
Kent Yao
f186fcb15e
[KYUUBI #329] Support tests with Apache Iceberg in engine
![yaooqinn](https://badgen.net/badge/Hello/yaooqinn/green) [![Closes%20#329](https://badgen.net/badge/Preview/Closes%2520%23329/blue)](https://github.com/yaooqinn/kyuubi/pull/329) ![209](https://badgen.net/badge/%2B/209/red) ![144](https://badgen.net/badge/-/144/green) ![2](https://badgen.net/badge/commits/2/yellow) ![Target Issue](https://badgen.net/badge/Missing/Target%20Issue/ff0000) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!

Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
  2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
  3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->

### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the use case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->

Support tests with Apache Iceberg in engine
- Improve debug experience  for developers
- Improve test coverage

### _How was this patch tested?_
- [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

Closes #329 from yaooqinn/iceberg2.

8bf6714 [Kent Yao] Reflect IcebergOperationSuit
329593a [Kent Yao] Reflect IcebergOperationSuit

Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-31 02:18:18 +08:00
jhx1008
787f53e098
[KYUUBI #328] Print a server log trace for engine process
![yaooqinn](https://badgen.net/badge/Hello/yaooqinn/green) [![Closes%20#328](https://badgen.net/badge/Preview/Closes%2520%23328/blue)](https://github.com/yaooqinn/kyuubi/pull/328) ![5](https://badgen.net/badge/%2B/5/red) ![4](https://badgen.net/badge/-/4/green) ![1](https://badgen.net/badge/commits/1/yellow) ![Target Issue](https://badgen.net/badge/Missing/Target%20Issue/ff0000) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!

Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
  2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
  3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->

### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the use case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->

for better tracing engine logs

### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [x] Add screenshots for manual tests if appropriate
![image](https://user-images.githubusercontent.com/8326978/106350656-ae9c3a00-6311-11eb-844d-cc910e3a98f4.png)

- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

Closes #328 from yaooqinn/log.

0354ffa [jhx1008] Print a server log trace for engine process

Authored-by: jhx1008 <jhx1008@gmail.com>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-30 15:59:48 +08:00
jhx1008
ed6775856f
[KYUUBI #327] Update contribution guide
![yaooqinn](https://badgen.net/badge/Hello/yaooqinn/green) [![Closes%20#327](https://badgen.net/badge/Preview/Closes%2520%23327/blue)](https://github.com/yaooqinn/kyuubi/pull/327) ![40](https://badgen.net/badge/%2B/40/red) ![11](https://badgen.net/badge/-/11/green) ![1](https://badgen.net/badge/commits/1/yellow) ![Target Issue](https://badgen.net/badge/Missing/Target%20Issue/ff0000) ![Test Plan](https://badgen.net/badge/Missing/Test%20Plan/ff0000) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!

Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
  2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
  3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->

### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the use case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->

keep contribution guideline fresh

### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

Closes #327 from yaooqinn/updatedoc.

861d434 [jhx1008] Update contribution guide

Authored-by: jhx1008 <jhx1008@gmail.com>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-30 15:11:49 +08:00
jhx1008
e5dbfe9e8e
[KYUUBI #326] Remove outdated deployment guide
![yaooqinn](https://badgen.net/badge/Hello/yaooqinn/green) [![Closes%20#326](https://badgen.net/badge/Preview/Closes%2520%23326/blue)](https://github.com/yaooqinn/kyuubi/pull/326) ![0](https://badgen.net/badge/%2B/0/red) ![93](https://badgen.net/badge/-/93/green) ![1](https://badgen.net/badge/commits/1/yellow) ![Target Issue](https://badgen.net/badge/Missing/Target%20Issue/ff0000) ![Test Plan](https://badgen.net/badge/Missing/Test%20Plan/ff0000) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!

Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
  2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
  3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->

### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the use case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->

the deployment guide is outdated
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

Closes #326 from yaooqinn/rmdeploydoc.

7d5393a [Kent Yao] Remove outdated deployment guide

Lead-authored-by: jhx1008 <jhx1008@gmail.com>
Co-authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-30 14:57:38 +08:00
peterylh
f5356795cc
[KYUUBI #325] Update PR template
![yaooqinn](https://badgen.net/badge/Hello/yaooqinn/green) [![Closes%20#325](https://badgen.net/badge/Preview/Closes%2520%23325/blue)](https://github.com/yaooqinn/kyuubi/pull/325) ![4](https://badgen.net/badge/%2B/4/red) ![12](https://badgen.net/badge/-/12/green) ![2](https://badgen.net/badge/commits/2/yellow) ![Test Plan](https://badgen.net/badge/Missing/Test%20Plan/ff0000) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!

Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines:
     https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->

### _Which issue are you going to fix?_
<!--
Replace ${ID} below with the actual issue id from
https://github.com/yaooqinn/kyuubi/issues,
so that the issue will be linked and automatically closed after merging
-->

Fixes #${ID}

### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the user case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->

simplify the PR template  according to the merge pr tool

### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

Closes #325 from yaooqinn/prtemp.

20f6e34 [Kent Yao] nit
d74de3c [peterylh] Update PR template

Lead-authored-by: peterylh <peterylh@163.com>
Co-authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-30 14:43:21 +08:00
jhx1008
f6645de216
[KYUUBI #324] Use a human-readable engine start command
![yaooqinn](https://badgen.net/badge/Hello/yaooqinn/green) [![Closes%20#324](https://badgen.net/badge/Preview/Closes%2520%23324/blue)](https://github.com/yaooqinn/kyuubi/pull/324) ![6](https://badgen.net/badge/%2B/6/red) ![1](https://badgen.net/badge/-/1/green) ![1](https://badgen.net/badge/commits/1/yellow) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!

Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines:
     https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->

### _Which issue are you going to fix?_
<!--
Replace ${ID} below with the actual issue id from
https://github.com/yaooqinn/kyuubi/issues,
so that the issue will be linked and automatically closed after merging
-->

Fixes #${ID}

### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the user case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->

Use a human-readable engine start command

### _How was this patch tested?_
- [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

Closes #324 from yaooqinn/printablecmd.

52a3e18 [jhx1008] Use a human readable engine start command

Authored-by: jhx1008 <jhx1008@gmail.com>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-30 14:36:28 +08:00
jhx1008
89e2ef743b
[KYUUBI #322] Override statement for better logging
![yaooqinn](https://badgen.net/badge/Hello/yaooqinn/green) [![Closes%20#322](https://badgen.net/badge/Preview/Closes%2520%23322/blue)](https://github.com/yaooqinn/kyuubi/pull/322) ![26](https://badgen.net/badge/%2B/26/red) ![0](https://badgen.net/badge/-/0/green) ![2](https://badgen.net/badge/commits/2/yellow) ![Test Plan](https://badgen.net/badge/Missing/Test%20Plan/ff0000) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!

Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines:
     https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->

### _Which issue are you going to fix?_
<!--
Replace ${ID} below with the actual issue id from
https://github.com/yaooqinn/kyuubi/issues,
so that the issue will be linked and automatically closed after merging
-->

Fixes #${ID}

### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the user case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->

### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

Closes #322 from yaooqinn/stmt.

9cebdb7 [Kent Yao] nit
8618583 [jhx1008] Override statement for better logging

Lead-authored-by: jhx1008 <jhx1008@gmail.com>
Co-authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-30 14:06:36 +08:00
jhx1008
ecd1c0e1a6
[KYUUBI #323] Fix Kyuubi conf template
![yaooqinn](https://badgen.net/badge/Hello/yaooqinn/green) [![Closes%20#323](https://badgen.net/badge/Preview/Closes%2520%23323/blue)](https://github.com/yaooqinn/kyuubi/pull/323) ![0](https://badgen.net/badge/%2B/0/red) ![10](https://badgen.net/badge/-/10/green) ![2](https://badgen.net/badge/commits/2/yellow) ![Test Plan](https://badgen.net/badge/Missing/Test%20Plan/ff0000) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!

Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines:
     https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->

### _Which issue are you going to fix?_
<!--
Replace ${ID} below with the actual issue id from
https://github.com/yaooqinn/kyuubi/issues,
so that the issue will be linked and automatically closed after merging
-->

Fixes #${ID}

### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the user case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->

the Hadoop conf can not be recognized in `kyuubi-defaulfs.conf`, use HADOOP_CONF_DIR instead

### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

Closes #323 from yaooqinn/conf.

a5f8a66 [Kent Yao] nit
7ef0046 [jhx1008] Fix Kyuubi conf template

Lead-authored-by: jhx1008 <jhx1008@gmail.com>
Co-authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-30 13:36:45 +08:00
jhx1008
97c0ff8395
[KYUUBI #321] Add Terminologies Documentation
![yaooqinn](https://badgen.net/badge/Hello/yaooqinn/green) [![Closes%20#321](https://badgen.net/badge/Preview/Closes%2520%23321/blue)](https://github.com/yaooqinn/kyuubi/pull/321) ![172](https://badgen.net/badge/%2B/172/red) ![1](https://badgen.net/badge/-/1/green) ![1](https://badgen.net/badge/commits/1/yellow) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!

Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines:
     https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->

### _Which issue are you going to fix?_
<!--
Replace ${ID} below with the actual issue id from
https://github.com/yaooqinn/kyuubi/issues,
so that the issue will be linked and automatically closed after merging
-->

Fixes #${ID}

### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the user case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->

Add terminology documentation for better understanding both for users and devlopers

### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [x] Add screenshots for manual tests if appropriate
![image](https://user-images.githubusercontent.com/8326978/106347018-278d9880-62f6-11eb-8dcf-8125ce69c403.png)

- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

Closes #321 from yaooqinn/terminology.

2a6c7e7 [jhx1008] Add Terminologies Documentation

Authored-by: jhx1008 <jhx1008@gmail.com>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-30 12:28:42 +08:00
peterylh
af58331f67
[KYUUBI #320] Fix Merge PR with duplicated title
![yaooqinn](https://badgen.net/badge/Hello/yaooqinn/green) [![Closes%20#320](https://badgen.net/badge/Preview/Closes%2520%23320/blue)](https://github.com/yaooqinn/kyuubi/pull/320) ![1](https://badgen.net/badge/%2B/1/red) ![1](https://badgen.net/badge/-/1/green) ![1](https://badgen.net/badge/commits/1/yellow) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!

Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines:
     https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->
duplicated
### _Which issue are you going to fix?_
<!--
Replace ${ID} below with the actual issue id from
https://github.com/yaooqinn/kyuubi/issues,
so that the issue will be linked and automatically closed after merging
-->

Fixes #${ID}

### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the user case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->

duplicated PR ID in the merged title
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

Closes #320 from yaooqinn/mergepr2.

8cbcf1b [peterylh] Fix Merge PR with duplicated title

Authored-by: peterylh <peterylh@163.com>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-29 23:22:28 +08:00
cz1019sniper
a8b970133e
[KYUUBI #319] Update Kyuubi Doc Version
![yaooqinn](https://badgen.net/badge/Hello/yaooqinn/green) [![Closes%20#319](https://badgen.net/badge/Preview/Closes%2520%23319/blue)](https://github.com/yaooqinn/kyuubi/pull/319) ![1](https://badgen.net/badge/%2B/1/red) ![1](https://badgen.net/badge/-/1/green) ![1](https://badgen.net/badge/commits/1/yellow) ![Test Plan](https://badgen.net/badge/Missing/Test%20Plan/ff0000) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!

Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines:
     https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->

### _Which issue are you going to fix?_
<!--
Replace ${ID} below with the actual issue id from
https://github.com/yaooqinn/kyuubi/issues,
so that the issue will be linked and automatically closed after merging
-->

Fixes #${ID}

### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the user case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->

the doc version is out of date

### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

Closes #319 from yaooqinn/versiondoc.

c972479 [cz1019sniper] Update Kyuubi Doc Version

Authored-by: cz1019sniper <tianlove1019@163.com>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-29 22:59:35 +08:00
Kent Yao
fcea17bc83
[KYUUBI #318] [KYUUBI #311]GetSchemas supports DSv2 and keeps its backward compatibility
![yaooqinn](https://badgen.net/badge/Hello/yaooqinn/green) [![Closes%20#318](https://badgen.net/badge/Preview/Closes%2520%23318/blue)](https://github.com/yaooqinn/kyuubi/pull/318) ![135](https://badgen.net/badge/%2B/135/red) ![45](https://badgen.net/badge/-/45/green) ![1](https://badgen.net/badge/commits/1/yellow) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!

Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines:
     https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->

### _Which issue are you going to fix?_
<!--
Replace ${ID} below with the actual issue id from
https://github.com/yaooqinn/kyuubi/issues,
so that the issue will be linked and automatically closed after merging
-->

Fixes #311

### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the user case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->

GetSchemas supports DSv2 and keeps its backward compatibility

we currently support only one part namespaces in this PR
### _How was this patch tested?_
- [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible

   add new tests
- [x] Add screenshots for manual tests if appropriate
![image](https://user-images.githubusercontent.com/8326978/106288487-15bedd80-6283-11eb-893f-0d55ad9a2f44.png)

- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

Closes #318 from yaooqinn/311.

1dec0e0 [Kent Yao] GetSchemas supports DSv2 and keeps its backward compatibility

Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-29 22:44:01 +08:00
Kent Yao
aa4c8bb6e5
[KYUUBI #317] [KYUUBI #317] merge pr script
![yaooqinn](https://badgen.net/badge/Hello/yaooqinn/green) [![Closes%20#317](https://badgen.net/badge/Preview/Closes%2520%23317/blue)](https://github.com/yaooqinn/kyuubi/pull/317) ![289](https://badgen.net/badge/%2B/289/red) ![0](https://badgen.net/badge/-/0/green) ![1](https://badgen.net/badge/commits/1/yellow) ![Test Plan](https://badgen.net/badge/Missing/Test%20Plan/ff0000) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!

Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines:
     https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->

### _Which issue are you going to fix?_
<!--
Replace ${ID} below with the actual issue id from
https://github.com/yaooqinn/kyuubi/issues,
so that the issue will be linked and automatically closed after merging
-->

Fixes #317

### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the user case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->

### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

Closes #317 from yaooqinn/mergepr.

4588d32 [Kent Yao] [KYUUBI #317] merge pr script

Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-29 16:26:58 +08:00
ulysses-you
3147d7c5b8
[KYUUBI #316] Nit remove some unnecessary blank
![ulysses-you](https://badgen.net/badge/Hello/ulysses-you/green) [![Closes%20#316](https://badgen.net/badge/Preview/Closes%2520%23316/blue)](https://github.com/yaooqinn/kyuubi/pull/316) ![0](https://badgen.net/badge/%2B/0/red) ![5](https://badgen.net/badge/-/5/green) ![1](https://badgen.net/badge/commits/1/yellow) ![Test Plan](https://badgen.net/badge/Missing/Test%20Plan/ff0000) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!

Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines:
     https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->

### _Which issue are you going to fix?_
<!--
Replace ${ID} below with the actual issue id from
https://github.com/yaooqinn/kyuubi/issues,
so that the issue will be linked and automatically closed after merging
-->

Fixes #316

### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the user case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->
Nit.

### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

Closes #316 from ulysses-you/nit.

e692b55 [ulysses-you] nit

Authored-by: ulysses-you <ulyssesyou18@gmail.com>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-29 16:23:40 +08:00
Kent Yao
cdde092c5d
[KYUUBI #315] Update README.md
![yaooqinn](https://badgen.net/badge/Hello/yaooqinn/green) [![Closes%20#315](https://badgen.net/badge/Preview/Closes%2520%23315/blue)](https://github.com/yaooqinn/kyuubi/pull/315) ![2](https://badgen.net/badge/%2B/2/red) ![2](https://badgen.net/badge/-/2/green) ![1](https://badgen.net/badge/commits/1/yellow) ![Test Plan](https://badgen.net/badge/Missing/Test%20Plan/ff0000) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!

Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines:
     https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->

### _Which issue are you going to fix?_
<!--
Replace ${ID} below with the actual issue id from
https://github.com/yaooqinn/kyuubi/issues,
so that the issue will be linked and automatically closed after merging
-->

Fixes #${ID}

### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the user case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->

### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

Closes #315 from yaooqinn/yaooqinn-patch-1.

8feb614 [Kent Yao] Update README.md

Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-29 16:22:23 +08:00
ulysses-you
2126565595
[KYUUBI #314] Add statement error msg in user log
![ulysses-you](https://badgen.net/badge/Hello/ulysses-you/green) [![Closes%20#314](https://badgen.net/badge/Preview/Closes%2520%23314/blue)](https://github.com/yaooqinn/kyuubi/pull/314) ![1](https://badgen.net/badge/%2B/1/red) ![0](https://badgen.net/badge/-/0/green) ![2](https://badgen.net/badge/commits/2/yellow) ![Test Plan](https://badgen.net/badge/Missing/Test%20Plan/ff0000) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!

Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines:
     https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->

<!--
Replace ${ID} below with the actual issue id from
https://github.com/yaooqinn/kyuubi/issues,
so that the issue will be linked and automatically closed after merging
-->

Fixes #314

<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the user case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->
Help to find problem

- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request
Squashed commit of the following:

commit e90840028848b1d307d11fd81b23f76f4a00ccf6
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Fri Jan 29 11:20:03 2021 +0800

    fix

commit 4a2136aa59b35bbd7997f0a59c466830ec665b4f
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Fri Jan 29 11:15:29 2021 +0800

    init
2021-01-29 15:23:04 +08:00
hzxiongyinke
277adc65db
[KYUUBI #313][MINOR] Fix README.md
![hzxiongyinke](https://badgen.net/badge/Hello/hzxiongyinke/green) [![Closes%20#313](https://badgen.net/badge/Preview/Closes%2520%23313/blue)](https://github.com/yaooqinn/kyuubi/pull/313) ![1](https://badgen.net/badge/%2B/1/red) ![1](https://badgen.net/badge/-/1/green) ![1](https://badgen.net/badge/commits/1/yellow) ![Target Issue](https://badgen.net/badge/Missing/Target%20Issue/ff0000) ![Test Plan](https://badgen.net/badge/Missing/Test%20Plan/ff0000) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!

Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines:
     https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->

<!--
Replace ${ID} below with the actual issue id from
https://github.com/yaooqinn/kyuubi/issues,
so that the issue will be linked and automatically closed after merging
-->

<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the user case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->

- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

Squashed commit of the following:

commit 9eb30ff89b164ccd49c9f59b91dd6717c26046f8
Author: hzxiongyinke <1062376716@qq.com>
Date:   Fri Jan 29 10:35:59 2021 +0800

    modify README.md
2021-01-29 10:54:57 +08:00
Kent Yao
efdd9fafc8
[KYUUBI #307]GetCatalogs supports DSv2 and keeps its backward compatibility (#307)
![yaooqinn](https://badgen.net/badge/Hello/yaooqinn/green) [![PR 307](https://badgen.net/badge/Preview/PR%20307/blue)](https://github.com/yaooqinn/kyuubi/pull/307) ![Feature](https://badgen.net/badge/Label/Feature/) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!  Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->

### Please add issue ID here?
<!-- replace ${issue ID} with the actual issue id -->
Fixes #307

### Why are the changes needed?
<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the user case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->

GetCatalogs supports DSv2 and keeps its backward compatibility

### Test Plan:
- [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [x] Add screenshots for manual tests if appropriate
![image](https://user-images.githubusercontent.com/8326978/106161043-7259c400-61c1-11eb-9beb-3326f6093284.png)

- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

* GetCatalogs supports DSv2

* pr template

* nit

* nit

* shim

* add iceberg tests

* nit
2021-01-29 10:27:48 +08:00
ulysses-you
05c64feaf2
[KYUUBI #303][FOLLOWUP] Fix test
fix #305
Squashed commit of the following:

commit f67ca84bafcd7fa43ae62a13edc6b044e9e7916f
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Tue Jan 26 20:36:10 2021 +0800

    init
2021-01-26 21:54:22 +08:00
ulysses-you
d44afdb346
[KYUUBI #303] Add host:port msg if we failed to initialize
![ulysses-you](https://badgen.net/badge/Hello/ulysses-you/green) [![PR 303](https://badgen.net/badge/Preview/PR%20303/blue)](https://github.com/yaooqinn/kyuubi/pull/303) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!  Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->

<!-- replace ${issue ID} with the actual issue id -->
Fixes #303

<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the user case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->

Before this PR, if we start Kyuubi with an already used port, we will get this error msg.
It's better to print host:port which we bind.
```
Exception in thread "main" org.apache.kyuubi.KyuubiException: Failed to initialize frontend service
	at org.apache.kyuubi.service.FrontendService.initialize(FrontendService.scala:102)
	at org.apache.kyuubi.service.CompositeService.$anonfun$initialize$1(CompositeService.scala:40)
	at org.apache.kyuubi.service.CompositeService.$anonfun$initialize$1$adapted(CompositeService.scala:40)
	at scala.collection.mutable.ResizableArray.foreach(ResizableArray.scala:62)
	at scala.collection.mutable.ResizableArray.foreach$(ResizableArray.scala:55)
	at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:49)
	at org.apache.kyuubi.service.CompositeService.initialize(CompositeService.scala:40)
	at org.apache.kyuubi.service.Serverable.initialize(Serverable.scala:37)
	at org.apache.kyuubi.server.KyuubiServer.initialize(KyuubiServer.scala:88)
	at org.apache.kyuubi.server.KyuubiServer$.startServer(KyuubiServer.scala:45)
	at org.apache.kyuubi.server.KyuubiServer$.main(KyuubiServer.scala:74)
	at org.apache.kyuubi.server.KyuubiServer.main(KyuubiServer.scala)
Caused by: java.net.BindException: Address already in use
	at java.net.PlainSocketImpl.socketBind(Native Method)
	at java.net.AbstractPlainSocketImpl.bind(AbstractPlainSocketImpl.java:387)
	at java.net.ServerSocket.bind(ServerSocket.java:375)
	at java.net.ServerSocket.<init>(ServerSocket.java:237)
	at org.apache.kyuubi.service.FrontendService.initialize(FrontendService.scala:77)
	... 11 more
```

- Add some test cases that check the changes thoroughly including negative and positive cases if possible
- Add screenshots for manual tests if appropriate
- [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request
Squashed commit of the following:

commit c3f5ffa3dae5d9822ae9b0d8eec879e971ccdea2
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Tue Jan 26 18:23:40 2021 +0800

    fix

commit 42d333de2c1edc0373c737053ff6c28b48a41cf7
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Tue Jan 26 14:44:35 2021 +0800

    err msg
2021-01-26 18:39:19 +08:00
ulysses-you
666593c426
[KYUUBI #302]fix zk client not release if open session failed
![ulysses-you](https://badgen.net/badge/Hello/ulysses-you/green) [![PR 302](https://badgen.net/badge/Preview/PR%20302/blue)](https://github.com/yaooqinn/kyuubi/pull/302) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!  Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->

<!-- replace ${issue ID} with the actual issue id -->
Fixes #302

<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the user case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->
Fix zk client leak problem.

- Add some test cases that check the changes thoroughly including negative and positive cases if possible
- Add screenshots for manual tests if appropriate
- [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request
2021-01-20 14:43:17 +08:00
fwang12
5eed2f7b50
[KYUUBI #300][TEST] Extract basic jdbc tests to prevent long time UT
fixies #300
Squashed commit of the following:

commit 8a08ef3fd798243c841d16fd14f8b900236f0373
Author: fwang12 <fwang12@ebay.com>
Date:   Tue Jan 19 20:20:33 2021 +0800

    rename SharedKyuubiOperationContext to WithKyuubiServer

commit f923eaffd709cb05b6f3928efaeb09925b63f6a5
Author: fwang12 <fwang12@ebay.com>
Date:   Tue Jan 19 19:45:54 2021 +0800

    style

commit 3dbba6a25d848b265fdfdf29f7bb173a70a12e68
Author: fwang12 <fwang12@ebay.com>
Date:   Tue Jan 19 19:43:33 2021 +0800

    fix ut

commit c5b41d9dd21e416452f46e80c7e4f25a9eb90595
Author: fwang12 <fwang12@ebay.com>
Date:   Tue Jan 19 19:30:43 2021 +0800

    just save

commit f9a53ba4ee7a6e36131cdf986a9de395c9bd8378
Author: fwang12 <fwang12@ebay.com>
Date:   Mon Jan 18 19:29:53 2021 +0800

    style

commit 660d6ff0d9c9a070ffafa697e5259e83cf8da266
Author: fwang12 <fwang12@ebay.com>
Date:   Mon Jan 18 18:40:17 2021 +0800

    Extract basic jdbc tests
2021-01-19 21:26:30 +08:00
fwang12
4e637c62de
[KYUUBI #297] Remove unused property from build properties file
fixes #297
Squashed commit of the following:

commit 26df4c44a57f92dd16efe69898e9e969c22093fa
Author: fwang12 <fwang12@ebay.com>
Date:   Mon Jan 18 13:09:13 2021 +0800

    remove unused properties in build info
2021-01-18 14:26:11 +08:00
Kent Yao
eadca7589c
[KYUUBI #296] Add spark 2.4 profile and shade hive-sevice-rpc to engine jar to fix thrift build err (#296)
* add spark 2.4.7 profile

* nit

* nit

* scala versions for profile spark-2.4
2021-01-18 14:23:31 +08:00
Cheng Pan
6f8564ce59
[KYUUBI #280] Align Operation GET_SCHEMAS * behavior with Hive #292
![pan3793](https://badgen.net/badge/Hello/pan3793/green) [![PR 292](https://badgen.net/badge/Preview/PR%20292/blue)](https://github.com/yaooqinn/kyuubi/pull/292) ![Bug](https://badgen.net/badge/Label/Bug/) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!  Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->

<!-- replace ${issue ID} with the actual issue id -->
Fixes #280
closes #292

<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the user case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->
Before this PR, Kyuubi treat Operation GET_SCHEMAS * as an invalid Operation then cause HUE list databases failed, but HiveServer2 will return all databases on same request.

- [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [x] Add screenshots for manual tests if appropriate
- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

After PR:
![201610862635_ pic](https://user-images.githubusercontent.com/26535726/104832256-032fc600-58cb-11eb-839b-6ece5328245a.jpg)
Squashed commit of the following:

commit f56fdc3fe35b4aa5a7b6f09cbbaa023ec713e2fe
Author: Cheng Pan <379377944@qq.com>
Date:   Sun Jan 17 23:27:03 2021 +0800

    [KYUUBI-280] code style and ut

commit ff74dbaf3e6d5606e5a2171e6dcc3628aa631eea
Author: Cheng Pan <379377944@qq.com>
Date:   Sun Jan 17 23:08:59 2021 +0800

    [KYUUBI-280] remove comments and handle schema * in other place

commit a8bcf98cd70e36903ece654e1c37d08e868b1c5b
Author: Cheng Pan <379377944@qq.com>
Date:   Sun Jan 17 13:47:24 2021 +0800

    [KYUUBI-280] Align Operation GET_SCHEMAS * behavior with Hive
2021-01-18 11:21:59 +08:00
Kent Yao
3a147f834b
Remove dulicated error msg for open sessions at engine side (#293) 2021-01-18 10:25:22 +08:00
fwang12
4b098bb7a5
[KYUUBI #295][INFRA] Add licenses for some yml files
fixed #295
Squashed commit of the following:

commit 4c8fbd3c1a14f4b01294aa07b1d603e1d0ded44a
Author: fwang12 <fwang12@ebay.com>
Date:   Mon Jan 18 00:34:11 2021 +0800

    Add licenses for some yml files
2021-01-18 10:24:13 +08:00
fwang12
cdee74747e
[KYUUBI #294][TEST] Enable UT for CONNECTION level engine shared.
fixes #294
Squashed commit of the following:

commit 6d6f78a202eae3ccad2ed0cf49942c06a22b2908
Author: fwang12 <fwang12@ebay.com>
Date:   Mon Jan 18 01:10:34 2021 +0800

    [TESTS] Enable UT for CONNECTION level engine shared.
2021-01-18 10:21:20 +08:00
Kent Yao
086bfab8b3
[KYUUBI #291] Add a quick start guide for DBeaver (#291)
![yaooqinn](https://badgen.net/badge/Hello/yaooqinn/green) [![PR 291](https://badgen.net/badge/Preview/PR%20291/blue)](https://github.com/yaooqinn/kyuubi/pull/291) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!  Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->

### Please add issue ID here?
<!-- replace ${issue ID} with the actual issue id -->
fixes #291

### Why are the changes needed?
<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the user case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->

add documentation for dbeaver database tool

### Test Plan:
- Add some test cases that check the changes thoroughly including negative and positive cases if possible
- Add screenshots for manual tests if appropriate
![image](https://user-images.githubusercontent.com/8326978/104806362-d9669880-5811-11eb-9e9f-97d630c345a7.png)

- [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

* dbeaver

* dbeaver

* nit
2021-01-16 16:04:15 +08:00
Kent Yao
60408dba19
[MINOR] Show Github Actions build status in readme 2021-01-15 15:40:43 +08:00
ulysses-you
ed585770f9
[KYUUBI #284][FOLLOWUP] Fix a race condition in engine redirect log file initialization
![ulysses-you](https://badgen.net/badge/Hello/ulysses-you/green) [![PR 289](https://badgen.net/badge/Preview/PR%20289/blue)](https://github.com/yaooqinn/kyuubi/pull/289) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!  Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->

fixes #284
closes #289

<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the user case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->
Fix the problem if some thread overwrite the same file.

- Add some test cases that check the changes thoroughly including negative and positive cases if possible
- Add screenshots for manual tests if appropriate
- [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

Squashed commit of the following:

commit 64445287c9522d33a797dd123b0683732cd50ebe
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Fri Jan 15 15:22:41 2021 +0800

    fix

commit e74229a614e727eef605d4ab496631972174c3cc
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Fri Jan 15 14:30:33 2021 +0800

    change

commit 91e94d4a11d343a5b833a99b9970f14c29981c04
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Fri Jan 15 11:56:24 2021 +0800

    nit
2021-01-15 15:38:56 +08:00
Kent Yao
0d0ea734f6
minor 2021-01-14 20:53:10 +08:00
ulysses-you
c83ea54e00
[KYUUBI #286] Add PR template
fixe #286
I believe it should be simple for now and we can update it when need.

     manually

Squashed commit of the following:

commit b618f82056e1b4c003dbde2b9eb9f01358dc3497
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Thu Jan 14 20:40:44 2021 +0800

    merge

commit 8c76e7b5ce159c4e088c66dfc60ab50f821b8c78
Merge: 7f37def c6bf6eb
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Thu Jan 14 20:37:30 2021 +0800

    Merge branch 'master' of https://github.com/yaooqinn/kyuubi into pr-template

commit 7f37def09273a7c28613b926189467e1364c8952
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Thu Jan 14 20:03:35 2021 +0800

    add pr template
2021-01-14 20:48:13 +08:00
ulysses-you
6dd78652d8
[KYUUBI #284] Sesson submit log should be overwritten
fixes #284
We will create and write a log during submit a new session (like spark-submit) but we don't delete or overwrite it. This PR aims to add a time config to decide if we need to overwrite a session submit log.

The log path template is `KYUUBI_WORD_DIR/user/$engine-log.$index`. We will increase the `index` automatically if a user create some session concurrently.

After this PR. The log path template is `KYUUBI_WORD_DIR/user/$engine.log.$index`.

Squashed commit of the following:

commit 7794406098df0a3129ccd2ab04a445d2155bef8e
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Thu Jan 14 19:52:10 2021 +0800

    fix

commit 13fd3bbb577c8bdad0ef73851262344d2870fd4d
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Thu Jan 14 19:02:36 2021 +0800

    fix docs

commit 82c192bc6bccf749f7d7232ed4f03f3c0a56c65f
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Thu Jan 14 18:04:50 2021 +0800

    fix

commit 134ea4389b0b9fddc777c79b1a9f43fc59ec3f7e
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Thu Jan 14 17:20:55 2021 +0800

    docs

commit 921ac11b27c028c508e834b88f9f9d9e17eb104a
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Thu Jan 14 17:16:09 2021 +0800

    fix config

commit bfcbd9633a18e9a4cf0b5b2308855ad8af7f7efd
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Thu Jan 14 16:36:00 2021 +0800

    prefix

commit bceb8c59cbd7d7757b2c30058f845fa1e3c7ee9d
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Thu Jan 14 16:14:20 2021 +0800

    doc

commit 4dd556333c7e6e8181f595293bb3877473c00ee7
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Thu Jan 14 16:11:00 2021 +0800

    init
2021-01-14 20:42:11 +08:00
Kent Yao
c6bf6ebf9e
PR ISSUE and Contribution Guide (#287) 2021-01-14 20:28:30 +08:00
ulysses-you
23a7c2a690
[KYUUBI #285] Add comment to remind develop if config updated
fixes #285

Squashed commit of the following:

commit 2bc1ae81fe58c538a2f9715562a6ae4587f1c91b
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Thu Jan 14 17:27:49 2021 +0800

    comment
2021-01-14 18:33:39 +08:00
Cheng Pan
50f86b3659
[KYUUBI#282] Downgrade libthrift:0.9.3 due to THRIFT-4805
fixes #282
Squashed commit of the following:

commit 6b6f75ce5d0171fc58472d21876ad5fd2a571aa0
Author: Cheng Pan <379377944@qq.com>
Date:   Thu Jan 14 00:25:38 2021 +0800

    downgrade libthrift:0.9.3 due to THRIFT-4805
2021-01-14 16:56:44 +08:00
fwang12
bf793f4b7a
Remove unused setting in pom
fixes #281
Squashed commit of the following:

commit 209729719e0f18b94377de8c126cc94cb14d1839
Author: fwang12 <fwang12@ebay.com>
Date:   Wed Jan 13 20:56:39 2021 +0800

    remove also

commit afdd72b7d39acfb286769a0f991d3437786f4341
Author: fwang12 <fwang12@ebay.com>
Date:   Wed Jan 13 20:31:47 2021 +0800

    Remove unused setting in pom
2021-01-13 21:11:34 +08:00
Kent Yao
776994471b
[DOC] Add v1.0.2 Documentation 2021-01-13 17:50:16 +08:00
ulysses-you
c34619eb63
[KYUUBI#209][Server] Fix high cpu load due to log capture thread not release
fixes #279
Squashed commit of the following:

commit adc811370380a74783cc22c21c02de0d15ea73fd
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Wed Jan 13 14:26:38 2021 +0800

    remove sleep

commit 41ad1172e9be59a9d88d0cdf22d5462690308b06
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Wed Jan 13 11:58:43 2021 +0800

    comment

commit fa7a7e90637818662aadc59c4f349316d66aa0a7
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Wed Jan 13 11:54:46 2021 +0800

    add test

commit 9f579e89a999aca9c98f424f5a748f2cd0fae3fb
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Wed Jan 13 11:54:38 2021 +0800

    release log capture thread
2021-01-13 17:34:28 +08:00
Cheng Pan
57ec15d09e
[MINOR] fix typo
fixes #277

Squashed commit of the following:

commit 291cb2c9baaf4072689231a9534c41a5eafd9a7e
Author: Cheng Pan <379377944@qq.com>
Date:   Tue Jan 12 23:42:47 2021 +0800

    update doc

commit 9f706c49f6c59d67c64d93c197cc963217636444
Author: Cheng Pan <379377944@qq.com>
Date:   Tue Jan 12 22:04:30 2021 +0800

    [MINOR] fix typo
2021-01-13 11:25:19 +08:00