Kent Yao
a4d507a9c6
[KYUUBI #337 ] [FOLLOWUP]GetSchemas supports DSv2 multipart namespaces with dot backtick
...
 [](https://github.com/yaooqinn/kyuubi/pull/337 )      [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues , add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the use case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
add support for '.' and '`' in a namespace part
for instance, cases like https://github.com/yaooqinn/kyuubi/pull/337/files#diff-bcd0dfb958c3943a58a9705ac7053374c796449fefd6be7e9f014f9dd14b558fR94 produce the below catalog tree, we should treat `a.b`.c and a.`b.c` differently.
```
/var/folders/01/h81cs4sn3dq2dd_k4j6fhrmc0000gn/T/kyuubi-94c946f7-a64b-4980-9dd1-a63a573244dd
├── a
│ └── b.c
├── a.b
│ └── c
├── a.b.c
├── a.b`.c
├── db1
│ └── db2
│ └── db3
└── db4
```
### _How was this patch tested?_
- [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [x] Add screenshots for manual tests if appropriate
- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #337 from yaooqinn/getschema3.
fdb8b19 [Kent Yao] [FOLLOWUP]GetSchemas supports DSv2 multipart namespaces
0091cfc [Kent Yao] [FOLLOWUP]GetSchemas supports DSv2 multipart namespaces
5ccee06 [Kent Yao] [FOLLOWUP]GetSchemas supports DSv2 multipart namespaces
Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
2021-02-02 09:54:47 +08:00
Kent Yao
c9d44b482c
[KYUUBI #334 ] GetSchemas supports DSv2 multipart namespaces
...
 [](https://github.com/yaooqinn/kyuubi/pull/334 )     [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues , add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the use case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
This PR adds support for using Spark DSv2 to get Schemas with multipart namespaces under multiple catalogs.
The current works are all based on Apache Iceberg.
TODOS:
next step we will support get tables operation for multiple catalogs and namespaces.
### _How was this patch tested?_
- [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [x] Add screenshots for manual tests if appropriate
- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #334 from yaooqinn/getschema2.
5994170 [Kent Yao] update
188258a [Kent Yao] GetSchemas supports DSv2 multipart namespaces
Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
2021-02-01 20:55:45 +08:00
Honglun
c169c861ff
[KYUUBI #306 ] SparkProcessBuilder support Windows
...
 [](https://github.com/yaooqinn/kyuubi/pull/335 )    [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues , add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the use case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
SparkProcessBuilder support Windows. Easy to test for developers using Windows.
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [x] Add screenshots for manual tests if appropriate
- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #335 from Honglun/master.
00eb48e [Honglun] SparkProcessBuilder support Windows
Authored-by: Honglun <283471011@qq.com>
Signed-off-by: Kent Yao <yao@apache.org>
2021-02-01 20:48:29 +08:00
jhx1008
9db0088ae1
[KYUUBI #333 ] Fix hanging due to disordered service stopping
...
 [](https://github.com/yaooqinn/kyuubi/pull/333 )     [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues , add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the use case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
the service discovery should stop before the embedded zk server.
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [x] Add screenshots for manual tests if appropriate
```before
2021-01-31 11:26:15.800 ERROR server.KyuubiServer: RECEIVED SIGNAL 15: TERM
2021-01-31 11:26:15.801 INFO server.NIOServerCnxn: Closed socket connection for client /127.0.0.1:58707 which had sessionid 0x1000fbbfad70002
2021-01-31 11:26:15.801 INFO server.NIOServerCnxn: Closed socket connection for client /127.0.0.1:58490 which had sessionid 0x1000fbbfad70000
2021-01-31 11:26:15.801 INFO server.NIOServerCnxnFactory: NIOServerCnxn factory exited run method
2021-01-31 11:26:15.801 INFO zookeeper.ClientCnxn: Unable to read additional data from server sessionid 0x1000fbbfad70000, likely server has closed socket, closing socket connection and attempting reconnect
2021-01-31 11:26:15.801 INFO server.ZooKeeperServer: shutting down
2021-01-31 11:26:15.801 INFO server.SessionTrackerImpl: Shutting down
2021-01-31 11:26:15.801 INFO server.PrepRequestProcessor: Shutting down
2021-01-31 11:26:15.802 INFO server.KyuubiServer: Service: [ServiceDiscovery] is stopping.
2021-01-31 11:26:15.802 INFO server.SyncRequestProcessor: Shutting down
2021-01-31 11:26:15.802 INFO server.PrepRequestProcessor: PrepRequestProcessor exited loop!
2021-01-31 11:26:15.802 INFO server.SyncRequestProcessor: SyncRequestProcessor exited!
2021-01-31 11:26:15.802 INFO server.FinalRequestProcessor: shutdown of request processor complete
2021-01-31 11:26:15.804 INFO server.EmbeddedZkServer: Service[EmbeddedZkServer] is stopped.
2021-01-31 11:26:15.906 INFO state.ConnectionStateManager: State change: SUSPENDED
2021-01-31 11:26:15.907 INFO client.ServiceDiscovery: Zookeeper client connection state changed to: SUSPENDED
2021-01-31 11:26:17.615 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2021-01-31 11:26:17.615 INFO zookeeper.ClientCnxn: Socket error occurred: localhost/127.0.0.1:2181: Connection refused
2021-01-31 11:26:18.793 INFO server.SessionTrackerImpl: SessionTrackerImpl exited loop!
2021-01-31 11:26:19.126 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2021-01-31 11:26:19.126 INFO zookeeper.ClientCnxn: Socket error occurred: localhost/127.0.0.1:2181: Connection refused
2021-01-31 11:26:20.815 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2021-01-31 11:26:20.815 INFO zookeeper.ClientCnxn: Socket error occurred: localhost/127.0.0.1:2181: Connection refused
2021-01-31 11:26:21.947 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2021-01-31 11:26:21.948 INFO zookeeper.ClientCnxn: Socket error occurred: localhost/127.0.0.1:2181: Connection refused
2021-01-31 11:26:23.288 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2021-01-31 11:26:23.289 INFO zookeeper.ClientCnxn: Socket error occurred: localhost/127.0.0.1:2181: Connection refused
2021-01-31 11:26:25.075 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2021-01-31 11:26:25.075 INFO zookeeper.ClientCnxn: Socket error occurred: localhost/127.0.0.1:2181: Connection refused
2021-01-31 11:26:26.965 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2021-01-31 11:26:26.965 INFO zookeeper.ClientCnxn: Socket error occurred: localhost/127.0.0.1:2181: Connection refused
2021-01-31 11:26:28.412 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2021-01-31 11:26:28.412 INFO zookeeper.ClientCnxn: Socket error occurred: localhost/127.0.0.1:2181: Connection refused
2021-01-31 11:26:30.356 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2021-01-31 11:26:30.356 INFO zookeeper.ClientCnxn: Socket error occurred: localhost/127.0.0.1:2181: Connection refused
2021-01-31 11:26:31.751 ERROR curator.ConnectionState: Connection timed out for connection string (127.0.0.1:2181) and timeout (15000) / elapsed (15841)
org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss
```
```after
2021-01-31 11:49:15.070 ERROR server.KyuubiServer: RECEIVED SIGNAL 15: TERM
2021-01-31 11:49:15.071 INFO server.KyuubiServer: Service: [ServiceDiscovery] is stopping.
2021-01-31 11:49:15.074 INFO server.PrepRequestProcessor: Processed session termination for sessionid: 0x1000fd1db370000
2021-01-31 11:49:15.074 WARN client.ServiceDiscovery: This Kyuubi instance localhost:10009 is now de-registered from ZooKeeper. The server will be shut down after the last client session completes.
2021-01-31 11:49:15.074 INFO client.ServiceDiscovery: Service[ServiceDiscovery] is stopped.
2021-01-31 11:49:15.075 INFO server.NIOServerCnxn: Closed socket connection for client /127.0.0.1:63940 which had sessionid 0x1000fd1db370000
2021-01-31 11:49:15.075 INFO zookeeper.ZooKeeper: Session: 0x1000fd1db370000 closed
2021-01-31 11:49:15.076 WARN client.ServiceDiscovery: Service[ServiceDiscovery] is not started(STOPPED) yet.
2021-01-31 11:49:15.076 INFO server.KyuubiServer: Service: [FrontendService] is stopping.
2021-01-31 11:49:15.078 INFO service.FrontendService: FrontendService has stopped
2021-01-31 11:49:15.078 INFO service.FrontendService: Service[FrontendService] is stopped.
2021-01-31 11:49:15.078 INFO server.KyuubiServer: Service: [KyuubiBackendService] is stopping.
2021-01-31 11:49:15.078 INFO server.KyuubiBackendService: Service: [KyuubiSessionManager] is stopping.
2021-01-31 11:49:15.078 INFO session.KyuubiSessionManager: Service: [KyuubiOperationManager] is stopping.
2021-01-31 11:49:15.078 INFO operation.KyuubiOperationManager: Service[KyuubiOperationManager] is stopped.
2021-01-31 11:49:15.078 INFO session.KyuubiSessionManager: Service[KyuubiSessionManager] is stopped.
2021-01-31 11:49:15.079 INFO server.KyuubiBackendService: Service[KyuubiBackendService] is stopped.
2021-01-31 11:49:15.079 INFO server.KyuubiServer: Service: [KinitAuxiliaryService] is stopping.
2021-01-31 11:49:15.079 INFO service.KinitAuxiliaryService: Service[KinitAuxiliaryService] is stopped.
2021-01-31 11:49:15.079 INFO server.KyuubiServer: Service[KyuubiServer] is stopped.
2021-01-31 11:49:15.079 INFO server.NIOServerCnxn: Closed socket connection for client /127.0.0.1:64039 which had sessionid 0x1000fd1db370002
2021-01-31 11:49:15.079 INFO server.NIOServerCnxnFactory: NIOServerCnxn factory exited run method
2021-01-31 11:49:15.079 INFO server.ZooKeeperServer: shutting down
2021-01-31 11:49:15.079 INFO server.SessionTrackerImpl: Shutting down
2021-01-31 11:49:15.079 INFO server.PrepRequestProcessor: Shutting down
2021-01-31 11:49:15.080 INFO server.SyncRequestProcessor: Shutting down
2021-01-31 11:49:15.080 INFO server.PrepRequestProcessor: PrepRequestProcessor exited loop!
2021-01-31 11:49:15.080 INFO server.SyncRequestProcessor: SyncRequestProcessor exited!
2021-01-31 11:49:15.080 INFO server.FinalRequestProcessor: shutdown of request processor complete
2021-01-31 11:49:15.081 INFO server.EmbeddedZkServer: Service[EmbeddedZkServer] is stopped.
```
- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #333 from yaooqinn/hang.
945e1ba [jhx1008] Fix hanging due to disordered service stopping
Authored-by: jhx1008 <jhx1008@gmail.com>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-31 13:30:36 +08:00
Zac Zhou
b77ff07e6f
[KYUUBI #331 ] Try to fix some minor issues in README.
...
 [](https://github.com/yaooqinn/kyuubi/pull/332 )     [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues , add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the use case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #332 from yuanzac/master_zq.
d0ddf88 [Zac Zhou] Try to fix some minor issues in README.
Authored-by: Zac Zhou <“zhouquan@apache.org”>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-31 11:31:44 +08:00
jhx1008
7d2c7299c2
[KYUUBI #330 ] PR template Update
...
 [](https://github.com/yaooqinn/kyuubi/pull/330 )     [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues , add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the use case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #330 from yaooqinn/prtemp2.
aca60e4 [jhx1008] PR template Update
Authored-by: jhx1008 <jhx1008@gmail.com>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-31 03:07:28 +08:00
Kent Yao
f186fcb15e
[KYUUBI #329 ] Support tests with Apache Iceberg in engine
...
 [](https://github.com/yaooqinn/kyuubi/pull/329 )     [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues , add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the use case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
Support tests with Apache Iceberg in engine
- Improve debug experience for developers
- Improve test coverage
### _How was this patch tested?_
- [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #329 from yaooqinn/iceberg2.
8bf6714 [Kent Yao] Reflect IcebergOperationSuit
329593a [Kent Yao] Reflect IcebergOperationSuit
Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-31 02:18:18 +08:00
jhx1008
787f53e098
[KYUUBI #328 ] Print a server log trace for engine process
...
 [](https://github.com/yaooqinn/kyuubi/pull/328 )     [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues , add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the use case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
for better tracing engine logs
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [x] Add screenshots for manual tests if appropriate
- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #328 from yaooqinn/log.
0354ffa [jhx1008] Print a server log trace for engine process
Authored-by: jhx1008 <jhx1008@gmail.com>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-30 15:59:48 +08:00
jhx1008
ed6775856f
[KYUUBI #327 ] Update contribution guide
...
 [](https://github.com/yaooqinn/kyuubi/pull/327 )      [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues , add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the use case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
keep contribution guideline fresh
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #327 from yaooqinn/updatedoc.
861d434 [jhx1008] Update contribution guide
Authored-by: jhx1008 <jhx1008@gmail.com>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-30 15:11:49 +08:00
jhx1008
e5dbfe9e8e
[KYUUBI #326 ] Remove outdated deployment guide
...
 [](https://github.com/yaooqinn/kyuubi/pull/326 )      [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues , add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the use case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
the deployment guide is outdated
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #326 from yaooqinn/rmdeploydoc.
7d5393a [Kent Yao] Remove outdated deployment guide
Lead-authored-by: jhx1008 <jhx1008@gmail.com>
Co-authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-30 14:57:38 +08:00
peterylh
f5356795cc
[KYUUBI #325 ] Update PR template
...
 [](https://github.com/yaooqinn/kyuubi/pull/325 )     [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines:
https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->
### _Which issue are you going to fix?_
<!--
Replace ${ID} below with the actual issue id from
https://github.com/yaooqinn/kyuubi/issues ,
so that the issue will be linked and automatically closed after merging
-->
Fixes #${ID}
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the user case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
simplify the PR template according to the merge pr tool
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #325 from yaooqinn/prtemp.
20f6e34 [Kent Yao] nit
d74de3c [peterylh] Update PR template
Lead-authored-by: peterylh <peterylh@163.com>
Co-authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-30 14:43:21 +08:00
jhx1008
f6645de216
[KYUUBI #324 ] Use a human-readable engine start command
...
 [](https://github.com/yaooqinn/kyuubi/pull/324 )    [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines:
https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->
### _Which issue are you going to fix?_
<!--
Replace ${ID} below with the actual issue id from
https://github.com/yaooqinn/kyuubi/issues ,
so that the issue will be linked and automatically closed after merging
-->
Fixes #${ID}
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the user case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
Use a human-readable engine start command
### _How was this patch tested?_
- [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #324 from yaooqinn/printablecmd.
52a3e18 [jhx1008] Use a human readable engine start command
Authored-by: jhx1008 <jhx1008@gmail.com>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-30 14:36:28 +08:00
jhx1008
89e2ef743b
[KYUUBI #322 ] Override statement for better logging
...
 [](https://github.com/yaooqinn/kyuubi/pull/322 )     [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines:
https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->
### _Which issue are you going to fix?_
<!--
Replace ${ID} below with the actual issue id from
https://github.com/yaooqinn/kyuubi/issues ,
so that the issue will be linked and automatically closed after merging
-->
Fixes #${ID}
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the user case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #322 from yaooqinn/stmt.
9cebdb7 [Kent Yao] nit
8618583 [jhx1008] Override statement for better logging
Lead-authored-by: jhx1008 <jhx1008@gmail.com>
Co-authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-30 14:06:36 +08:00
jhx1008
ecd1c0e1a6
[KYUUBI #323 ] Fix Kyuubi conf template
...
 [](https://github.com/yaooqinn/kyuubi/pull/323 )     [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines:
https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->
### _Which issue are you going to fix?_
<!--
Replace ${ID} below with the actual issue id from
https://github.com/yaooqinn/kyuubi/issues ,
so that the issue will be linked and automatically closed after merging
-->
Fixes #${ID}
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the user case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
the Hadoop conf can not be recognized in `kyuubi-defaulfs.conf`, use HADOOP_CONF_DIR instead
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #323 from yaooqinn/conf.
a5f8a66 [Kent Yao] nit
7ef0046 [jhx1008] Fix Kyuubi conf template
Lead-authored-by: jhx1008 <jhx1008@gmail.com>
Co-authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-30 13:36:45 +08:00
jhx1008
97c0ff8395
[KYUUBI #321 ] Add Terminologies Documentation
...
 [](https://github.com/yaooqinn/kyuubi/pull/321 )    [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines:
https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->
### _Which issue are you going to fix?_
<!--
Replace ${ID} below with the actual issue id from
https://github.com/yaooqinn/kyuubi/issues ,
so that the issue will be linked and automatically closed after merging
-->
Fixes #${ID}
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the user case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
Add terminology documentation for better understanding both for users and devlopers
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [x] Add screenshots for manual tests if appropriate
- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #321 from yaooqinn/terminology.
2a6c7e7 [jhx1008] Add Terminologies Documentation
Authored-by: jhx1008 <jhx1008@gmail.com>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-30 12:28:42 +08:00
peterylh
af58331f67
[KYUUBI #320 ] Fix Merge PR with duplicated title
...
 [](https://github.com/yaooqinn/kyuubi/pull/320 )    [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines:
https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->
duplicated
### _Which issue are you going to fix?_
<!--
Replace ${ID} below with the actual issue id from
https://github.com/yaooqinn/kyuubi/issues ,
so that the issue will be linked and automatically closed after merging
-->
Fixes #${ID}
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the user case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
duplicated PR ID in the merged title
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #320 from yaooqinn/mergepr2.
8cbcf1b [peterylh] Fix Merge PR with duplicated title
Authored-by: peterylh <peterylh@163.com>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-29 23:22:28 +08:00
cz1019sniper
a8b970133e
[KYUUBI #319 ] Update Kyuubi Doc Version
...
 [](https://github.com/yaooqinn/kyuubi/pull/319 )     [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines:
https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->
### _Which issue are you going to fix?_
<!--
Replace ${ID} below with the actual issue id from
https://github.com/yaooqinn/kyuubi/issues ,
so that the issue will be linked and automatically closed after merging
-->
Fixes #${ID}
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the user case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
the doc version is out of date
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #319 from yaooqinn/versiondoc.
c972479 [cz1019sniper] Update Kyuubi Doc Version
Authored-by: cz1019sniper <tianlove1019@163.com>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-29 22:59:35 +08:00
Kent Yao
fcea17bc83
[KYUUBI #318 ] [KYUUBI #311 ]GetSchemas supports DSv2 and keeps its backward compatibility
...
 [](https://github.com/yaooqinn/kyuubi/pull/318 )    [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines:
https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->
### _Which issue are you going to fix?_
<!--
Replace ${ID} below with the actual issue id from
https://github.com/yaooqinn/kyuubi/issues ,
so that the issue will be linked and automatically closed after merging
-->
Fixes #311
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the user case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
GetSchemas supports DSv2 and keeps its backward compatibility
we currently support only one part namespaces in this PR
### _How was this patch tested?_
- [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible
add new tests
- [x] Add screenshots for manual tests if appropriate
- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #318 from yaooqinn/311.
1dec0e0 [Kent Yao] GetSchemas supports DSv2 and keeps its backward compatibility
Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-29 22:44:01 +08:00
Kent Yao
aa4c8bb6e5
[KYUUBI #317 ] [KYUUBI #317 ] merge pr script
...
 [](https://github.com/yaooqinn/kyuubi/pull/317 )     [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines:
https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->
### _Which issue are you going to fix?_
<!--
Replace ${ID} below with the actual issue id from
https://github.com/yaooqinn/kyuubi/issues ,
so that the issue will be linked and automatically closed after merging
-->
Fixes #317
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the user case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #317 from yaooqinn/mergepr.
4588d32 [Kent Yao] [KYUUBI #317 ] merge pr script
Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-29 16:26:58 +08:00
ulysses-you
3147d7c5b8
[KYUUBI #316 ] Nit remove some unnecessary blank
...
 [](https://github.com/yaooqinn/kyuubi/pull/316 )     [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines:
https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->
### _Which issue are you going to fix?_
<!--
Replace ${ID} below with the actual issue id from
https://github.com/yaooqinn/kyuubi/issues ,
so that the issue will be linked and automatically closed after merging
-->
Fixes #316
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the user case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
Nit.
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #316 from ulysses-you/nit.
e692b55 [ulysses-you] nit
Authored-by: ulysses-you <ulyssesyou18@gmail.com>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-29 16:23:40 +08:00
Kent Yao
cdde092c5d
[KYUUBI #315 ] Update README.md
...
 [](https://github.com/yaooqinn/kyuubi/pull/315 )     [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines:
https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->
### _Which issue are you going to fix?_
<!--
Replace ${ID} below with the actual issue id from
https://github.com/yaooqinn/kyuubi/issues ,
so that the issue will be linked and automatically closed after merging
-->
Fixes #${ID}
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the user case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #315 from yaooqinn/yaooqinn-patch-1.
8feb614 [Kent Yao] Update README.md
Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-29 16:22:23 +08:00
ulysses-you
2126565595
[KYUUBI #314 ] Add statement error msg in user log
...
 [](https://github.com/yaooqinn/kyuubi/pull/314 )     [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines:
https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->
<!--
Replace ${ID} below with the actual issue id from
https://github.com/yaooqinn/kyuubi/issues ,
so that the issue will be linked and automatically closed after merging
-->
Fixes #314
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the user case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
Help to find problem
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Squashed commit of the following:
commit e90840028848b1d307d11fd81b23f76f4a00ccf6
Author: ulysses-you <ulyssesyou18@gmail.com>
Date: Fri Jan 29 11:20:03 2021 +0800
fix
commit 4a2136aa59b35bbd7997f0a59c466830ec665b4f
Author: ulysses-you <ulyssesyou18@gmail.com>
Date: Fri Jan 29 11:15:29 2021 +0800
init
2021-01-29 15:23:04 +08:00
hzxiongyinke
277adc65db
[KYUUBI #313 ][MINOR] Fix README.md
...
 [](https://github.com/yaooqinn/kyuubi/pull/313 )      [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines:
https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->
<!--
Replace ${ID} below with the actual issue id from
https://github.com/yaooqinn/kyuubi/issues ,
so that the issue will be linked and automatically closed after merging
-->
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the user case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Squashed commit of the following:
commit 9eb30ff89b164ccd49c9f59b91dd6717c26046f8
Author: hzxiongyinke <1062376716@qq.com>
Date: Fri Jan 29 10:35:59 2021 +0800
modify README.md
2021-01-29 10:54:57 +08:00
Kent Yao
efdd9fafc8
[KYUUBI #307 ]GetCatalogs supports DSv2 and keeps its backward compatibility ( #307 )
...
 [](https://github.com/yaooqinn/kyuubi/pull/307 )  [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request! Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->
### Please add issue ID here?
<!-- replace ${issue ID} with the actual issue id -->
Fixes #307
### Why are the changes needed?
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the user case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
GetCatalogs supports DSv2 and keeps its backward compatibility
### Test Plan:
- [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [x] Add screenshots for manual tests if appropriate
- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
* GetCatalogs supports DSv2
* pr template
* nit
* nit
* shim
* add iceberg tests
* nit
2021-01-29 10:27:48 +08:00
ulysses-you
05c64feaf2
[KYUUBI #303 ][FOLLOWUP] Fix test
...
fix #305
Squashed commit of the following:
commit f67ca84bafcd7fa43ae62a13edc6b044e9e7916f
Author: ulysses-you <ulyssesyou18@gmail.com>
Date: Tue Jan 26 20:36:10 2021 +0800
init
2021-01-26 21:54:22 +08:00
ulysses-you
d44afdb346
[KYUUBI #303 ] Add host:port msg if we failed to initialize
...
 [](https://github.com/yaooqinn/kyuubi/pull/303 ) [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request! Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->
<!-- replace ${issue ID} with the actual issue id -->
Fixes #303
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the user case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
Before this PR, if we start Kyuubi with an already used port, we will get this error msg.
It's better to print host:port which we bind.
```
Exception in thread "main" org.apache.kyuubi.KyuubiException: Failed to initialize frontend service
at org.apache.kyuubi.service.FrontendService.initialize(FrontendService.scala:102)
at org.apache.kyuubi.service.CompositeService.$anonfun$initialize$1(CompositeService.scala:40)
at org.apache.kyuubi.service.CompositeService.$anonfun$initialize$1$adapted(CompositeService.scala:40)
at scala.collection.mutable.ResizableArray.foreach(ResizableArray.scala:62)
at scala.collection.mutable.ResizableArray.foreach$(ResizableArray.scala:55)
at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:49)
at org.apache.kyuubi.service.CompositeService.initialize(CompositeService.scala:40)
at org.apache.kyuubi.service.Serverable.initialize(Serverable.scala:37)
at org.apache.kyuubi.server.KyuubiServer.initialize(KyuubiServer.scala:88)
at org.apache.kyuubi.server.KyuubiServer$.startServer(KyuubiServer.scala:45)
at org.apache.kyuubi.server.KyuubiServer$.main(KyuubiServer.scala:74)
at org.apache.kyuubi.server.KyuubiServer.main(KyuubiServer.scala)
Caused by: java.net.BindException: Address already in use
at java.net.PlainSocketImpl.socketBind(Native Method)
at java.net.AbstractPlainSocketImpl.bind(AbstractPlainSocketImpl.java:387)
at java.net.ServerSocket.bind(ServerSocket.java:375)
at java.net.ServerSocket.<init>(ServerSocket.java:237)
at org.apache.kyuubi.service.FrontendService.initialize(FrontendService.scala:77)
... 11 more
```
- Add some test cases that check the changes thoroughly including negative and positive cases if possible
- Add screenshots for manual tests if appropriate
- [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Squashed commit of the following:
commit c3f5ffa3dae5d9822ae9b0d8eec879e971ccdea2
Author: ulysses-you <ulyssesyou18@gmail.com>
Date: Tue Jan 26 18:23:40 2021 +0800
fix
commit 42d333de2c1edc0373c737053ff6c28b48a41cf7
Author: ulysses-you <ulyssesyou18@gmail.com>
Date: Tue Jan 26 14:44:35 2021 +0800
err msg
2021-01-26 18:39:19 +08:00
ulysses-you
666593c426
[KYUUBI #302 ]fix zk client not release if open session failed
...
 [](https://github.com/yaooqinn/kyuubi/pull/302 ) [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request! Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->
<!-- replace ${issue ID} with the actual issue id -->
Fixes #302
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the user case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
Fix zk client leak problem.
- Add some test cases that check the changes thoroughly including negative and positive cases if possible
- Add screenshots for manual tests if appropriate
- [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
2021-01-20 14:43:17 +08:00
fwang12
5eed2f7b50
[KYUUBI #300 ][TEST] Extract basic jdbc tests to prevent long time UT
...
fixies #300
Squashed commit of the following:
commit 8a08ef3fd798243c841d16fd14f8b900236f0373
Author: fwang12 <fwang12@ebay.com>
Date: Tue Jan 19 20:20:33 2021 +0800
rename SharedKyuubiOperationContext to WithKyuubiServer
commit f923eaffd709cb05b6f3928efaeb09925b63f6a5
Author: fwang12 <fwang12@ebay.com>
Date: Tue Jan 19 19:45:54 2021 +0800
style
commit 3dbba6a25d848b265fdfdf29f7bb173a70a12e68
Author: fwang12 <fwang12@ebay.com>
Date: Tue Jan 19 19:43:33 2021 +0800
fix ut
commit c5b41d9dd21e416452f46e80c7e4f25a9eb90595
Author: fwang12 <fwang12@ebay.com>
Date: Tue Jan 19 19:30:43 2021 +0800
just save
commit f9a53ba4ee7a6e36131cdf986a9de395c9bd8378
Author: fwang12 <fwang12@ebay.com>
Date: Mon Jan 18 19:29:53 2021 +0800
style
commit 660d6ff0d9c9a070ffafa697e5259e83cf8da266
Author: fwang12 <fwang12@ebay.com>
Date: Mon Jan 18 18:40:17 2021 +0800
Extract basic jdbc tests
2021-01-19 21:26:30 +08:00
fwang12
4e637c62de
[KYUUBI #297 ] Remove unused property from build properties file
...
fixes #297
Squashed commit of the following:
commit 26df4c44a57f92dd16efe69898e9e969c22093fa
Author: fwang12 <fwang12@ebay.com>
Date: Mon Jan 18 13:09:13 2021 +0800
remove unused properties in build info
2021-01-18 14:26:11 +08:00
Kent Yao
eadca7589c
[KYUUBI #296 ] Add spark 2.4 profile and shade hive-sevice-rpc to engine jar to fix thrift build err ( #296 )
...
* add spark 2.4.7 profile
* nit
* nit
* scala versions for profile spark-2.4
2021-01-18 14:23:31 +08:00
Cheng Pan
6f8564ce59
[KYUUBI #280 ] Align Operation GET_SCHEMAS * behavior with Hive #292
...
 [](https://github.com/yaooqinn/kyuubi/pull/292 )  [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request! Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->
<!-- replace ${issue ID} with the actual issue id -->
Fixes #280
closes #292
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the user case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
Before this PR, Kyuubi treat Operation GET_SCHEMAS * as an invalid Operation then cause HUE list databases failed, but HiveServer2 will return all databases on same request.
- [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [x] Add screenshots for manual tests if appropriate
- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
After PR:
Squashed commit of the following:
commit f56fdc3fe35b4aa5a7b6f09cbbaa023ec713e2fe
Author: Cheng Pan <379377944@qq.com>
Date: Sun Jan 17 23:27:03 2021 +0800
[KYUUBI-280] code style and ut
commit ff74dbaf3e6d5606e5a2171e6dcc3628aa631eea
Author: Cheng Pan <379377944@qq.com>
Date: Sun Jan 17 23:08:59 2021 +0800
[KYUUBI-280] remove comments and handle schema * in other place
commit a8bcf98cd70e36903ece654e1c37d08e868b1c5b
Author: Cheng Pan <379377944@qq.com>
Date: Sun Jan 17 13:47:24 2021 +0800
[KYUUBI-280] Align Operation GET_SCHEMAS * behavior with Hive
2021-01-18 11:21:59 +08:00
Kent Yao
3a147f834b
Remove dulicated error msg for open sessions at engine side ( #293 )
2021-01-18 10:25:22 +08:00
fwang12
4b098bb7a5
[KYUUBI #295 ][INFRA] Add licenses for some yml files
...
fixed #295
Squashed commit of the following:
commit 4c8fbd3c1a14f4b01294aa07b1d603e1d0ded44a
Author: fwang12 <fwang12@ebay.com>
Date: Mon Jan 18 00:34:11 2021 +0800
Add licenses for some yml files
2021-01-18 10:24:13 +08:00
fwang12
cdee74747e
[KYUUBI #294 ][TEST] Enable UT for CONNECTION level engine shared.
...
fixes #294
Squashed commit of the following:
commit 6d6f78a202eae3ccad2ed0cf49942c06a22b2908
Author: fwang12 <fwang12@ebay.com>
Date: Mon Jan 18 01:10:34 2021 +0800
[TESTS] Enable UT for CONNECTION level engine shared.
2021-01-18 10:21:20 +08:00
Kent Yao
086bfab8b3
[KYUUBI #291 ] Add a quick start guide for DBeaver ( #291 )
...
 [](https://github.com/yaooqinn/kyuubi/pull/291 ) [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request! Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->
### Please add issue ID here?
<!-- replace ${issue ID} with the actual issue id -->
fixes #291
### Why are the changes needed?
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the user case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
add documentation for dbeaver database tool
### Test Plan:
- Add some test cases that check the changes thoroughly including negative and positive cases if possible
- Add screenshots for manual tests if appropriate
- [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
* dbeaver
* dbeaver
* nit
2021-01-16 16:04:15 +08:00
Kent Yao
60408dba19
[MINOR] Show Github Actions build status in readme
2021-01-15 15:40:43 +08:00
ulysses-you
ed585770f9
[KYUUBI #284 ][FOLLOWUP] Fix a race condition in engine redirect log file initialization
...
 [](https://github.com/yaooqinn/kyuubi/pull/289 ) [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request! Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->
fixes #284
closes #289
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the user case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
Fix the problem if some thread overwrite the same file.
- Add some test cases that check the changes thoroughly including negative and positive cases if possible
- Add screenshots for manual tests if appropriate
- [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Squashed commit of the following:
commit 64445287c9522d33a797dd123b0683732cd50ebe
Author: ulysses-you <ulyssesyou18@gmail.com>
Date: Fri Jan 15 15:22:41 2021 +0800
fix
commit e74229a614e727eef605d4ab496631972174c3cc
Author: ulysses-you <ulyssesyou18@gmail.com>
Date: Fri Jan 15 14:30:33 2021 +0800
change
commit 91e94d4a11d343a5b833a99b9970f14c29981c04
Author: ulysses-you <ulyssesyou18@gmail.com>
Date: Fri Jan 15 11:56:24 2021 +0800
nit
2021-01-15 15:38:56 +08:00
Kent Yao
0d0ea734f6
minor
2021-01-14 20:53:10 +08:00
ulysses-you
c83ea54e00
[KYUUBI #286 ] Add PR template
...
fixe #286
I believe it should be simple for now and we can update it when need.
manually
Squashed commit of the following:
commit b618f82056e1b4c003dbde2b9eb9f01358dc3497
Author: ulysses-you <ulyssesyou18@gmail.com>
Date: Thu Jan 14 20:40:44 2021 +0800
merge
commit 8c76e7b5ce159c4e088c66dfc60ab50f821b8c78
Merge: 7f37def c6bf6ebhttps://github.com/yaooqinn/kyuubi into pr-template
commit 7f37def09273a7c28613b926189467e1364c8952
Author: ulysses-you <ulyssesyou18@gmail.com>
Date: Thu Jan 14 20:03:35 2021 +0800
add pr template
2021-01-14 20:48:13 +08:00
ulysses-you
6dd78652d8
[KYUUBI #284 ] Sesson submit log should be overwritten
...
fixes #284
We will create and write a log during submit a new session (like spark-submit) but we don't delete or overwrite it. This PR aims to add a time config to decide if we need to overwrite a session submit log.
The log path template is `KYUUBI_WORD_DIR/user/$engine-log.$index`. We will increase the `index` automatically if a user create some session concurrently.
After this PR. The log path template is `KYUUBI_WORD_DIR/user/$engine.log.$index`.
Squashed commit of the following:
commit 7794406098df0a3129ccd2ab04a445d2155bef8e
Author: ulysses-you <ulyssesyou18@gmail.com>
Date: Thu Jan 14 19:52:10 2021 +0800
fix
commit 13fd3bbb577c8bdad0ef73851262344d2870fd4d
Author: ulysses-you <ulyssesyou18@gmail.com>
Date: Thu Jan 14 19:02:36 2021 +0800
fix docs
commit 82c192bc6bccf749f7d7232ed4f03f3c0a56c65f
Author: ulysses-you <ulyssesyou18@gmail.com>
Date: Thu Jan 14 18:04:50 2021 +0800
fix
commit 134ea4389b0b9fddc777c79b1a9f43fc59ec3f7e
Author: ulysses-you <ulyssesyou18@gmail.com>
Date: Thu Jan 14 17:20:55 2021 +0800
docs
commit 921ac11b27c028c508e834b88f9f9d9e17eb104a
Author: ulysses-you <ulyssesyou18@gmail.com>
Date: Thu Jan 14 17:16:09 2021 +0800
fix config
commit bfcbd9633a18e9a4cf0b5b2308855ad8af7f7efd
Author: ulysses-you <ulyssesyou18@gmail.com>
Date: Thu Jan 14 16:36:00 2021 +0800
prefix
commit bceb8c59cbd7d7757b2c30058f845fa1e3c7ee9d
Author: ulysses-you <ulyssesyou18@gmail.com>
Date: Thu Jan 14 16:14:20 2021 +0800
doc
commit 4dd556333c7e6e8181f595293bb3877473c00ee7
Author: ulysses-you <ulyssesyou18@gmail.com>
Date: Thu Jan 14 16:11:00 2021 +0800
init
2021-01-14 20:42:11 +08:00
Kent Yao
c6bf6ebf9e
PR ISSUE and Contribution Guide ( #287 )
2021-01-14 20:28:30 +08:00
ulysses-you
23a7c2a690
[KYUUBI #285 ] Add comment to remind develop if config updated
...
fixes #285
Squashed commit of the following:
commit 2bc1ae81fe58c538a2f9715562a6ae4587f1c91b
Author: ulysses-you <ulyssesyou18@gmail.com>
Date: Thu Jan 14 17:27:49 2021 +0800
comment
2021-01-14 18:33:39 +08:00
Cheng Pan
50f86b3659
[KYUUBI#282] Downgrade libthrift:0.9.3 due to THRIFT-4805
...
fixes #282
Squashed commit of the following:
commit 6b6f75ce5d0171fc58472d21876ad5fd2a571aa0
Author: Cheng Pan <379377944@qq.com>
Date: Thu Jan 14 00:25:38 2021 +0800
downgrade libthrift:0.9.3 due to THRIFT-4805
2021-01-14 16:56:44 +08:00
fwang12
bf793f4b7a
Remove unused setting in pom
...
fixes #281
Squashed commit of the following:
commit 209729719e0f18b94377de8c126cc94cb14d1839
Author: fwang12 <fwang12@ebay.com>
Date: Wed Jan 13 20:56:39 2021 +0800
remove also
commit afdd72b7d39acfb286769a0f991d3437786f4341
Author: fwang12 <fwang12@ebay.com>
Date: Wed Jan 13 20:31:47 2021 +0800
Remove unused setting in pom
2021-01-13 21:11:34 +08:00
Kent Yao
776994471b
[DOC] Add v1.0.2 Documentation
2021-01-13 17:50:16 +08:00
ulysses-you
c34619eb63
[KYUUBI#209][Server] Fix high cpu load due to log capture thread not release
...
fixes #279
Squashed commit of the following:
commit adc811370380a74783cc22c21c02de0d15ea73fd
Author: ulysses-you <ulyssesyou18@gmail.com>
Date: Wed Jan 13 14:26:38 2021 +0800
remove sleep
commit 41ad1172e9be59a9d88d0cdf22d5462690308b06
Author: ulysses-you <ulyssesyou18@gmail.com>
Date: Wed Jan 13 11:58:43 2021 +0800
comment
commit fa7a7e90637818662aadc59c4f349316d66aa0a7
Author: ulysses-you <ulyssesyou18@gmail.com>
Date: Wed Jan 13 11:54:46 2021 +0800
add test
commit 9f579e89a999aca9c98f424f5a748f2cd0fae3fb
Author: ulysses-you <ulyssesyou18@gmail.com>
Date: Wed Jan 13 11:54:38 2021 +0800
release log capture thread
2021-01-13 17:34:28 +08:00
Cheng Pan
57ec15d09e
[MINOR] fix typo
...
fixes #277
Squashed commit of the following:
commit 291cb2c9baaf4072689231a9534c41a5eafd9a7e
Author: Cheng Pan <379377944@qq.com>
Date: Tue Jan 12 23:42:47 2021 +0800
update doc
commit 9f706c49f6c59d67c64d93c197cc963217636444
Author: Cheng Pan <379377944@qq.com>
Date: Tue Jan 12 22:04:30 2021 +0800
[MINOR] fix typo
2021-01-13 11:25:19 +08:00
Kent Yao
1903c03d71
readme
2021-01-12 21:38:28 +08:00
Kent Yao
09bd2bd174
Handle InvocationTargetException and UndeclaredThrowableException in KSE ( #274 )
...
* Handle InvocationTargetException and UndeclaredThrowableException
* nit
2021-01-10 02:21:45 +08:00
Cheng Pan
24b8b22e33
exclude hbase-* from hive-jdbc
...
fixes #275
Squashed commit of the following:
commit 6429ef117150087e8232ea73eb5b4a3668a1f017
Author: Cheng Pan <379377944@qq.com>
Date: Sun Jan 10 00:53:41 2021 +0800
exclude hbase-* from hive-jdbc
2021-01-10 01:21:41 +08:00
