Kent Yao
968ed4f079
[KYUUBI #376 ] Use spark-hive instead of spark-hive-thriftserver in engine test
...
 [](https://github.com/yaooqinn/kyuubi/pull/376 )     [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues , add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the use case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
get rid of compile error when upgrading spark versions. instead, we shall add some e2e tests for it
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #376 from yaooqinn/hive.
26da066 [Kent Yao] Use spark-hive instead of spark-hive-thriftserver in engine test
Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
2021-02-26 00:28:17 +08:00
Kent Yao
ce7b122435
[KYUUBI #371 ] Avoid creating useless operation log for meta operation
...
 [](https://github.com/yaooqinn/kyuubi/pull/371 )     [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues , add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->
### _Why are the changes needed?_
1. Operation log for metadata is useless for client-side
2. Operation log for metadata dumps nothing useful for the engine side too
3. Operation log will create files that bring overhead for meta operations and may fail operations
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #371 from yaooqinn/oplog.
ca62e74 [Kent Yao] Avoid creating useless operation log for meta operation
Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
2021-02-25 20:47:48 +08:00
Cheng Pan
c659089bc2
[KYUUBI #360 ] Correct handle getNextRowSet with FETCH_PRIOR FETCH_FIRST
...
 [](https://github.com/yaooqinn/kyuubi/pull/370 )      [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues , add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the use case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
close #360
Ref: https://github.com/apache/spark/pull/30600
### _How was this patch tested?_
- [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #370 from pan3793/KYUUBI-360.
e79b8cb [Cheng Pan] [KYUUBI #360 ] comments
0fae3db [Cheng Pan] fix import
3d1b2a6 [Cheng Pan] [KYUUBI #360 ] fix ut
eda3e59 [Cheng Pan] [KYUUBI #360 ] fix import
16178d6 [Cheng Pan] [KYUUBI #360 ] ut
179404d [Cheng Pan] [KYUUBI #360 ] nit
455af6b [Cheng Pan] [KYUUBI #360 ] correct getNextRowSet with FETCH_PRIOR FETCH_FIRST
2307f1f [Cheng Pan] [KYUUBI #360 ] move ThriftUtils to kyuubi-common
Authored-by: Cheng Pan <379377944@qq.com>
Signed-off-by: Kent Yao <yao@apache.org>
2021-02-25 18:19:02 +08:00
Kent Yao
4b13f1c551
[KYUUBI #367 ] Engine terminating checker should start after exposed
...
 [](https://github.com/yaooqinn/kyuubi/pull/367 )      [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues , add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the use case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
Currently, the engine starts to check its lifecycle during the session manager's startup without any initial delay. Before the engine gets ready finally, it might trigger self-terminating.
In this PR, we move the checker to the end where the engine is exposed to the servers.
Avoiding errors like:
```
org.apache.hive.service.cli.HiveSQLException: Error operating GET_CATALOGS: java.net.SocketException: Connection reset
at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:267)
at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:258)
at org.apache.hive.jdbc.HiveDatabaseMetaData.getCatalogs(HiveDatabaseMetaData.java:142)
at org.apache.kyuubi.operation.BasicIcebergJDBCTests.$anonfun$$init$$2(BasicIcebergJDBCTests.scala:50)
at org.apache.kyuubi.operation.BasicIcebergJDBCTests.$anonfun$$init$$2$adapted(BasicIcebergJDBCTests.scala:48)
at org.apache.kyuubi.operation.JDBCTestUtils.$anonfun$withMultipleConnectionJdbcStatement$3(JDBCTestUtils.scala:43)
at org.apache.kyuubi.operation.JDBCTestUtils.$anonfun$withMultipleConnectionJdbcStatement$3$adapted(JDBCTestUtils.scala:43)
at scala.collection.mutable.ResizableArray.foreach(ResizableArray.scala:62)
at scala.collection.mutable.ResizableArray.foreach$(ResizableArray.scala:55)
at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:49)
```
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #367 from yaooqinn/engine.
f6a979e [Kent Yao] fix test
9cc561c [Kent Yao] address comment
3d15ab2 [Kent Yao] nit
a85d2e0 [Kent Yao] Engine terminating checker should start after exposed
Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
2021-02-25 15:10:43 +08:00
Kent Yao
ee50890b00
[KYUUBI #310 ] GetColumns supports DSv2 and keeps its backward compatibility
...
 [](https://github.com/yaooqinn/kyuubi/pull/358 )    [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues , add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->
close #310
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the use case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
### _How was this patch tested?_
- [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #358 from yaooqinn/310.
8cb30a4 [Kent Yao] sql wildcards to java regex
34d2c3a [Kent Yao] Merge branch 'master' into 310
d332be5 [Kent Yao] [KYUUBI #310 ] GetColumns supports DSv2 and keeps its backward compatibility
Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
2021-02-23 20:43:02 +08:00
Cheng Pan
23e1d61e47
[KYUUBI #350 ] Avoid using HiveResult
...
 [](https://github.com/yaooqinn/kyuubi/pull/351 )    [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues , add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the use case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
close #350
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #351 from pan3793/KYUUBI-350.
8b9ac46 [Cheng Pan] debug logs
21add73 [Cheng Pan] minor
46ceb54 [Cheng Pan] [KYUUBI-350] in favor cast string in executeStatment
f4e3633 [Cheng Pan] [KYUUBI-350] Avoid using HiveResult in RowSet
Authored-by: Cheng Pan <379377944@qq.com>
Signed-off-by: Kent Yao <yao@apache.org>
2021-02-12 14:00:39 +08:00
Kent Yao
a2818003e6
[KYUUBI #309 ] GetTables supports DSv2 and keeps its backward compatibility
...
 [](https://github.com/yaooqinn/kyuubi/pull/346 )    [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues , add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the use case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
fix #309
get tables through Spark DSv2
### _How was this patch tested?_
- [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #346 from yaooqinn/gettables.
16dbe4b [Kent Yao] nit
e03b021 [Kent Yao] nit
7f3eee2 [Kent Yao] Merge branch 'master' into gettables
0180cc5 [Kent Yao] add a test
8498152 [Kent Yao] GetTables supports DSv2 and keeps its backward compatibility
Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
2021-02-07 13:45:53 +08:00
ulysses-you
fbf1e3506c
[KYUUBI #345 ] Catch Throwable instead of Exception
...
 [](https://github.com/yaooqinn/kyuubi/pull/345 )       [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues , add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the use case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
We might get this error when running spark sql，so it's more reasonable to catch `Throwable`.
```
java.lang.NoClassDefFoundError: org/apache/hadoop/hive/serde2/SerDe
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at java.lang.ClassLoader.loadClass(ClassLoader.java:411)
```
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #345 from ulysses-you/throwable.
b6ffacd [ulysses-you] throw
Authored-by: ulysses-you <ulyssesyou18@gmail.com>
Signed-off-by: Kent Yao <yao@apache.org>
2021-02-03 19:31:26 +08:00
Kent Yao
7deb2f7fd7
[KYUUBI #336 ] Fix a race in Kyuubi start and stop
...
 [](https://github.com/yaooqinn/kyuubi/pull/336 )     [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues , add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the use case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
there is something wrong with Travis these days due to some newly added test cases
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #336 from yaooqinn/travisagain.
0285f5a [Kent Yao] fix a race
3624889 [Kent Yao] fix a race
895b4d5 [Kent Yao] fix a race
e253b9c [Kent Yao] fix a race
75d699a [Kent Yao] fix a race
7bde6b9 [Kent Yao] nit
6959e42 [Kent Yao] nit
062a151 [Kent Yao] nit
ca8af10 [Kent Yao] kyuubi-common
6e4b8b6 [jhx1008] Try to restore travis
Lead-authored-by: Kent Yao <yao@apache.org>
Co-authored-by: jhx1008 <jhx1008@gmail.com>
Signed-off-by: Kent Yao <yao@apache.org>
2021-02-02 20:46:06 +08:00
Kent Yao
a4d507a9c6
[KYUUBI #337 ] [FOLLOWUP]GetSchemas supports DSv2 multipart namespaces with dot backtick
...
 [](https://github.com/yaooqinn/kyuubi/pull/337 )      [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues , add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the use case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
add support for '.' and '`' in a namespace part
for instance, cases like https://github.com/yaooqinn/kyuubi/pull/337/files#diff-bcd0dfb958c3943a58a9705ac7053374c796449fefd6be7e9f014f9dd14b558fR94 produce the below catalog tree, we should treat `a.b`.c and a.`b.c` differently.
```
/var/folders/01/h81cs4sn3dq2dd_k4j6fhrmc0000gn/T/kyuubi-94c946f7-a64b-4980-9dd1-a63a573244dd
├── a
│ └── b.c
├── a.b
│ └── c
├── a.b.c
├── a.b`.c
├── db1
│ └── db2
│ └── db3
└── db4
```
### _How was this patch tested?_
- [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [x] Add screenshots for manual tests if appropriate
- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #337 from yaooqinn/getschema3.
fdb8b19 [Kent Yao] [FOLLOWUP]GetSchemas supports DSv2 multipart namespaces
0091cfc [Kent Yao] [FOLLOWUP]GetSchemas supports DSv2 multipart namespaces
5ccee06 [Kent Yao] [FOLLOWUP]GetSchemas supports DSv2 multipart namespaces
Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
2021-02-02 09:54:47 +08:00
Kent Yao
c9d44b482c
[KYUUBI #334 ] GetSchemas supports DSv2 multipart namespaces
...
 [](https://github.com/yaooqinn/kyuubi/pull/334 )     [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues , add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the use case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
This PR adds support for using Spark DSv2 to get Schemas with multipart namespaces under multiple catalogs.
The current works are all based on Apache Iceberg.
TODOS:
next step we will support get tables operation for multiple catalogs and namespaces.
### _How was this patch tested?_
- [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [x] Add screenshots for manual tests if appropriate
- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #334 from yaooqinn/getschema2.
5994170 [Kent Yao] update
188258a [Kent Yao] GetSchemas supports DSv2 multipart namespaces
Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
2021-02-01 20:55:45 +08:00
Kent Yao
f186fcb15e
[KYUUBI #329 ] Support tests with Apache Iceberg in engine
...
 [](https://github.com/yaooqinn/kyuubi/pull/329 )     [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues , add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the use case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
Support tests with Apache Iceberg in engine
- Improve debug experience for developers
- Improve test coverage
### _How was this patch tested?_
- [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #329 from yaooqinn/iceberg2.
8bf6714 [Kent Yao] Reflect IcebergOperationSuit
329593a [Kent Yao] Reflect IcebergOperationSuit
Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-31 02:18:18 +08:00
jhx1008
89e2ef743b
[KYUUBI #322 ] Override statement for better logging
...
 [](https://github.com/yaooqinn/kyuubi/pull/322 )     [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines:
https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->
### _Which issue are you going to fix?_
<!--
Replace ${ID} below with the actual issue id from
https://github.com/yaooqinn/kyuubi/issues ,
so that the issue will be linked and automatically closed after merging
-->
Fixes #${ID}
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the user case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #322 from yaooqinn/stmt.
9cebdb7 [Kent Yao] nit
8618583 [jhx1008] Override statement for better logging
Lead-authored-by: jhx1008 <jhx1008@gmail.com>
Co-authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-30 14:06:36 +08:00
Kent Yao
fcea17bc83
[KYUUBI #318 ] [KYUUBI #311 ]GetSchemas supports DSv2 and keeps its backward compatibility
...
 [](https://github.com/yaooqinn/kyuubi/pull/318 )    [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines:
https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->
### _Which issue are you going to fix?_
<!--
Replace ${ID} below with the actual issue id from
https://github.com/yaooqinn/kyuubi/issues ,
so that the issue will be linked and automatically closed after merging
-->
Fixes #311
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the user case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
GetSchemas supports DSv2 and keeps its backward compatibility
we currently support only one part namespaces in this PR
### _How was this patch tested?_
- [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible
add new tests
- [x] Add screenshots for manual tests if appropriate
- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #318 from yaooqinn/311.
1dec0e0 [Kent Yao] GetSchemas supports DSv2 and keeps its backward compatibility
Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-29 22:44:01 +08:00
ulysses-you
3147d7c5b8
[KYUUBI #316 ] Nit remove some unnecessary blank
...
 [](https://github.com/yaooqinn/kyuubi/pull/316 )     [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines:
https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->
### _Which issue are you going to fix?_
<!--
Replace ${ID} below with the actual issue id from
https://github.com/yaooqinn/kyuubi/issues ,
so that the issue will be linked and automatically closed after merging
-->
Fixes #316
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the user case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
Nit.
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #316 from ulysses-you/nit.
e692b55 [ulysses-you] nit
Authored-by: ulysses-you <ulyssesyou18@gmail.com>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-29 16:23:40 +08:00
ulysses-you
2126565595
[KYUUBI #314 ] Add statement error msg in user log
...
 [](https://github.com/yaooqinn/kyuubi/pull/314 )     [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines:
https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->
<!--
Replace ${ID} below with the actual issue id from
https://github.com/yaooqinn/kyuubi/issues ,
so that the issue will be linked and automatically closed after merging
-->
Fixes #314
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the user case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
Help to find problem
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Squashed commit of the following:
commit e90840028848b1d307d11fd81b23f76f4a00ccf6
Author: ulysses-you <ulyssesyou18@gmail.com>
Date: Fri Jan 29 11:20:03 2021 +0800
fix
commit 4a2136aa59b35bbd7997f0a59c466830ec665b4f
Author: ulysses-you <ulyssesyou18@gmail.com>
Date: Fri Jan 29 11:15:29 2021 +0800
init
2021-01-29 15:23:04 +08:00
Kent Yao
efdd9fafc8
[KYUUBI #307 ]GetCatalogs supports DSv2 and keeps its backward compatibility ( #307 )
...
 [](https://github.com/yaooqinn/kyuubi/pull/307 )  [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request! Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->
### Please add issue ID here?
<!-- replace ${issue ID} with the actual issue id -->
Fixes #307
### Why are the changes needed?
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the user case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
GetCatalogs supports DSv2 and keeps its backward compatibility
### Test Plan:
- [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [x] Add screenshots for manual tests if appropriate
- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
* GetCatalogs supports DSv2
* pr template
* nit
* nit
* shim
* add iceberg tests
* nit
2021-01-29 10:27:48 +08:00
Kent Yao
eadca7589c
[KYUUBI #296 ] Add spark 2.4 profile and shade hive-sevice-rpc to engine jar to fix thrift build err ( #296 )
...
* add spark 2.4.7 profile
* nit
* nit
* scala versions for profile spark-2.4
2021-01-18 14:23:31 +08:00
Cheng Pan
6f8564ce59
[KYUUBI #280 ] Align Operation GET_SCHEMAS * behavior with Hive #292
...
 [](https://github.com/yaooqinn/kyuubi/pull/292 )  [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request! Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->
<!-- replace ${issue ID} with the actual issue id -->
Fixes #280
closes #292
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the user case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
Before this PR, Kyuubi treat Operation GET_SCHEMAS * as an invalid Operation then cause HUE list databases failed, but HiveServer2 will return all databases on same request.
- [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [x] Add screenshots for manual tests if appropriate
- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
After PR:
Squashed commit of the following:
commit f56fdc3fe35b4aa5a7b6f09cbbaa023ec713e2fe
Author: Cheng Pan <379377944@qq.com>
Date: Sun Jan 17 23:27:03 2021 +0800
[KYUUBI-280] code style and ut
commit ff74dbaf3e6d5606e5a2171e6dcc3628aa631eea
Author: Cheng Pan <379377944@qq.com>
Date: Sun Jan 17 23:08:59 2021 +0800
[KYUUBI-280] remove comments and handle schema * in other place
commit a8bcf98cd70e36903ece654e1c37d08e868b1c5b
Author: Cheng Pan <379377944@qq.com>
Date: Sun Jan 17 13:47:24 2021 +0800
[KYUUBI-280] Align Operation GET_SCHEMAS * behavior with Hive
2021-01-18 11:21:59 +08:00
Kent Yao
3a147f834b
Remove dulicated error msg for open sessions at engine side ( #293 )
2021-01-18 10:25:22 +08:00
Cheng Pan
0eeb99774f
Tune pom
...
fixes #271
Squashed commit of the following:
commit fe0f469b2068865398d6e5be1957fdf6c6f5eb87
Author: Cheng Pan <379377944@qq.com>
Date: Sat Jan 9 22:28:43 2021 +0800
followup
commit 527e32419ecb2ae584d1251cb345e3fc870965a9
Author: Cheng Pan <379377944@qq.com>
Date: Sat Jan 9 22:21:29 2021 +0800
revert some stuffs
commit 82f188972b8491c5d381ba076a53f84a2fbc1898
Author: Cheng Pan <379377944@qq.com>
Date: Sat Jan 9 16:49:14 2021 +0800
remove unused dependencies
commit c7eb27228d2749ab9100102467e94d3a6a98cf44
Author: Cheng Pan <379377944@qq.com>
Date: Sat Jan 9 15:41:59 2021 +0800
minimize dependencies in kyuubi-spark-sql-engine
commit da902b1b1e02c7e93810ca832f6c9e7109cf95b9
Author: Cheng Pan <379377944@qq.com>
Date: Sat Jan 9 13:26:34 2021 +0800
exclude hive dependencies
commit 55ae7f025a5ffcec402919e28b7b3af5987dfe16
Author: Cheng Pan <379377944@qq.com>
Date: Sat Jan 9 01:08:09 2021 +0800
pin versions and excludes in <dependencyManagement>
commit 9ef84a5f62afd66fb4b817d593ba1b13ff8348ed
Author: Cheng Pan <379377944@qq.com>
Date: Sat Jan 9 14:12:04 2021 +0800
trigger kyuubi-spark-sql-engine package
commit d492e3fdce64e6554fe0db1d810c6f4bea198baa
Author: Cheng Pan <379377944@qq.com>
Date: Sat Jan 9 13:44:13 2021 +0800
trigger kyuubi-download
commit 050281b8fc400f3ae5fa1d43d56da49846664ea4
Author: Cheng Pan <379377944@qq.com>
Date: Sat Jan 9 15:30:58 2021 +0800
pin modules version in dependencyManagement
commit 1655fc453ded4626ae5e12e7b17af6f10c30a0dd
Author: Cheng Pan <379377944@qq.com>
Date: Fri Jan 8 19:45:27 2021 +0800
tune modules in alphabetical order
commit 7f3f4d987336d71d73eab059e93f3d008cfcd1a6
Author: Cheng Pan <379377944@qq.com>
Date: Sat Jan 9 00:09:49 2021 +0800
change dependencies scope to test
2021-01-09 23:30:46 +08:00
Kent Yao
6292b51ec8
Support launch SparkProcessBuilder with keytab and principal ( #269 )
...
* Support launch SparkProcessBuilder with keytab and principal
* fix tests
2021-01-08 23:43:14 +08:00
Cheng Pan
90c120759e
Improve pom.xml
...
fixes #268
Squashed commit of the following:
commit d40d0831d578af23559ea2a2544ceebc47f6df50
Author: Cheng Pan <379377944@qq.com>
Date: Fri Jan 8 18:30:51 2021 +0800
remove unused mockito
commit 386e7e4eb1c93006e302c41ffbc04d0acfaf9a9b
Author: Cheng Pan <379377944@qq.com>
Date: Fri Jan 8 17:35:44 2021 +0800
extract versions to properties
2021-01-08 19:04:48 +08:00
Kent Yao
4c433fc59a
Add SparkSQLEngineListener
2021-01-03 02:09:25 +08:00
Kent Yao
ca1b452e9a
Prepare Kyuubi v1.1.0
2020-12-31 15:51:12 +08:00
Kent Yao
17fe83778e
ServiceDiscovery for kyuubi servver
2020-12-28 13:05:35 +08:00
Kent Yao
a0f900a629
Reformat ServiceDiscovery
2020-12-28 00:10:31 +08:00
Kent Yao
3ec0db6a40
Improve Session Share Level
2020-12-27 00:05:07 +08:00
Zen
7a79b16cdf
fix #259 engine scope
...
Squashed commit of the following:
commit bb598b101da43b145bd4c95976e8decd39a02210
Merge: 54e730c c4cf523
Author: zen <xinjingziranchan@gmail.com>
Date: Thu Dec 24 10:53:42 2020 +0800
Merge remote-tracking branch 'origin/pr2-engine-scope' into pr2-engine-scope
# Conflicts:
# externals/kyuubi-spark-sql-engine/src/main/scala/org/apache/kyuubi/engine/spark/SparkSQLEngine.scala
commit 54e730c5b26ffb147e5c1266bdd036460cc20d82
Merge: 62d1575 512fbc5e8bc44c
2020-12-24 19:02:40 +08:00
Zen
512fbc50cf
Support Spark YARN cluster deployment mode fix #264
...
Squashed commit of the following:
commit 3c875db5dd245b4f978afec92e1d02ac831c94bf
Author: zen <xinjingziranchan@gmail.com>
Date: Wed Dec 23 19:51:22 2020 +0800
remove unnecessary code
commit c2487ee7ca4bb4271c7ae6a6263e32e040c4c159
Merge: 67bf250 d8e5c5a
2020-12-23 20:45:09 +08:00
Zen
e8bc44c2ad
[ #258 ] delete the engine's timeoutChecker scheduler and merge it to sessionManager's scheduler
...
fix #258
Squashed commit of the following:
commit 5b0a4d1f77b32cef00f55b80b8562752c1f462d7
Author: zen <xinjingziranchan@gmail.com>
Date: Wed Dec 16 10:15:16 2020 +0800
fix closing session log
commit c0fe24d06638f9be18d91a4ad05943a023967c62
Author: zen <xinjingziranchan@gmail.com>
Date: Sat Dec 12 22:08:25 2020 +0800
move this check task to SparkSQLSessionManager.
commit 1968913702872f0ba433679596596f114f2e16d1
Author: zen <xinjingziranchan@gmail.com>
Date: Thu Dec 10 15:55:32 2020 +0800
add log when close session
commit 26a944787c63666813a0d64e67a36b671640d493
Author: zen <xinjingziranchan@gmail.com>
Date: Thu Dec 10 11:32:45 2020 +0800
delete the engine's timeoutChecker scheduler and merge it to sessionManager's scheduler.
2020-12-21 11:01:31 +08:00
Kent Yao
5374398050
Stringlify exception for better client debugging
2020-11-27 22:20:51 +08:00
Kent Yao
87e243c596
support query log for async exec
2020-11-27 16:40:07 +08:00
Kent Yao
f8ef7c8997
Support ansynchronous exec for Kyuubi Server
2020-11-24 10:55:29 +08:00
Kent Yao
9ca23bcf20
Support ansynchronous exec for Spark SQL engine
2020-11-20 19:52:57 +08:00
Zen
6637c58273
followup [add SparkSQLEngine idle check] fix #251
...
Squashed commit of the following:
commit 808ccb738f8774e465d12dfb04a6d37256545e78
Author: Zen <xinjingziranchan@gmail.com>
Date: Wed Nov 18 14:18:46 2020 +0800
Fixed duplicate issues with the Jars directory when packaging Kyuubi
commit 91ca0a0f8a5a260b1ae29a31c323f69d37a14bfe
Author: zen <xinjingziranchan@gmail.com>
Date: Wed Nov 18 14:01:56 2020 +0800
fix log print and SparkSQLEngine timeoutChecker concurrent issue.
commit 15343d9cd07b48d3909c1085836687a4cc7f05c3
Author: zen <xinjingziranchan@gmail.com>
Date: Tue Nov 17 21:21:03 2020 +0800
消除打印dehug日志时，重复判断是否开启debug模式
commit eecc0bf01144b3f2601e6a821bedf786e5aafb22
Author: zen <xinjingziranchan@gmail.com>
Date: Tue Nov 17 15:08:13 2020 +0800
Revert "修复打包时kyuubi依赖jars目录重复，导致启动时找不到org.apache.kyuubi.server.KyuubiServer启动类"
This reverts commit 29e9dd45
commit 29e9dd45e90b1549b68e96024b1ee866429bf40d
Author: zen <xinjingziranchan@gmail.com>
Date: Tue Nov 17 14:36:23 2020 +0800
修复打包时kyuubi依赖jars目录重复，导致启动时找不到org.apache.kyuubi.server.KyuubiServer启动类
commit 44364ecd289ca40181bd150998cce76762b145be
Author: zen <xinjingziranchan@gmail.com>
Date: Tue Nov 17 13:48:21 2020 +0800
修复SparkSQLEngine停止时没有关闭timeoutChecker线程池，以及增加timeoutChecker打印日志
commit 63a67e2c487a5418a056ff4f797b46185ed4c17b
Merge: 6028f55 64b83a4fb4bace7bfc470#1 from yaooqinn/master
同步更新
2020-11-18 16:41:43 +08:00
zen
7fd225b098
add SparkSQLEngine idle check
...
fix #250
Squashed commit of the following:
commit 6028f55504cbc3d522bf061fde71608019243d3e
Author: 金晶(000538) <jinjing@fcbox.com>
Date: Mon Nov 16 16:26:09 2020 +0800
测试代码SparkOperationSuite格式调整
commit 0b14c69183691e3601aef3a9d56c545edef44499
Author: 金晶(000538) <jinjing@fcbox.com>
Date: Mon Nov 16 14:49:42 2020 +0800
1.新增SparkSQLEngine空闲定时检测任务
2.修复SparkSQLEngine关闭session时未移除SparkSQLOperationManager中缓存的sparkSession
commit 8fdb6b7cec70f32dc05bfeeedcc233d0f6fb4017
Merge: fb4bace7bfc470#1 from yaooqinn/master
同步更新
2020-11-16 19:28:33 +08:00
Kent Yao
b3d996917d
fix static and core conf via hiveconf or hivevar
2020-11-13 16:08:47 +08:00
Kent Yao
fb4bace6a5
Ignore static and other unmodifiable settting in session
2020-11-11 11:15:09 +08:00
Kent Yao
574c119712
JDBCTests added and some related bugs fixed
2020-11-10 21:24:02 +08:00
Kent Yao
a67d485951
Missing version in readMessageBegin, old client
...
2020-11-10 10:15:42,001 [61208289] - ERROR [FrontendServiceHandler-Pool: Thread-449:TThreadPoolServer$WorkerProcess@315] - Thrift error occurred during processing of message.
org.apache.thrift.protocol.TProtocolException: Missing version in readMessageBegin, old client?
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:234)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:27)
at org.apache.kyuubi.service.authentication.TSetIpAddressProcessor.process(TSetIpAddressProcessor.scala:36)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:310)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2020-11-10 17:21:17 +08:00
Kent Yao
f8dc5a9ca3
Using ha.zookeeper.acl.enabled to control ZK acl
2020-11-09 17:34:55 +08:00
Kent Yao
7157370ef6
Add Building Doc
2020-11-05 19:05:26 +08:00
Kent Yao
642b52e965
nit
2020-10-30 16:04:20 +08:00
Kent Yao
6efa589a74
FrontendServiceSuite
2020-10-21 20:22:42 +08:00
Kent Yao
53b3fdb616
OperationStatus
2020-10-21 16:06:38 +08:00
Kent Yao
0849678453
Hive JDBC Database MetaData API Auditing
2020-10-20 18:08:28 +08:00
Kent Yao
6ad06f66e9
UtilsSuite
2020-10-16 15:21:35 +08:00
Kent Yao
e7a1054fd2
fix work dir bug
2020-10-14 14:59:49 +08:00
Kent Yao
5d1ea8547a
Make SparkSQLEngine be able to self teminate
2020-10-13 20:49:54 +08:00
Kent Yao
396e06a3bb
nit
2020-09-29 10:11:34 +08:00
Kent Yao
f60a6d37a7
log time cost for operation
2020-09-24 16:47:22 +08:00
Kent Yao
ff7a1221e0
handle client ip properly
2020-09-24 11:59:55 +08:00
Kent Yao
f8b8c6c172
Print spark engine dignosis at client side
2020-09-23 17:41:51 +08:00
Kent Yao
c673235a42
finish cancel operation test
2020-09-22 18:00:58 +08:00
Kent Yao
efa78a92f1
improve get schemas test
2020-09-22 17:43:41 +08:00
Kent Yao
470d7ca90d
Make man service work
2020-09-21 14:05:34 +08:00
Kent Yao
07204dbef5
add test for close and cancel operation
2020-09-15 14:36:02 +08:00
Kent Yao
d8a27c914f
spark-sql-engine: enable session configuration
2020-09-14 18:05:08 +08:00
Kent Yao
07c9d9578d
style
2020-09-14 10:59:47 +08:00
Kent Yao
31cbee72ef
add some test for execute statement operation
2020-09-11 19:28:38 +08:00
Kent Yao
f7a5549f6c
refine SparkProcessBuilder
2020-09-11 16:22:39 +08:00
Kent Yao
bd536cd9c5
Remove KyuubiThriftBinaryCliService
2020-09-10 21:05:21 +08:00
Kent Yao
4ee3577944
improve test for operation log
2020-09-10 18:22:48 +08:00
Kent Yao
13706c3c3a
improve test for operation log
2020-09-10 16:59:57 +08:00
Kent Yao
ee315c6963
fix test
2020-09-10 14:09:36 +08:00
Kent Yao
59b7c3a09e
add more tests
2020-09-10 12:01:58 +08:00
Kent Yao
83d1ab7450
bump up spark to 3.0.1
2020-09-10 10:58:52 +08:00
Kent Yao
01d50d3ec7
add tests for meta operations
2020-09-09 16:15:45 +08:00
Kent Yao
42e92e41b6
add test for get null column
2020-09-09 11:25:18 +08:00
Kent Yao
0a43b82400
fix GetColumns
2020-09-09 10:06:15 +08:00
Kent Yao
46d6dda3f3
Improve spark sql engine test
2020-09-08 21:19:21 +08:00
Kent Yao
06178e52fe
KyuubiServer Part 1
2020-09-08 14:45:40 +08:00
Kent Yao
e8ab5ab4a0
Some build staff
2020-08-21 14:39:33 +08:00
Kent Yao
0468fd4d4e
Implementaton of KyuubiOperationManager
2020-08-21 10:51:55 +08:00
Kent Yao
86e1a7aac3
SparkProcessBuilder
2020-08-18 17:22:08 +08:00
