yangrong688
03ba80dbcd
[KYUUBI #434 ] [DOCS] Rename BONDED_EXPONENTIAL_BACKOFF to BOUNDED_EXPONENTIAL_BACKOFF
...
 [](https://github.com/yaooqinn/kyuubi/pull/434 )       [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
change BONDED_EXPONENTIAL_BACKOFF to BOUNDED_EXPONENTIAL_BACKOFF
Closes #434 from yangrong688/master.
492ceb9 [yangrong688] fix typo
8bd6809 [yangrong688] fix typo
Authored-by: yangrong688 <yangrong.jxufe@gmail.com>
Signed-off-by: Kent Yao <yao@apache.org>
2021-03-15 11:45:12 +08:00
yangrong688
9600f8371c
[KYUUBI #431 ] [DOCS] Fix typo
...
 [](https://github.com/yaooqinn/kyuubi/pull/431 )       [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
change anther to another
Closes #431 from yangrong688/master.
981ad55 [yangrong688] fix typo
Authored-by: yangrong688 <yangrong.jxufe@gmail.com>
Signed-off-by: Cheng Pan <379377944@qq.com>
2021-03-13 23:14:30 +08:00
yangrong688
dfca811cc9
[KYUUBI #355 ] Update Kyuubi HA Guide to latest configuration parameters
...
 [](https://github.com/yaooqinn/kyuubi/pull/355 )       [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
Update HA doc to latest configuration parameters.
Closes #355 from yangrong688/master.
f1fa119 [yangrong688] copy ha configurations from settings.md and update related
4c94a33 [yangrong688] Merge branch 'master' of https://github.com/yaooqinn/kyuubi
d0889a0 [yangrong688] update ha related configuration parameter from zk to zookeeper
Authored-by: yangrong688 <yangrong.jxufe@gmail.com>
Signed-off-by: Kent Yao <yao@apache.org>
2021-03-11 11:46:46 +08:00
ulysses-you
3eefea6d76
[KYUUBI #410 ] Add Spark-3.1 trouble shooting
...
 [](https://github.com/yaooqinn/kyuubi/pull/409 )     [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues , add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the use case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
More details could see the config `spark.sql.legacy.setCommandRejectsSparkCoreConfs`
### _How was this patch tested?_
Closes #409 from ulysses-you/spark-3-1-trouble-shooting.
e4bc899 [ulysses-you] fix
d6e1903 [ulysses-you] init
Authored-by: ulysses-you <ulyssesyou18@gmail.com>
Signed-off-by: Kent Yao <yao@apache.org>
2021-03-09 17:54:15 +08:00
Kent Yao
183e18f1bc
[KYUUBI #404 ] How To Use Spark Dynamic Resource Allocation (DRA) in Kyuubi
...
 [](https://github.com/yaooqinn/kyuubi/pull/404 )     [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues , add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the use case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #404 from yaooqinn/dra.
b8b755c [Kent Yao] How To Use Spark Dynamic Resource Allocation (DRA) in Kyuubi
9bb47b1 [Kent Yao] How To Use Spark Dynamic Resource Allocation (DRA) in Kyuubi
e786787 [Kent Yao] How To Use Spark Dynamic Resource Allocation (DRA) in Kyuubi
Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
2021-03-08 18:27:49 +08:00
Cheng Pan
e49ff88305
[KYUUBI #390 ] Replace abbr in doc
...
 [](https://github.com/yaooqinn/kyuubi/pull/390 )      [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues , add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the use case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #390 from pan3793/doc.
4b7cdf2 [Cheng Pan] replace abbr in doc
Authored-by: Cheng Pan <379377944@qq.com>
Signed-off-by: Kent Yao <yao@apache.org>
2021-03-03 22:04:32 +08:00
Kent Yao
f83faa8356
[KYUUBI #389 ] Bump up curator to 2.12.0
...
 [](https://github.com/yaooqinn/kyuubi/pull/389 )      [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues , add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the use case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
2.12.0 is the last update for curator-test to support zk v3.4.x
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #389 from yaooqinn/curator.
0b12323 [Kent Yao] Bump up curator to 2.12.0
Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Cheng Pan <379377944@qq.com>
2021-03-03 19:37:59 +08:00
Kent Yao
3d0f050034
[KYUUBI #388 ] How To Use Spark Adaptive Query Execution (AQE) in Kyuubi
...
 [](https://github.com/yaooqinn/kyuubi/pull/388 )     [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues , add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the use case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
User guide
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #388 from yaooqinn/aqe.
dc2833f [Kent Yao] How To Use Spark Adaptive Query Execution (AQE) in Kyuubi
Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
2021-03-03 13:55:52 +08:00
Kent Yao
0f62568171
[KYUUBI #379 ] Improve engine log capture
...
 [](https://github.com/yaooqinn/kyuubi/pull/379 )     [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues , add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the use case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
1. limit error size with `kyuubi.session.engine.startup.error.max.size` to reduce long time pause or heap overhead
2. update `error` immediately when detecting errors at the very first line ASAP
3. Using `Exception:` instead of `Exception` to search each line to filter better
4. add the engine log address in the exception message in case of error bootstraping
### _How was this patch tested?_
- [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #379 from yaooqinn/logsize.
7cf58da [Kent Yao] mute in console
b58a3a2 [Kent Yao] update
fbc4a0b [Kent Yao] update
0815f77 [Kent Yao] log
93f5f2f [Kent Yao] log
Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
2021-02-26 17:31:44 +08:00
Kent Yao
4b13f1c551
[KYUUBI #367 ] Engine terminating checker should start after exposed
...
 [](https://github.com/yaooqinn/kyuubi/pull/367 )      [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues , add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the use case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
Currently, the engine starts to check its lifecycle during the session manager's startup without any initial delay. Before the engine gets ready finally, it might trigger self-terminating.
In this PR, we move the checker to the end where the engine is exposed to the servers.
Avoiding errors like:
```
org.apache.hive.service.cli.HiveSQLException: Error operating GET_CATALOGS: java.net.SocketException: Connection reset
at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:267)
at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:258)
at org.apache.hive.jdbc.HiveDatabaseMetaData.getCatalogs(HiveDatabaseMetaData.java:142)
at org.apache.kyuubi.operation.BasicIcebergJDBCTests.$anonfun$$init$$2(BasicIcebergJDBCTests.scala:50)
at org.apache.kyuubi.operation.BasicIcebergJDBCTests.$anonfun$$init$$2$adapted(BasicIcebergJDBCTests.scala:48)
at org.apache.kyuubi.operation.JDBCTestUtils.$anonfun$withMultipleConnectionJdbcStatement$3(JDBCTestUtils.scala:43)
at org.apache.kyuubi.operation.JDBCTestUtils.$anonfun$withMultipleConnectionJdbcStatement$3$adapted(JDBCTestUtils.scala:43)
at scala.collection.mutable.ResizableArray.foreach(ResizableArray.scala:62)
at scala.collection.mutable.ResizableArray.foreach$(ResizableArray.scala:55)
at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:49)
```
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #367 from yaooqinn/engine.
f6a979e [Kent Yao] fix test
9cc561c [Kent Yao] address comment
3d15ab2 [Kent Yao] nit
a85d2e0 [Kent Yao] Engine terminating checker should start after exposed
Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
2021-02-25 15:10:43 +08:00
ulysses-you
6a4697019c
[KYUUBI #339 ] Add JDK8 bug troubleshootint
...
 [](https://github.com/yaooqinn/kyuubi/pull/339 )      [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues , add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the use case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
Help user to find the resolution.
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #339 from ulysses-you/jdk8-bug.
b25a629 [ulysses-you] init
Authored-by: ulysses-you <ulyssesyou18@gmail.com>
Signed-off-by: Kent Yao <yao@apache.org>
2021-02-02 18:05:37 +08:00
jhx1008
e5dbfe9e8e
[KYUUBI #326 ] Remove outdated deployment guide
...
 [](https://github.com/yaooqinn/kyuubi/pull/326 )      [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues , add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the use case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
the deployment guide is outdated
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #326 from yaooqinn/rmdeploydoc.
7d5393a [Kent Yao] Remove outdated deployment guide
Lead-authored-by: jhx1008 <jhx1008@gmail.com>
Co-authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-30 14:57:38 +08:00
jhx1008
ecd1c0e1a6
[KYUUBI #323 ] Fix Kyuubi conf template
...
 [](https://github.com/yaooqinn/kyuubi/pull/323 )     [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines:
https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->
### _Which issue are you going to fix?_
<!--
Replace ${ID} below with the actual issue id from
https://github.com/yaooqinn/kyuubi/issues ,
so that the issue will be linked and automatically closed after merging
-->
Fixes #${ID}
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the user case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
the Hadoop conf can not be recognized in `kyuubi-defaulfs.conf`, use HADOOP_CONF_DIR instead
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
Closes #323 from yaooqinn/conf.
a5f8a66 [Kent Yao] nit
7ef0046 [jhx1008] Fix Kyuubi conf template
Lead-authored-by: jhx1008 <jhx1008@gmail.com>
Co-authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
2021-01-30 13:36:45 +08:00
ulysses-you
6dd78652d8
[KYUUBI #284 ] Sesson submit log should be overwritten
...
fixes #284
We will create and write a log during submit a new session (like spark-submit) but we don't delete or overwrite it. This PR aims to add a time config to decide if we need to overwrite a session submit log.
The log path template is `KYUUBI_WORD_DIR/user/$engine-log.$index`. We will increase the `index` automatically if a user create some session concurrently.
After this PR. The log path template is `KYUUBI_WORD_DIR/user/$engine.log.$index`.
Squashed commit of the following:
commit 7794406098df0a3129ccd2ab04a445d2155bef8e
Author: ulysses-you <ulyssesyou18@gmail.com>
Date: Thu Jan 14 19:52:10 2021 +0800
fix
commit 13fd3bbb577c8bdad0ef73851262344d2870fd4d
Author: ulysses-you <ulyssesyou18@gmail.com>
Date: Thu Jan 14 19:02:36 2021 +0800
fix docs
commit 82c192bc6bccf749f7d7232ed4f03f3c0a56c65f
Author: ulysses-you <ulyssesyou18@gmail.com>
Date: Thu Jan 14 18:04:50 2021 +0800
fix
commit 134ea4389b0b9fddc777c79b1a9f43fc59ec3f7e
Author: ulysses-you <ulyssesyou18@gmail.com>
Date: Thu Jan 14 17:20:55 2021 +0800
docs
commit 921ac11b27c028c508e834b88f9f9d9e17eb104a
Author: ulysses-you <ulyssesyou18@gmail.com>
Date: Thu Jan 14 17:16:09 2021 +0800
fix config
commit bfcbd9633a18e9a4cf0b5b2308855ad8af7f7efd
Author: ulysses-you <ulyssesyou18@gmail.com>
Date: Thu Jan 14 16:36:00 2021 +0800
prefix
commit bceb8c59cbd7d7757b2c30058f845fa1e3c7ee9d
Author: ulysses-you <ulyssesyou18@gmail.com>
Date: Thu Jan 14 16:14:20 2021 +0800
doc
commit 4dd556333c7e6e8181f595293bb3877473c00ee7
Author: ulysses-you <ulyssesyou18@gmail.com>
Date: Thu Jan 14 16:11:00 2021 +0800
init
2021-01-14 20:42:11 +08:00
Cheng Pan
57ec15d09e
[MINOR] fix typo
...
fixes #277
Squashed commit of the following:
commit 291cb2c9baaf4072689231a9534c41a5eafd9a7e
Author: Cheng Pan <379377944@qq.com>
Date: Tue Jan 12 23:42:47 2021 +0800
update doc
commit 9f706c49f6c59d67c64d93c197cc963217636444
Author: Cheng Pan <379377944@qq.com>
Date: Tue Jan 12 22:04:30 2021 +0800
[MINOR] fix typo
2021-01-13 11:25:19 +08:00
Kent Yao
d70aec651d
Spark Conf temp
2020-12-31 15:02:21 +08:00
Kent Yao
ad9c0562ad
Kyuubi Architecture documentation
2020-12-29 16:13:07 +08:00
Kent Yao
3ec0db6a40
Improve Session Share Level
2020-12-27 00:05:07 +08:00
Kent Yao
d357203b0e
Add authentication guide
2020-11-30 17:45:20 +08:00
Kent Yao
87e243c596
support query log for async exec
2020-11-27 16:40:07 +08:00
Kent Yao
575e9c9599
Add support for user defaults
2020-11-25 21:37:25 +08:00
Kent Yao
f8ef7c8997
Support ansynchronous exec for Kyuubi Server
2020-11-24 10:55:29 +08:00
Kent Yao
9ca23bcf20
Support ansynchronous exec for Spark SQL engine
2020-11-20 19:52:57 +08:00
Kent Yao
f5900b052f
reorder doc
2020-11-19 11:32:29 +08:00
Kent Yao
91d0ce302e
add HADOOP_CONF_DIR to classpath
2020-11-19 00:30:25 +08:00
Kent Yao
ea1431b162
[DOC] Integration w/ Hive Metastore
2020-11-18 16:37:21 +08:00
Kent Yao
64b83a48c5
Show possible error even timeout
2020-11-16 22:56:25 +08:00
Kent Yao
15820a2b09
fix
2020-11-16 19:42:06 +08:00
Kent Yao
b3d996917d
fix static and core conf via hiveconf or hivevar
2020-11-13 16:08:47 +08:00
Kent Yao
4396e59abe
Add doc for overview
2020-11-13 14:17:42 +08:00
Kent Yao
fb4bace6a5
Ignore static and other unmodifiable settting in session
2020-11-11 11:15:09 +08:00
Kent Yao
574c119712
JDBCTests added and some related bugs fixed
2020-11-10 21:24:02 +08:00
Kent Yao
a67d485951
Missing version in readMessageBegin, old client
...
2020-11-10 10:15:42,001 [61208289] - ERROR [FrontendServiceHandler-Pool: Thread-449:TThreadPoolServer$WorkerProcess@315] - Thrift error occurred during processing of message.
org.apache.thrift.protocol.TProtocolException: Missing version in readMessageBegin, old client?
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:234)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:27)
at org.apache.kyuubi.service.authentication.TSetIpAddressProcessor.process(TSetIpAddressProcessor.scala:36)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:310)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2020-11-10 17:21:17 +08:00
Kent Yao
f8dc5a9ca3
Using ha.zookeeper.acl.enabled to control ZK acl
2020-11-09 17:34:55 +08:00
Kent Yao
56ead65496
Add Trouble Shooting with a HADOOP_CONF_DIR case
2020-11-06 19:40:23 +08:00
Kent Yao
92e3d6d443
FIX org.apache.kyuubi.config.KyuubiConf#toSparkPrefixedConf
...
/**
* This method is used to convert kyuubi configs to configs that Spark could identify.
* - If the key is start with `spark.`, keep it AS IS as it is a Spark Conf
* - If the key is start with `hadoop.`, it will be prefixed with `spark.hadoop.`
* - Otherwise, the key will be added a `spark.` prefix
* @return a map with spark specified configs
*/
2020-11-06 14:37:40 +08:00
Kent Yao
7e1f6ef7ec
Add Trouble Shooting with a UnsupportedClassVersionError case
2020-11-06 11:40:25 +08:00
Kent Yao
7157370ef6
Add Building Doc
2020-11-05 19:05:26 +08:00
