5526898f7b
<!-- Thanks for sending a pull request! Here are some tips for you: 1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html 2. If the PR is related to an issue in https://github.com/apache/incubator-kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'. 3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'. --> ### _Why are the changes needed?_ <!-- Please clarify why the changes are needed. For instance, 1. If you add a feature, you can talk about the use case of it. 2. If you fix a bug, you can clarify why it is a bug. --> ### 1. Describe the feature Kyuubi use `TestingServer` as the EmbeddedZookeeper service in codebase, and require many args to init the service. These `electionPort`, `quorumPort`, `serverId` parameters only work in cluster mode, these ports are not bound to the host. From hadoop and bookkeeper project, they use `ZooKeeperServer` as a built-in zk service, especially the bookeeper project. - https://github.com/apache/hadoop/blob/trunk/hadoop-common-project/hadoop-registry/src/main/java/org/apache/hadoop/registry/server/services/MicroZookeeperService.java - https://github.com/apache/bookkeeper/blob/master/bookkeeper-server/src/main/java/org/apache/bookkeeper/shims/zk/ZooKeeperServerShimImpl.java ### 2. Describe the solution Improve - Remove `electionPort`, `quorumPort`, `serverId` which are nerver be used, hadoop and bookkeer do the same - Replace `TestingServer` with `ZooKeeperServer` - Remove `curator-test` dependency ### 3. `deleteDataDirectoryOnClose` The name style for `deleteDataDirectoryOnClose` option, refer to hadoop `core-default.xml` https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-common/core-default.xml ``` hadoop.security.dns.log-slow-lookups.enabled hadoop.security.dns.log-slow-lookups.threshold.ms dfs.client.block.write.replace-datanode-on-failure.policy ``` ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request Closes #907 from timothy65535/ky-894. Closes #894 7d7fde9f [timothy65535] remove useless config ce06a0fd [timothy65535] limit travis build only master branch ff825c3f [timothy65535] revert deleteDataDirectoryOnClose config a336544a [timothy65535] remove javassist 3da0bd55 [timothy65535] remove javassist 0abb44df [timothy65535] [KYUUBI #894] Enhance kyuubi-zookeeper module Authored-by: timothy65535 <timothy65535@163.com> Signed-off-by: ulysses-you <ulyssesyou18@gmail.com>
58 lines
2.7 KiB
Plaintext
58 lines
2.7 KiB
Plaintext
#
|
|
# Licensed to the Apache Software Foundation (ASF) under one or more
|
|
# contributor license agreements. See the NOTICE file distributed with
|
|
# this work for additional information regarding copyright ownership.
|
|
# The ASF licenses this file to You under the Apache License, Version 2.0
|
|
# (the "License"); you may not use this file except in compliance with
|
|
# the License. You may obtain a copy of the License at
|
|
#
|
|
# http://www.apache.org/licenses/LICENSE-2.0
|
|
#
|
|
# Unless required by applicable law or agreed to in writing, software
|
|
# distributed under the License is distributed on an "AS IS" BASIS,
|
|
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
|
|
# See the License for the specific language governing permissions and
|
|
# limitations under the License.
|
|
#
|
|
|
|
commons-codec/1.15//commons-codec-1.15.jar
|
|
commons-lang3/3.10//commons-lang3-3.10.jar
|
|
curator-client/2.12.0//curator-client-2.12.0.jar
|
|
curator-framework/2.12.0//curator-framework-2.12.0.jar
|
|
curator-recipes/2.12.0//curator-recipes-2.12.0.jar
|
|
failureaccess/1.0.1//failureaccess-1.0.1.jar
|
|
guava/30.1-jre//guava-30.1-jre.jar
|
|
hadoop-client-api/3.2.2//hadoop-client-api-3.2.2.jar
|
|
hadoop-client-runtime/3.2.2//hadoop-client-runtime-3.2.2.jar
|
|
hive-service-rpc/2.3.7//hive-service-rpc-2.3.7.jar
|
|
htrace-core4/4.1.0-incubating//htrace-core4-4.1.0-incubating.jar
|
|
jackson-annotations/2.11.4//jackson-annotations-2.11.4.jar
|
|
jackson-core/2.11.4//jackson-core-2.11.4.jar
|
|
jackson-databind/2.11.4//jackson-databind-2.11.4.jar
|
|
jakarta.servlet-api/4.0.4//jakarta.servlet-api-4.0.4.jar
|
|
jaxb-api/2.2.11//jaxb-api-2.2.11.jar
|
|
jcl-over-slf4j/1.7.30//jcl-over-slf4j-1.7.30.jar
|
|
jetty-http/9.4.41.v20210516//jetty-http-9.4.41.v20210516.jar
|
|
jetty-io/9.4.41.v20210516//jetty-io-9.4.41.v20210516.jar
|
|
jetty-security/9.4.41.v20210516//jetty-security-9.4.41.v20210516.jar
|
|
jetty-server/9.4.41.v20210516//jetty-server-9.4.41.v20210516.jar
|
|
jetty-servlet/9.4.41.v20210516//jetty-servlet-9.4.41.v20210516.jar
|
|
jetty-util-ajax/9.4.41.v20210516//jetty-util-ajax-9.4.41.v20210516.jar
|
|
jetty-util/9.4.41.v20210516//jetty-util-9.4.41.v20210516.jar
|
|
libfb303/0.9.3//libfb303-0.9.3.jar
|
|
libthrift/0.9.3//libthrift-0.9.3.jar
|
|
log4j/1.2.17//log4j-1.2.17.jar
|
|
metrics-core/4.1.1//metrics-core-4.1.1.jar
|
|
metrics-jmx/4.1.1//metrics-jmx-4.1.1.jar
|
|
metrics-json/4.1.1//metrics-json-4.1.1.jar
|
|
metrics-jvm/4.1.1//metrics-jvm-4.1.1.jar
|
|
scala-library/2.12.14//scala-library-2.12.14.jar
|
|
scopt_2.12/4.0.1//scopt_2.12-4.0.1.jar
|
|
simpleclient/0.10.0//simpleclient-0.10.0.jar
|
|
simpleclient_common/0.10.0//simpleclient_common-0.10.0.jar
|
|
simpleclient_dropwizard/0.10.0//simpleclient_dropwizard-0.10.0.jar
|
|
simpleclient_servlet/0.10.0//simpleclient_servlet-0.10.0.jar
|
|
slf4j-api/1.7.30//slf4j-api-1.7.30.jar
|
|
slf4j-log4j12/1.7.30//slf4j-log4j12-1.7.30.jar
|
|
zookeeper/3.4.14//zookeeper-3.4.14.jar
|