apache/kyuubi
1
0
Fork 0
Code Issues Pull Requests Actions 5 Packages Projects Releases Wiki Activity
8dddfeb0af
kyuubi/dev/dependencyList
zwangsheng 3bc299d01e
[KYUUBI #2868] [K8S] Add KubernetesApplicationOperation 
### _Why are the changes needed?_

close #2868
Add Kubernetes Application Operation.
Help Tag Spark Driver with Engine Ref Id.

1) Find taged Engine:
`KyuubiApplicationManager => KubernetesApplicationOperation =(doesn't found taged pod)=> KubernetesApplicationOperation#JpsApplicationOperation`

2) `SparkBatchProcessBuilder` add logic to help tag Kubernetes Engine Tag.

3) Add Unit Test help to check `KubernetesApplicationOperation` find & kill  Spark Engine On Kubernetes with both client mode and cluster mode.

### _How was this patch tested?_
- [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [ ] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests) locally before make a pull request

Closes #2869 from zwangsheng/feature/k8s-application-operation.

Closes #2868

04c97210 [zwangsheng] remove
fc151603 [zwangsheng] fix kyuubi on kubernetes integration test
29a3da52 [zwangsheng] fix
f43f0989 [zwangsheng] fix
2f2c9581 [zwangsheng] test
209dd65d [zwangsheng] fix jps
e12c681c [zwangsheng] fix tag
80971f98 [zwangsheng] fix
0760b63d [zwangsheng] fix
087eadb1 [zwangsheng] fix
d4989b09 [zwangsheng] try
93d83f81 [zwangsheng] add test
19378da4 [zwangsheng] fix style
63007261 [zwangsheng] fix test
fd4bf714 [zwangsheng] fix
66fc902b [zwangsheng] Using jps for client
2a1b797f [zwangsheng] fix setting
4827c459 [zwangsheng] fix
9ee90da6 [zwangsheng] decoupling spark
6b5831da [zwangsheng] useless driver label
f9ca898c [zwangsheng] fix
2add72fe [zwangsheng] fix setting
aaa081f8 [zwangsheng] fix style & dependency list
e102ac73 [zwangsheng] add kubernetesApplicationOperation

Authored-by: zwangsheng <2213335496@qq.com>
Signed-off-by: ulysses-you <ulyssesyou@apache.org>
2022-07-01 12:15:12 +08:00

153 lines
8.4 KiB
Plaintext
Raw Blame History

#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
HikariCP/4.0.3//HikariCP-4.0.3.jar
aopalliance-repackaged/2.6.1//aopalliance-repackaged-2.6.1.jar
automaton/1.11-8//automaton-1.11-8.jar
classgraph/4.8.95//classgraph-4.8.95.jar
commons-codec/1.15//commons-codec-1.15.jar
commons-collections/3.2.2//commons-collections-3.2.2.jar
commons-lang/2.6//commons-lang-2.6.jar
commons-lang3/3.10//commons-lang3-3.10.jar
commons-logging/1.1.3//commons-logging-1.1.3.jar
curator-client/2.12.0//curator-client-2.12.0.jar
curator-framework/2.12.0//curator-framework-2.12.0.jar
curator-recipes/2.12.0//curator-recipes-2.12.0.jar
derby/10.14.2.0//derby-10.14.2.0.jar
fliptables/1.0.2//fliptables-1.0.2.jar
generex/1.0.2//generex-1.0.2.jar
guava/30.1-jre//guava-30.1-jre.jar
hadoop-client-api/3.3.1//hadoop-client-api-3.3.1.jar
hadoop-client-runtime/3.3.1//hadoop-client-runtime-3.3.1.jar
hive-common/3.1.3//hive-common-3.1.3.jar
hive-metastore/3.1.3//hive-metastore-3.1.3.jar
hive-serde/3.1.3//hive-serde-3.1.3.jar
hive-service-rpc/3.1.3//hive-service-rpc-3.1.3.jar
hive-shims-0.23/3.1.3//hive-shims-0.23-3.1.3.jar
hive-shims-common/3.1.3//hive-shims-common-3.1.3.jar
hive-standalone-metastore/3.1.3//hive-standalone-metastore-3.1.3.jar
hive-storage-api/2.7.0//hive-storage-api-2.7.0.jar
hk2-api/2.6.1//hk2-api-2.6.1.jar
hk2-locator/2.6.1//hk2-locator-2.6.1.jar
hk2-utils/2.6.1//hk2-utils-2.6.1.jar
htrace-core4/4.1.0-incubating//htrace-core4-4.1.0-incubating.jar
httpclient/4.5.13//httpclient-4.5.13.jar
httpcore/4.4.13//httpcore-4.4.13.jar
jackson-annotations/2.13.3//jackson-annotations-2.13.3.jar
jackson-core/2.13.3//jackson-core-2.13.3.jar
jackson-databind/2.13.3//jackson-databind-2.13.3.jar
jackson-dataformat-yaml/2.13.3//jackson-dataformat-yaml-2.13.3.jar
jackson-datatype-jsr310/2.13.3//jackson-datatype-jsr310-2.13.3.jar
jackson-jaxrs-base/2.13.3//jackson-jaxrs-base-2.13.3.jar
jackson-jaxrs-json-provider/2.13.3//jackson-jaxrs-json-provider-2.13.3.jar
jackson-module-jaxb-annotations/2.13.3//jackson-module-jaxb-annotations-2.13.3.jar
jackson-module-scala_2.12/2.13.3//jackson-module-scala_2.12-2.13.3.jar
jakarta.activation-api/1.2.1//jakarta.activation-api-1.2.1.jar
jakarta.annotation-api/1.3.5//jakarta.annotation-api-1.3.5.jar
jakarta.inject/2.6.1//jakarta.inject-2.6.1.jar
jakarta.servlet-api/4.0.4//jakarta.servlet-api-4.0.4.jar
jakarta.validation-api/2.0.2//jakarta.validation-api-2.0.2.jar
jakarta.ws.rs-api/2.1.6//jakarta.ws.rs-api-2.1.6.jar
jakarta.xml.bind-api/2.3.2//jakarta.xml.bind-api-2.3.2.jar
javassist/3.25.0-GA//javassist-3.25.0-GA.jar
jcl-over-slf4j/1.7.35//jcl-over-slf4j-1.7.35.jar
jersey-client/2.35//jersey-client-2.35.jar
jersey-common/2.35//jersey-common-2.35.jar
jersey-container-servlet-core/2.35//jersey-container-servlet-core-2.35.jar
jersey-entity-filtering/2.35//jersey-entity-filtering-2.35.jar
jersey-hk2/2.35//jersey-hk2-2.35.jar
jersey-media-json-jackson/2.35//jersey-media-json-jackson-2.35.jar
jersey-server/2.35//jersey-server-2.35.jar
jetty-http/9.4.41.v20210516//jetty-http-9.4.41.v20210516.jar
jetty-io/9.4.41.v20210516//jetty-io-9.4.41.v20210516.jar
jetty-security/9.4.41.v20210516//jetty-security-9.4.41.v20210516.jar
jetty-server/9.4.41.v20210516//jetty-server-9.4.41.v20210516.jar
jetty-servlet/9.4.41.v20210516//jetty-servlet-9.4.41.v20210516.jar
jetty-util-ajax/9.4.41.v20210516//jetty-util-ajax-9.4.41.v20210516.jar
jetty-util/9.4.41.v20210516//jetty-util-9.4.41.v20210516.jar
jline/0.9.94//jline-0.9.94.jar
kubernetes-client/5.12.1//kubernetes-client-5.12.1.jar
kubernetes-model-admissionregistration/5.12.1//kubernetes-model-admissionregistration-5.12.1.jar
kubernetes-model-apiextensions/5.12.1//kubernetes-model-apiextensions-5.12.1.jar
kubernetes-model-apps/5.12.1//kubernetes-model-apps-5.12.1.jar
kubernetes-model-autoscaling/5.12.1//kubernetes-model-autoscaling-5.12.1.jar
kubernetes-model-batch/5.12.1//kubernetes-model-batch-5.12.1.jar
kubernetes-model-certificates/5.12.1//kubernetes-model-certificates-5.12.1.jar
kubernetes-model-common/5.12.1//kubernetes-model-common-5.12.1.jar
kubernetes-model-coordination/5.12.1//kubernetes-model-coordination-5.12.1.jar
kubernetes-model-core/5.12.1//kubernetes-model-core-5.12.1.jar
kubernetes-model-discovery/5.12.1//kubernetes-model-discovery-5.12.1.jar
kubernetes-model-events/5.12.1//kubernetes-model-events-5.12.1.jar
kubernetes-model-extensions/5.12.1//kubernetes-model-extensions-5.12.1.jar
kubernetes-model-flowcontrol/5.12.1//kubernetes-model-flowcontrol-5.12.1.jar
kubernetes-model-metrics/5.12.1//kubernetes-model-metrics-5.12.1.jar
kubernetes-model-networking/5.12.1//kubernetes-model-networking-5.12.1.jar
kubernetes-model-node/5.12.1//kubernetes-model-node-5.12.1.jar
kubernetes-model-policy/5.12.1//kubernetes-model-policy-5.12.1.jar
kubernetes-model-rbac/5.12.1//kubernetes-model-rbac-5.12.1.jar
kubernetes-model-scheduling/5.12.1//kubernetes-model-scheduling-5.12.1.jar
kubernetes-model-storageclass/5.12.1//kubernetes-model-storageclass-5.12.1.jar
libfb303/0.9.3//libfb303-0.9.3.jar
libthrift/0.9.3//libthrift-0.9.3.jar
log4j-1.2-api/2.17.2//log4j-1.2-api-2.17.2.jar
log4j-api/2.17.2//log4j-api-2.17.2.jar
log4j-core/2.17.2//log4j-core-2.17.2.jar
log4j-slf4j-impl/2.17.2//log4j-slf4j-impl-2.17.2.jar
logging-interceptor/3.12.12//logging-interceptor-3.12.12.jar
metrics-core/4.2.8//metrics-core-4.2.8.jar
metrics-jmx/4.2.8//metrics-jmx-4.2.8.jar
metrics-json/4.2.8//metrics-json-4.2.8.jar
metrics-jvm/4.2.8//metrics-jvm-4.2.8.jar
netty-all/4.1.73.Final//netty-all-4.1.73.Final.jar
netty-buffer/4.1.73.Final//netty-buffer-4.1.73.Final.jar
netty-codec/4.1.73.Final//netty-codec-4.1.73.Final.jar
netty-common/4.1.73.Final//netty-common-4.1.73.Final.jar
netty-handler/4.1.73.Final//netty-handler-4.1.73.Final.jar
netty-resolver/4.1.73.Final//netty-resolver-4.1.73.Final.jar
netty-tcnative-classes/2.0.46.Final//netty-tcnative-classes-2.0.46.Final.jar
netty-transport-classes-epoll/4.1.73.Final//netty-transport-classes-epoll-4.1.73.Final.jar
netty-transport-classes-kqueue/4.1.73.Final//netty-transport-classes-kqueue-4.1.73.Final.jar
netty-transport-native-epoll/4.1.73.Final/linux-aarch_64/netty-transport-native-epoll-4.1.73.Final-linux-aarch_64.jar
netty-transport-native-epoll/4.1.73.Final/linux-x86_64/netty-transport-native-epoll-4.1.73.Final-linux-x86_64.jar
netty-transport-native-kqueue/4.1.73.Final/osx-aarch_64/netty-transport-native-kqueue-4.1.73.Final-osx-aarch_64.jar
netty-transport-native-kqueue/4.1.73.Final/osx-x86_64/netty-transport-native-kqueue-4.1.73.Final-osx-x86_64.jar
netty-transport-native-unix-common/4.1.73.Final//netty-transport-native-unix-common-4.1.73.Final.jar
netty-transport/4.1.73.Final//netty-transport-4.1.73.Final.jar
okhttp/3.12.12//okhttp-3.12.12.jar
okio/1.15.0//okio-1.15.0.jar
osgi-resource-locator/1.0.3//osgi-resource-locator-1.0.3.jar
paranamer/2.8//paranamer-2.8.jar
scala-library/2.12.15//scala-library-2.12.15.jar
scopt_2.12/4.0.1//scopt_2.12-4.0.1.jar
simpleclient/0.14.1//simpleclient-0.14.1.jar
simpleclient_common/0.14.1//simpleclient_common-0.14.1.jar
simpleclient_dropwizard/0.14.1//simpleclient_dropwizard-0.14.1.jar
simpleclient_servlet/0.14.1//simpleclient_servlet-0.14.1.jar
simpleclient_servlet_common/0.14.1//simpleclient_servlet_common-0.14.1.jar
simpleclient_tracer_common/0.14.1//simpleclient_tracer_common-0.14.1.jar
simpleclient_tracer_otel/0.14.1//simpleclient_tracer_otel-0.14.1.jar
simpleclient_tracer_otel_agent/0.14.1//simpleclient_tracer_otel_agent-0.14.1.jar
slf4j-api/1.7.35//slf4j-api-1.7.35.jar
snakeyaml/1.30//snakeyaml-1.30.jar
swagger-annotations/2.1.11//swagger-annotations-2.1.11.jar
swagger-core/2.1.11//swagger-core-2.1.11.jar
swagger-integration/2.1.11//swagger-integration-2.1.11.jar
swagger-jaxrs2/2.1.11//swagger-jaxrs2-2.1.11.jar
swagger-models/2.1.11//swagger-models-2.1.11.jar
zjsonpatch/0.3.0//zjsonpatch-0.3.0.jar
zookeeper/3.4.14//zookeeper-3.4.14.jar
Reference in New Issue View Git Blame Copy Permalink