kyuubi/docs
zwangsheng b23c87c318
[KYUUBI #4467][K8S][BATCH] Tolerate Driver Pod ephemerally invisible after submitting
### _Why are the changes needed?_

The following discussion assumes using Spark cluster mode w/ `waitCompletion=false`.

In Spark on Yarn, the application is visible immediately after `spark-submit` is returned, but things are different in Spark on K8s, Driver Pod is ephemerally invisible after submitting, so NOT_FOUND is returned instead of UNKNOWN or PENDING.

To tolerate the above case, `kyuubi.engine.submit.timeout` is introduced, ApplicationManager will report UNKNOWN instead of NOT_FOUND during the Driver Pod scheduling period.

More detail in #4467
1. Remove `KubernetesApplicationOperation`'s `JpsApplicationOperation` for handle Client Deploy Mode(`YarnApplicationOperation` doesn't handle this either)
2. Add engine submit timeout for `KubernetesApplicationOperation` to return Unknown status when not found driver pod in time range.
3. GetApplicationInfo with it's submit time

### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [ ] [Run test](https://kyuubi.readthedocs.io/en/master/develop_tools/testing.html#running-tests) locally before make a pull request

Closes #4469 from zwangsheng/4467.

Closes #4467

562b67463 [zwangsheng] [KYUUBI #4467] Fix Setting.md
362c43d1b [zwangsheng] [KYUUBI #4467] Fix Setting.md
ac69f4d81 [zwangsheng] [KYUUBI #4467] Add Config Desc
d2b9fb660 [zwangsheng] [KYUUBI #4467] save tab
eac880fcf [zwangsheng] [KYUUBI #4467] Ingnore Kubernetes Operation for client mode test
7a20b97a4 [Cheng Pan] Update kyuubi-server/src/main/scala/org/apache/kyuubi/engine/KubernetesApplicationOperation.scala
aa4c7716a [zwangsheng] [KYUUBI #4467] Ingnore Kubernetes Operation for client mode test
c5bd888ab [zwangsheng] [KYUUBI #4467] note it test
a86dcefba [zwangsheng] [KYUUBI #4467] Using default none
aed7f8794 [Cheng Pan] Update docs/deployment/settings.md
490df7dc0 [zwangsheng] [KYUUBI #4467] fix complie
33f3a5be8 [zwangsheng] [KYUUBI #4467] fix comments
4745790cf [zwangsheng] [KYUUBI #4467] Fix IT Test
924cfe38e [zwangsheng] [KYUUBI #4467] Fix Setting.md
5f8aeaacc [zwangsheng] [KYUUBI #4467] KubernetesApplicationOperation Wait if not fount driver pod in limit time range

Lead-authored-by: zwangsheng <2213335496@qq.com>
Co-authored-by: Cheng Pan <pan3793@gmail.com>
Signed-off-by: Cheng Pan <chengpan@apache.org>
2023-03-14 23:01:43 +08:00
..
_static/css [KYUUBI #2764] [DOCS] Fix tables in docs being coverd by right toc sidebar 2022-05-27 17:21:42 +08:00
appendix [KYUUBI #4235] [DOCS] Prefer https:// URLs in docs 2023-02-03 14:01:11 +08:00
client [KYUUBI #3876][FOLLOWUP] Update the rest api docs for open session response 2023-02-24 08:27:23 +08:00
community [KYUUBI #4385] [DOCS] Refine release process 2023-02-21 09:47:45 +08:00
connector [KYUUBI #3081][DOCS] Add Hudi connector doc in Trino 2023-02-19 18:55:31 +08:00
deployment [KYUUBI #4467][K8S][BATCH] Tolerate Driver Pod ephemerally invisible after submitting 2023-03-14 23:01:43 +08:00
develop_tools [KYUUBI #4397] [BUILD] build/dist supports --web-ui 2023-02-23 11:45:58 +08:00
extensions [KYUUBI #4235] [DOCS] Prefer https:// URLs in docs 2023-02-03 14:01:11 +08:00
imgs [KYUUBI #4371] Fix typo in kyuubi_ecosystem.drawio 2023-02-20 13:00:45 +08:00
monitor [KYUUBI #4364] Add metrics for user opened connections with session type 2023-02-18 14:52:00 +08:00
overview [KYUUBI #4235] [DOCS] Prefer https:// URLs in docs 2023-02-03 14:01:11 +08:00
quick_start [KYUUBI #4338] Bump Spark from 3.3.1 to 3.3.2 2023-02-19 00:06:57 +08:00
security [KYUUBI #4362] Add _configurations in kerberos.rst 2023-02-19 00:34:22 +08:00
tools [KYUUBI #4360] Support to refresh the unlimited users for session limiter 2023-02-18 00:54:11 +08:00
conf.py [KYUUBI #4020] remove incubating from kyuubi source code 2023-01-04 09:43:20 +08:00
index.rst [KYUUBI #3763] [DOCS] Update the home page of documentation to keep the latest updates 2022-11-07 14:11:24 +08:00
make.bat [KYUUBI #4235] [DOCS] Prefer https:// URLs in docs 2023-02-03 14:01:11 +08:00
Makefile
requirements.txt [KYUUBI #4340] Bump up markdown version from 3.3.7 to 3.4.1 2023-02-16 16:27:19 +08:00