Wang, Fei ecfca79328 [KYUUBI #7033] Treat YARN/Kubernetes application NOT_FOUND as failed to prevent data quality issue ... ### Why are the changes needed? Currently, NOT_FOUND application stated is treated as a terminated but not failed state. It might cause some data quality issue if downstream application depends on the batch state for data processing. So, I think we should treat NOT_FOUND as a failed state instead. Currently, we support 3 types of application manager. 1. [JpsApplicationOperation](https://github.com/apache/kyuubi/blob/master/kyuubi-server/src/main/scala/org/apache/kyuubi/engine/JpsApplicationOperation.scala) 2. [YarnApplicationOperation](https://github.com/apache/kyuubi/blob/master/kyuubi-server/src/main/scala/org/apache/kyuubi/engine/YarnApplicationOperation.scala) 3. [KubernetesApplicationOperation](https://github.com/apache/kyuubi/blob/master/kyuubi-server/src/main/scala/org/apache/kyuubi/engine/KubernetesApplicationOperation.scala) YarnApplicationOperation and KubernetesApplicationOperation are widely used in production use case. And in multiple kyuubi instance mode, the NOT_FOUND case should rarely happen. 1. 7e199d6fdb/kyuubi-server/src/main/scala/org/apache/kyuubi/server/api/v1/BatchesResource.scala (L369-L385) 3. https://github.com/apache/kyuubi/pull/7029 So, I think we should treat NOT_FOUND as a failed state in production use case. It is better to fail some corner cases than to mistakenly set unsuccessful batches to the finished state. ### How was this patch tested? GA. ### Was this patch authored or co-authored using generative AI tooling? No. Closes #7033 from turboFei/revist_not_found. Closes #7033 ada4f8822 [Cheng Pan] Update kyuubi-server/src/main/scala/org/apache/kyuubi/engine/ApplicationOperation.scala 985e23c24 [Wang, Fei] Refine f03d61242 [Wang, Fei] comments b9d6ac203 [Wang, Fei] incase the metadata updated by peer instance 3bd61ca85 [Wang, Fei] add 339df4730 [Wang, Fei] treat NOT_FOUND as failed Lead-authored-by: Wang, Fei <fwang12@ebay.com> Co-authored-by: Cheng Pan <pan3793@gmail.com> Signed-off-by: Cheng Pan <chengpan@apache.org>		2025-04-27 21:09:08 +08:00
..
src	[KYUUBI #7033] Treat YARN/Kubernetes application NOT_FOUND as failed to prevent data quality issue	2025-04-27 21:09:08 +08:00
web-ui	Bump nanoid from 3.3.6 to 3.3.11 in /kyuubi-server/web-ui (#7001)	2025-03-25 14:44:57 +00:00
pom.xml	[KYUUBI #7045] Expose jetty metrics	2025-04-25 00:02:56 -07:00