From 6a183f9d1ec41eadfb11171c6ccc82ec56109070 Mon Sep 17 00:00:00 2001 From: hongdongdong Date: Thu, 9 Sep 2021 13:37:31 +0800 Subject: [PATCH] [KYUUBI #1057] [KYUUBI#1056] Output error log when currentEngine is None ### _Why are the changes needed?_ When createSpark in SparkSqlEngine get sparksession or execute initialize.sql failed, we cannot get any error info in logs. At this time, currentEngine is None. ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [X] [Run test](https://kyuubi.readthedocs.io/en/latest/develop_tools/testing.html#running-tests) locally before make a pull request Closes #1057 from hddong/engine-fix. Closes #1057 44ead3b3 [hongdongdong] fix 3462d36c [hongdongdong] [KYUUBI#1056] Output error log when currentEngine is None Authored-by: hongdongdong Signed-off-by: Kent Yao (cherry picked from commit 888651353482ba49abe7c8077ac478ec795e2b97) Signed-off-by: Kent Yao --- .../scala/org/apache/kyuubi/engine/spark/SparkSQLEngine.scala | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/externals/kyuubi-spark-sql-engine/src/main/scala/org/apache/kyuubi/engine/spark/SparkSQLEngine.scala b/externals/kyuubi-spark-sql-engine/src/main/scala/org/apache/kyuubi/engine/spark/SparkSQLEngine.scala index b21fa3511..e5aa7294b 100644 --- a/externals/kyuubi-spark-sql-engine/src/main/scala/org/apache/kyuubi/engine/spark/SparkSQLEngine.scala +++ b/externals/kyuubi-spark-sql-engine/src/main/scala/org/apache/kyuubi/engine/spark/SparkSQLEngine.scala @@ -146,7 +146,7 @@ object SparkSQLEngine extends Logging { // blocking main thread countDownLatch.await() } catch { - case t: Throwable => + case t: Throwable if currentEngine.isDefined => currentEngine.foreach { engine => val status = engine.engineStatus.copy(diagnostic = s"Error State SparkSQL Engine ${t.getMessage}") @@ -154,6 +154,8 @@ object SparkSQLEngine extends Logging { error(status, t) engine.stop() } + case t: Throwable => + error("Create SparkSQL Engine Failed", t) } finally { if (spark != null) { spark.stop()