fixes#284
We will create and write a log during submit a new session (like spark-submit) but we don't delete or overwrite it. This PR aims to add a time config to decide if we need to overwrite a session submit log.
The log path template is `KYUUBI_WORD_DIR/user/$engine-log.$index`. We will increase the `index` automatically if a user create some session concurrently.
After this PR. The log path template is `KYUUBI_WORD_DIR/user/$engine.log.$index`.
Squashed commit of the following:
commit 7794406098df0a3129ccd2ab04a445d2155bef8e
Author: ulysses-you <ulyssesyou18@gmail.com>
Date: Thu Jan 14 19:52:10 2021 +0800
fix
commit 13fd3bbb577c8bdad0ef73851262344d2870fd4d
Author: ulysses-you <ulyssesyou18@gmail.com>
Date: Thu Jan 14 19:02:36 2021 +0800
fix docs
commit 82c192bc6bccf749f7d7232ed4f03f3c0a56c65f
Author: ulysses-you <ulyssesyou18@gmail.com>
Date: Thu Jan 14 18:04:50 2021 +0800
fix
commit 134ea4389b0b9fddc777c79b1a9f43fc59ec3f7e
Author: ulysses-you <ulyssesyou18@gmail.com>
Date: Thu Jan 14 17:20:55 2021 +0800
docs
commit 921ac11b27c028c508e834b88f9f9d9e17eb104a
Author: ulysses-you <ulyssesyou18@gmail.com>
Date: Thu Jan 14 17:16:09 2021 +0800
fix config
commit bfcbd9633a18e9a4cf0b5b2308855ad8af7f7efd
Author: ulysses-you <ulyssesyou18@gmail.com>
Date: Thu Jan 14 16:36:00 2021 +0800
prefix
commit bceb8c59cbd7d7757b2c30058f845fa1e3c7ee9d
Author: ulysses-you <ulyssesyou18@gmail.com>
Date: Thu Jan 14 16:14:20 2021 +0800
doc
commit 4dd556333c7e6e8181f595293bb3877473c00ee7
Author: ulysses-you <ulyssesyou18@gmail.com>
Date: Thu Jan 14 16:11:00 2021 +0800
init
2020-11-10 10:15:42,001 [61208289] - ERROR [FrontendServiceHandler-Pool: Thread-449:TThreadPoolServer$WorkerProcess@315] - Thrift error occurred during processing of message.
org.apache.thrift.protocol.TProtocolException: Missing version in readMessageBegin, old client?
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:234)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:27)
at org.apache.kyuubi.service.authentication.TSetIpAddressProcessor.process(TSetIpAddressProcessor.scala:36)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:310)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
/**
* This method is used to convert kyuubi configs to configs that Spark could identify.
* - If the key is start with `spark.`, keep it AS IS as it is a Spark Conf
* - If the key is start with `hadoop.`, it will be prefixed with `spark.hadoop.`
* - Otherwise, the key will be added a `spark.` prefix
* @return a map with spark specified configs
*/
