Commit Graph

4 Commits

Author SHA1 Message Date
ulysses-you
2e67b09954
[KYUUBI #864] Block cleaner should catch NonFatal exception
<!--
Thanks for sending a pull request!

Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
  2. If the PR is related to an issue in https://github.com/apache/incubator-kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
  3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->

### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the use case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->
The daemonset may encounter some pontential issue during long-time running. It should be robust to catch `NonFatal` exception with it.

### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [x] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

Closes #864 from ulysses-you/block-cleaner.

Closes #864

d3e9dd00 [ulysses-you] dir
46ec3fc0 [ulysses-you] fix

Authored-by: ulysses-you <ulyssesyou18@gmail.com>
Signed-off-by: Kent Yao <yao@apache.org>
2021-07-26 18:49:53 +08:00
Binjie Yang
bf8de1a29b [KYUUBI #856] Enhance Spark Block Cleaner loginfo
### _Why are the changes needed?_
Enhacce Spark Block Cleaner loginfo
* Unite timeunit
* Remove period

### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [X] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

Closes #856 from zwangsheng/enhance/block-cleaner.

Closes #856

c9b3fda8 [Binjie Yang] timeunit
124d1566 [Binjie Yang] enhance spark block cleaner loginfo

Authored-by: Binjie Yang <2213335496@qq.com>
Signed-off-by: ulysses-you <ulyssesyou18@gmail.com>
2021-07-22 11:52:41 +08:00
Binjie Yang
7ee92ce5c1 [KYUUBI #828] Manage Spark-Block-Cleaner log files
### _Why are the changes needed?_
Spark-Block-Cleaner log files are not governed by itself.
Add log4j-defaults.properties to help input both console and file.
And use rollingFileApeender to split big logfile to small logFiles.
Create a log file under /logs/spark-block-cleaner-log/ so that you can manage the log yourself with the ability to clear the folder leading to `spark-`.

### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [X] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request

Closes #831 from zwangsheng/feature/block-cleaner.

Closes #828

83dc639e [ulysses] nit
5458f84b [Binjie Yang] make init log4j static
f0d65dd7 [Binjie Yang] import format
48514496 [Binjie Yang] optimize properties
52713f1e [Binjie Yang] assign log4j.properties
a8723f1a [Binjie Yang] fix
4d44a033 [Binjie Yang] use rollingfileappender

Lead-authored-by: Binjie Yang <2213335496@qq.com>
Co-authored-by: ulysses <ulyssesyou18@gmail.com>
Signed-off-by: ulysses-you <ulyssesyou18@gmail.com>
2021-07-19 18:27:35 +08:00
ulysses
bd42d8a2f8
Refactor Kyuubi kubernetes block cleaner (#794)
Refactor Kyuubi kubernetes block cleaner
2021-07-14 11:42:06 +08:00