From f83faa8356dca2717ab8970d887319d9c677bd5e Mon Sep 17 00:00:00 2001 From: Kent Yao Date: Wed, 3 Mar 2021 19:37:59 +0800 Subject: [PATCH] [KYUUBI #389] Bump up curator to 2.12.0 ![yaooqinn](https://badgen.net/badge/Hello/yaooqinn/green) [![Closes #389](https://badgen.net/badge/Preview/Closes%20%23389/blue)](https://github.com/yaooqinn/kyuubi/pull/389) ![1](https://badgen.net/badge/%2B/1/red) ![28](https://badgen.net/badge/-/28/green) ![1](https://badgen.net/badge/commits/1/yellow) ![Target Issue](https://badgen.net/badge/Missing/Target%20Issue/ff0000) ![Test Plan](https://badgen.net/badge/Missing/Test%20Plan/ff0000) [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info) ### _Why are the changes needed?_ 2.12.0 is the last update for curator-test to support zk v3.4.x ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request Closes #389 from yaooqinn/curator. 0b12323 [Kent Yao] Bump up curator to 2.12.0 Authored-by: Kent Yao Signed-off-by: Cheng Pan <379377944@qq.com> --- docs/deployment/settings.md | 27 --------------------------- pom.xml | 2 +- 2 files changed, 1 insertion(+), 28 deletions(-) diff --git a/docs/deployment/settings.md b/docs/deployment/settings.md index 7cacf1b00..a86b12931 100644 --- a/docs/deployment/settings.md +++ b/docs/deployment/settings.md @@ -140,19 +140,6 @@ You can configure the Kyuubi properties in `$KYUUBI_HOME/conf/kyuubi-defaults.co # spark.scheduler.listenerbus.eventqueue.shared.capacity 100000 # spark.scheduler.listenerbus.eventqueue.eventLog.capacity 20000 -## Dynamic Allocation -# spark.dynamicAllocation.enabled true -# spark.dynamicAllocation.initialExecutors 10 -# spark.dynamicAllocation.minExecutors 10 -# spark.dynamicAllocation.maxExecutors 500 -# spark.dynamicAllocation.executorAllocationRatio 0.8 -# spark.dynamicAllocation.executorIdleTimeout 60s -# spark.dynamicAllocation.cachedExecutorIdleTimeout 1h -# spark.dynamicAllocation.shuffleTracking.enabled false -# spark.dynamicAllocation.shuffleTracking.timeout 30min -# spark.dynamicAllocation.schedulerBacklogTimeout 1s -# spark.dynamicAllocation.sustainedSchedulerBacklogTimeout 1s - ## External Shuffle Service # spark.shuffle.service.enabled true # spark.shuffle.service.fetch.rdd.enabled true @@ -224,20 +211,6 @@ You can configure the Kyuubi properties in `$KYUUBI_HOME/conf/kyuubi-defaults.co # spark.sql.optimizer.dynamicPartitionPruning.fallbackFilterRatio 0.5 # spark.sql.optimizer.dynamicPartitionPruning.reuseBroadcastOnly true -# Adaptive Query Execution -# spark.sql.adaptive.enabled true -# spark.sql.adaptive.forceApply false -# spark.sql.adaptive.logLevel info -# spark.sql.adaptive.advisoryPartitionSizeInBytes 128m -# spark.sql.adaptive.coalescePartitions.enabled true -# spark.sql.adaptive.coalescePartitions.minPartitionNum 64 -# spark.sql.adaptive.coalescePartitions.initialPartitionNum -# spark.sql.adaptive.fetchShuffleBlocksInBatch true -# spark.sql.adaptive.localShuffleReader.enabled true -# spark.sql.adaptive.skewJoin.enabled true -# spark.sql.adaptive.skewJoin.skewedPartitionFactor 5 -# spark.sql.adaptive.skewJoin.skewedPartitionThresholdInBytes 256m -# spark.sql.adaptive.nonEmptyPartitionRatioForBroadcastJoin 0.2 ``` ### Authentication diff --git a/pom.xml b/pom.xml index c029f6457..377203fbb 100644 --- a/pom.xml +++ b/pom.xml @@ -64,7 +64,7 @@ 4.5.6 4.4.12 11.0.2 - 2.7.1 + 2.12.0 2.7.4 2.3.7 3.7.0.Final