kyuubi/dev
ulysses-you 1003f5296c
[KYUUBI #1321] Add config to control if zorder using global sort
<!--
Thanks for sending a pull request!

Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
  2. If the PR is related to an issue in https://github.com/apache/incubator-kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
  3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->

### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the use case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->
Add a new config `spark.sql.optimizer.zorderGlobalSort.enabled` to control if we do a global sort using zorder. This is a trade-off with data skew if the zorder columns has low cardinality.

### _How was this patch tested?_
- [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/develop_tools/testing.html#running-tests) locally before make a pull request

Closes #1321 from ulysses-you/zorder-config.

Closes #1321

422599e4 [ulysses-you] delete table
c11e2f4f [ulysses-you] doc
b984b537 [ulysses-you] Add config to control if zorder using global sort

Authored-by: ulysses-you <ulyssesyou18@gmail.com>
Signed-off-by: ulysses-you <ulyssesyou@apache.org>
2021-11-02 19:17:11 +08:00
..
kyuubi-codecov [KYUUBI #1257] [BUILD] Reduce unnecessary maven profile 2021-10-22 14:51:42 +08:00
kyuubi-extension-spark-3-1 [KYUUBI #1257] [BUILD] Reduce unnecessary maven profile 2021-10-22 14:51:42 +08:00
kyuubi-extension-spark-3-2 [KYUUBI #1257] [BUILD] Reduce unnecessary maven profile 2021-10-22 14:51:42 +08:00
kyuubi-extension-spark-common [KYUUBI #1321] Add config to control if zorder using global sort 2021-11-02 19:17:11 +08:00
kyuubi-tpcds [KYUUBI #1238] [BUILD] Add back Scala stuff to root POM 2021-10-15 17:49:48 +08:00
checkout_pr.sh [KYUUBI #1233] Add checkout_pr.sh script 2021-10-14 13:53:09 +08:00
dependencyList [KYUUBI #460] Upgrade Hive dependency to 2.3.9 2021-10-23 13:47:22 +08:00
merge_kyuubi_pr.py [KYUUBI #809] [INFRA] Support reopened PR in pr merge tool 2021-07-15 18:05:07 +08:00