kyuubi/docs
ulysses-you 2acee9ea97
[KYUUBI #3601] [SPARK] Support infer columns for rebalance and sort
### _Why are the changes needed?_

Improve the rebalance before writing rule.

The rebalance before writing rule adds a rebalance at the top of query for data writing command, however the default partitioning of rebalance uses RoundRobinPartitioning which would break the original partitioning of data. It may cause the the output data size bigger than before.

This pr supports infer the columns from join and aggregate for rebalance and sort to improve the compression ratio.

Note that, this improvement only works for static partition writing.

### _How was this patch tested?_
- [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [ ] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests) locally before make a pull request

Closes #3601 from ulysses-you/smart-order.

Closes #3601

c190dc1a [ulysses-you] docs
995969b5 [ulysses-you] view
ea23c417 [ulysses-you] Support infer columns for rebalance and sort

Authored-by: ulysses-you <ulyssesyou18@gmail.com>
Signed-off-by: ulysses-you <ulyssesyou@apache.org>
2022-10-17 18:13:50 +08:00
..
_static/css [KYUUBI #2764] [DOCS] Fix tables in docs being coverd by right toc sidebar 2022-05-27 17:21:42 +08:00
appendix [KYUUBI #2751] [DOC] Replace sphinx_rtd_theme with sphinx_book_theme 2022-05-27 02:22:36 +08:00
changelog [KYUUBI #3342] Add v1.6.0-incubating changelog 2022-08-25 18:00:05 +08:00
client [KYUUBI #3596] [DOCS]update plan only execution mode doc 2022-10-10 19:21:23 +08:00
community [KYUUBI #3268] Update release docs for status file news 2022-08-18 17:55:13 +08:00
connector [KYUUBI #3531] [FOLLOWUP] Fix malforme format in hive connector doc 2022-10-02 23:49:01 +08:00
deployment [KYUUBI #3597] Engine should prefer ip for registering on K8s cluster mode 2022-10-10 12:04:41 +08:00
develop_tools [KYUUBI #3241][DOCS] Update Develop Tools / Building a Runnable Distribution 2022-08-18 15:38:09 +08:00
extensions [KYUUBI #3601] [SPARK] Support infer columns for rebalance and sort 2022-10-17 18:13:50 +08:00
imgs [KYUUBI #3060] [Subtask][#3059] Build content of the connector document section 2022-07-14 14:19:13 +08:00
monitor [KYUUBI #3157][DOC] Modify logging doc due to using log4j2 instead of log4j 2022-08-15 21:15:56 +08:00
overview [KYUUBI #2751] [DOC] Replace sphinx_rtd_theme with sphinx_book_theme 2022-05-27 02:22:36 +08:00
quick_start [KYUUBI #3423] Bump Flink from 1.15.1 to 1.15.2 2022-09-11 21:30:27 +08:00
security [KYUUBI #3545][KYUUBI #3563] Support restrict spark configurations 2022-09-30 15:43:58 +08:00
tools [KYUUBI #3045][FOLLOWUP] Correct the common options and add docs for kyuubi-admin command 2022-07-15 10:47:49 +08:00
conf.py [KYUUBI #2764] [DOCS] Fix tables in docs being coverd by right toc sidebar 2022-05-27 17:21:42 +08:00
index.rst [KYUUBI #3101] [Subtask][#3100] Build the content for extension points documentation 2022-07-21 15:37:19 +08:00
make.bat
Makefile
requirements.txt [KYUUBI #3126] Using markdown 3.3.7 for kyuubi document build 2022-07-25 14:46:20 +08:00