2acee9ea97
### _Why are the changes needed?_ Improve the rebalance before writing rule. The rebalance before writing rule adds a rebalance at the top of query for data writing command, however the default partitioning of rebalance uses RoundRobinPartitioning which would break the original partitioning of data. It may cause the the output data size bigger than before. This pr supports infer the columns from join and aggregate for rebalance and sort to improve the compression ratio. Note that, this improvement only works for static partition writing. ### _How was this patch tested?_ - [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [ ] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests) locally before make a pull request Closes #3601 from ulysses-you/smart-order. Closes #3601 c190dc1a [ulysses-you] docs 995969b5 [ulysses-you] view ea23c417 [ulysses-you] Support infer columns for rebalance and sort Authored-by: ulysses-you <ulyssesyou18@gmail.com> Signed-off-by: ulysses-you <ulyssesyou@apache.org> |
||
|---|---|---|
| .. | ||
| engines | ||
| server | ||
| index.rst | ||