### _Why are the changes needed?_ - concurrent execution and smart builder is shipped with `mvnd`, but the CI log shows they are not activated - increase maximum degree of concurrency and utilize `SmartBuilder` feature in `mvnd`. `-Dmvnd.minThreads` is set as fallback and it will be ignored if `--threads` or `-Dmvnd.threads` is used. #### Before: (https://github.com/apache/kyuubi/actions/runs/4276652363/jobs/7444896450#step:6:64) ``` [INFO] Build maximum degree of concurrency is 1 ``` #### After: (https://github.com/apache/kyuubi/actions/runs/4279322563/jobs/7449912132#step:8:64) ``` [INFO] Using the SmartBuilder implementation with a thread count of 4 [INFO] Build maximum degree of concurrency is 4 ``` (https://github.com/apache/kyuubi/actions/runs/4279322563/jobs/7449912132#step:8:553) ``` [INFO] Segment walltime 13 s, segment projects service time 36 s, effective/maximum degree of concurrency 2.63/4 ``` ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [x] [Run test](https://kyuubi.readthedocs.io/en/master/develop_tools/testing.html#running-tests) locally before make a pull request Closes #4420 from bowenliang123/mvnd-smart. Closes #4274 64f0cc53e [liangbowen] update 391da26d3 [liangbowen] quite in dep and style jobs c776356a5 [liangbowen] use -Dmvnd.minThreads d10bfb70c [liangbowen] use -Dmvnd.minThreads f793d2b6b [liangbowen] warn bbb929fe3 [liangbowen] quiet a5e6d4914 [liangbowen] logging warn level 3cfbaad45 [liangbowen] enable quite option and cancel redirect stderr 09442ff69 [liangbowen] update ca5f855fa [liangbowen] try to redirect stderr 0ebdd18d4 [liangbowen] set completion and print MAVEN_CLI_OPTS d3b2c9656 [liangbowen] revert explicitly setting `mvnd.noBuffering` e2eca0140 [liangbowen] revert explicitly setting `mvnd.noBuffering` dba25e327 [liangbowen] explicitly set `mvnd.noBuffering` to false prevent displaying events continuously b7583f936 [liangbowen] shell d60ebd047 [liangbowen] change mvnd cache key 2cc576ef8 [liangbowen] dep bbd6414c9 [liangbowen] move multithread setting to mvnd's MAVEN_CLI_OPTS 347b58c8c [liangbowen] increase concurrency for spotless check 15c5519e4 [liangbowen] increase concurrency Authored-by: liangbowen <liangbowen@gf.com.cn> Signed-off-by: liangbowen <liangbowen@gf.com.cn> |
||
|---|---|---|
| .. | ||
| release | ||
| dependency.sh | ||
| dist | ||
| Dockerfile | ||
| kyuubi-build-info | ||
| kyuubi-build-info.cmd | ||
| mvn | ||
| mvnd | ||
| util.sh | ||