kyuubi/build
liangbowen 5fab9b710a [KYUUBI #4274] [FOLLOWUP] Increase maximum degree of concurrency for mvnd in CI jobs
### _Why are the changes needed?_

- concurrent execution and smart builder is shipped with `mvnd`, but the CI log shows they are not activated
- increase maximum degree of concurrency and utilize `SmartBuilder` feature in `mvnd`. `-Dmvnd.minThreads` is set as fallback and it will be ignored if `--threads` or `-Dmvnd.threads` is used.

#### Before:
(https://github.com/apache/kyuubi/actions/runs/4276652363/jobs/7444896450#step:6:64)
```
[INFO] Build maximum degree of concurrency is 1
```

#### After:
(https://github.com/apache/kyuubi/actions/runs/4279322563/jobs/7449912132#step:8:64)
```
[INFO] Using the SmartBuilder implementation with a thread count of 4
[INFO] Build maximum degree of concurrency is 4
```
(https://github.com/apache/kyuubi/actions/runs/4279322563/jobs/7449912132#step:8:553)
```
[INFO] Segment walltime 13 s, segment projects service time 36 s, effective/maximum degree of concurrency 2.63/4
```

### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [x] [Run test](https://kyuubi.readthedocs.io/en/master/develop_tools/testing.html#running-tests) locally before make a pull request

Closes #4420 from bowenliang123/mvnd-smart.

Closes #4274

64f0cc53e [liangbowen] update
391da26d3 [liangbowen] quite in dep and style jobs
c776356a5 [liangbowen] use -Dmvnd.minThreads
d10bfb70c [liangbowen] use -Dmvnd.minThreads
f793d2b6b [liangbowen] warn
bbb929fe3 [liangbowen] quiet
a5e6d4914 [liangbowen] logging warn level
3cfbaad45 [liangbowen] enable quite option and cancel redirect stderr
09442ff69 [liangbowen] update
ca5f855fa [liangbowen] try to redirect stderr
0ebdd18d4 [liangbowen] set completion and print MAVEN_CLI_OPTS
d3b2c9656 [liangbowen] revert explicitly setting `mvnd.noBuffering`
e2eca0140 [liangbowen] revert explicitly setting `mvnd.noBuffering`
dba25e327 [liangbowen] explicitly set `mvnd.noBuffering` to false prevent displaying events continuously
b7583f936 [liangbowen] shell
d60ebd047 [liangbowen] change mvnd cache key
2cc576ef8 [liangbowen] dep
bbd6414c9 [liangbowen] move multithread setting to mvnd's MAVEN_CLI_OPTS
347b58c8c [liangbowen] increase concurrency for spotless check
15c5519e4 [liangbowen] increase concurrency

Authored-by: liangbowen <liangbowen@gf.com.cn>
Signed-off-by: liangbowen <liangbowen@gf.com.cn>
2023-03-02 18:00:19 +08:00
..
release [KYUUBI #4397] [BUILD] build/dist supports --web-ui 2023-02-23 11:45:58 +08:00
dependency.sh [KYUUBI #4191] [Improvement] Skip fetching Maven dependency snapshot update when building dependencyList 2023-01-30 13:47:12 +08:00
dist [KYUUBI #4413] [BUILD] Build docker image should include web UI 2023-02-26 17:10:18 +08:00
Dockerfile [KYUUBI #4288] Use eclipse-temurin:8-jdk-focal as default base image 2023-02-10 12:25:57 +08:00
kyuubi-build-info [KYUUBI #4187] [Improvement] Print revision commit time on server startup 2023-01-20 23:43:29 +08:00
kyuubi-build-info.cmd [KYUUBI #3903] Support windows generate kyuubi-version-info.properties 2022-12-05 20:27:43 +08:00
mvn [KYUUBI #4247][FOLLOWUP] Fix build/mvn version comparison 2023-02-09 20:45:02 +08:00
mvnd [KYUUBI #4274] [FOLLOWUP] Increase maximum degree of concurrency for mvnd in CI jobs 2023-03-02 18:00:19 +08:00
util.sh