Cheng Pan
08dbe24d28
[KYUUBI #380 ] [FOLLOWUP #377 ] change default distribution bundle name, and distribute without spark bundle
...
 [](https://github.com/yaooqinn/kyuubi/pull/380 )     [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues , add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the use case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
This is a followup of #377 , change list:
- change the spark version suffix in default distribution bundle name from `spark-{major}.{minor}.{patch}` to `spark-{major}.{minor}`
- release distribution bundles both with spark and without spark
Consider Kyuubi 1.1.x has not released, the available distribution still in old style, so now just keep the doc as is.
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
- [x] Manual test
`build/dist --tgz`
```
➜ kyuubi git:(master) ✗ ls | grep tar.gz
kyuubi-1.1.0-SNAPSHOT-bin-spark-3.0.tar.gz
```
Closes #380 from pan3793/build.
36fa006 [Cheng Pan] [FOLLOWUP #377 ] change default distribution bundle name, and distribute without spark bundle
Authored-by: Cheng Pan <379377944@qq.com>
Signed-off-by: Kent Yao <yao@apache.org>
2021-02-28 23:05:36 +08:00
Cheng Pan
2f8df2355d
[KYUUBI #377 ] build/dist support --spark-provided
...
 [](https://github.com/yaooqinn/kyuubi/pull/378 )    [❨?❩](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info )<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->
<!--
Thanks for sending a pull request!
Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues , add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->
### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
1. If you add a feature, you can talk about the use case of it.
2. If you fix a bug, you can clarify why it is a bug.
-->
close #377
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests ) locally before make a pull request
- [x] Manual test
`build/dist --spark-provided`
```
(kyuubi) ➜ kyuubi git:(master) ✗ tree dist
dist
├── LICENSE
├── RELEASE
├── bin
│ ├── kyuubi
│ ├── kyuubi-logo
│ └── load-kyuubi-env.sh
├── conf
│ ├── kyuubi-defaults.conf.template
│ ├── kyuubi-env.sh.template
│ └── log4j.properties.template
├── externals
│ └── engines
│ └── spark
│ └── kyuubi-spark-sql-engine-1.1.0-SNAPSHOT.jar
├── jars
│ ├── apacheds-i18n-2.0.0-M15.jar
│ ├── apacheds-kerberos-codec-2.0.0-M15.jar
│ ├── api-asn1-api-1.0.0-M20.jar
│ ├── api-util-1.0.0-M20.jar
│ ├── audience-annotations-0.5.0.jar
│ ├── commons-beanutils-1.7.0.jar
│ ├── commons-beanutils-core-1.8.0.jar
│ ├── commons-codec-1.4.jar
│ ├── commons-collections-3.2.2.jar
│ ├── commons-configuration-1.6.jar
│ ├── commons-digester-1.8.jar
│ ├── commons-io-2.4.jar
│ ├── commons-lang-2.6.jar
│ ├── commons-lang3-3.10.jar
│ ├── commons-math-2.2.jar
│ ├── curator-client-2.7.1.jar
│ ├── curator-framework-2.7.1.jar
│ ├── curator-recipes-2.7.1.jar
│ ├── curator-test-2.7.1.jar
│ ├── guava-11.0.2.jar
│ ├── hadoop-annotations-2.7.4.jar
│ ├── hadoop-auth-2.7.4.jar
│ ├── hadoop-common-2.7.4.jar
│ ├── hive-service-rpc-2.3.7.jar
│ ├── httpclient-4.5.6.jar
│ ├── httpcore-4.4.12.jar
│ ├── javassist-3.18.1-GA.jar
│ ├── jcl-over-slf4j-1.7.30.jar
│ ├── jsr305-3.0.2.jar
│ ├── kyuubi-common-1.1.0-SNAPSHOT.jar
│ ├── kyuubi-ha-1.1.0-SNAPSHOT.jar
│ ├── kyuubi-main-1.1.0-SNAPSHOT.jar
│ ├── libfb303-0.9.3.jar
│ ├── libthrift-0.9.3.jar
│ ├── log4j-1.2.17.jar
│ ├── netty-3.7.0.Final.jar
│ ├── scala-library-2.12.10.jar
│ ├── slf4j-api-1.7.30.jar
│ ├── slf4j-log4j12-1.7.30.jar
│ ├── spotbugs-annotations-3.1.9.jar
│ └── zookeeper-3.4.14.jar
├── logs
├── pid
└── work
```
Bundle size
```
(kyuubi) ➜ kyuubi git:(KYUUBI-377) ll | grep tar.gz
-rw-r--r-- 1 chengpan staff 230M Feb 26 12:59 kyuubi-1.1.0-SNAPSHOT-bin-spark-3.0.2.tar.gz
-rw-r--r-- 1 chengpan staff 20M Feb 26 12:56 kyuubi-1.1.0-SNAPSHOT-bin-without-spark.tar.gz
```
Closes #378 from pan3793/KYUUBI-377.
442569e [Cheng Pan] add profile spark-provided for skip download spark binary
0d8da24 [Cheng Pan] update doc
5b7c41f [Cheng Pan] [KYUUBI #377 ] build/dist support --spark-provided
Authored-by: Cheng Pan <379377944@qq.com>
Signed-off-by: ulysses-you <ulyssesyou18@gmail.com>
2021-02-26 15:00:42 +08:00
fwang12
4e637c62de
[KYUUBI #297 ] Remove unused property from build properties file
...
fixes #297
Squashed commit of the following:
commit 26df4c44a57f92dd16efe69898e9e969c22093fa
Author: fwang12 <fwang12@ebay.com>
Date: Mon Jan 18 13:09:13 2021 +0800
remove unused properties in build info
2021-01-18 14:26:11 +08:00
Zen
6637c58273
followup [add SparkSQLEngine idle check] fix #251
...
Squashed commit of the following:
commit 808ccb738f8774e465d12dfb04a6d37256545e78
Author: Zen <xinjingziranchan@gmail.com>
Date: Wed Nov 18 14:18:46 2020 +0800
Fixed duplicate issues with the Jars directory when packaging Kyuubi
commit 91ca0a0f8a5a260b1ae29a31c323f69d37a14bfe
Author: zen <xinjingziranchan@gmail.com>
Date: Wed Nov 18 14:01:56 2020 +0800
fix log print and SparkSQLEngine timeoutChecker concurrent issue.
commit 15343d9cd07b48d3909c1085836687a4cc7f05c3
Author: zen <xinjingziranchan@gmail.com>
Date: Tue Nov 17 21:21:03 2020 +0800
消除打印dehug日志时，重复判断是否开启debug模式
commit eecc0bf01144b3f2601e6a821bedf786e5aafb22
Author: zen <xinjingziranchan@gmail.com>
Date: Tue Nov 17 15:08:13 2020 +0800
Revert "修复打包时kyuubi依赖jars目录重复，导致启动时找不到org.apache.kyuubi.server.KyuubiServer启动类"
This reverts commit 29e9dd45
commit 29e9dd45e90b1549b68e96024b1ee866429bf40d
Author: zen <xinjingziranchan@gmail.com>
Date: Tue Nov 17 14:36:23 2020 +0800
修复打包时kyuubi依赖jars目录重复，导致启动时找不到org.apache.kyuubi.server.KyuubiServer启动类
commit 44364ecd289ca40181bd150998cce76762b145be
Author: zen <xinjingziranchan@gmail.com>
Date: Tue Nov 17 13:48:21 2020 +0800
修复SparkSQLEngine停止时没有关闭timeoutChecker线程池，以及增加timeoutChecker打印日志
commit 63a67e2c487a5418a056ff4f797b46185ed4c17b
Merge: 6028f55 64b83a4fb4bace7bfc470#1 from yaooqinn/master
同步更新
2020-11-18 16:41:43 +08:00
Kent Yao
7157370ef6
Add Building Doc
2020-11-05 19:05:26 +08:00
Kent Yao
e92071a67c
Suppport making distribution
2020-09-25 15:40:41 +08:00
Kent Yao
eb2a7050d9
build info
2020-09-21 21:26:16 +08:00
Kent Yao
e22dda7dbd
Add more build infomation
2020-09-11 09:55:11 +08:00
konradqcharczyk
85689b6b64
Squashed commit of the following:
...
commit cd39627e46666c80bcf155fed647d2a84328af99
Merge: aae0cef 9b03db7
Author: konradqcharczyk <konradqcharczyk@gmail.com>
Date: Sun Jun 7 16:16:00 2020 +0200
apache mirror and spark version changed
commit aae0cef4347c55a68f74f426b98378b39d0b8bdb
Author: konradqcharczyk <konradqcharczyk@gmail.com>
Date: Sun Jun 7 14:51:16 2020 +0200
apache mirror and spark version changed
commit 9b03db77aebb73fe3587478c36c282a750116164
Author: konradqcharczyk <konradqcharczyk@gmail.com>
Date: Sun Jun 7 14:51:16 2020 +0200
spark 2.4.3 changes
2020-06-07 22:30:14 +08:00
Kent Yao
13c68b5550
[KYUUBI-167]Handling ApplicationMaster token expiry to support long caching sparkcontext with dynamic executor allocation ( #168 )
...
* [KYUUBI-167]Handling ApplicationMaster token expiry to support long caching sparkcontext with dynamic executor allocation - fix #167
* fix ut
* add ut
* fix ut
* add doc
* fix https://github.com/apache/spark/pull/24120
* logger
* typo
* comment/dist jar
* fix ut
* typo
2019-03-19 13:51:08 +08:00
Kent Yao
248259d84f
verify resource setting and add some comments
2018-07-26 16:36:16 +08:00
Kent Yao
52012ff8c3
typo
2018-06-22 14:56:59 +08:00
Kent Yao
6676ebfc01
init commit for making kyuubi server a sub-project fix #90
2018-06-22 14:20:04 +08:00
Kent Yao
a19ca23a56
test class loader
2018-05-14 19:16:22 +08:00
Kent Yao
729ee6186f
add version info
2018-05-13 18:52:08 +08:00
Kent Yao
828585e6ea
fixes #55 add script for making distribution
2018-04-09 14:59:06 +08:00
Kent Yao
1f7d7993dc
mv mvn to build
2018-01-20 00:01:36 +08:00
