Commit Graph

32 Commits

Author SHA1 Message Date
Cheng Pan
fd0cf11eca
[CELEBORN-738] Enable CI for Java 17
### What changes were proposed in this pull request?

Enable CI for Celeborn Master/Worker and Client with Spark 3.3/3.4

### Why are the changes needed?

Ensure Celeborn works on Java 17.

Note: there may be some code paths that are not covered by tests, we should fix them in the future.

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Pass GA

Closes #1649 from pan3793/CELEBORN-738.

Authored-by: Cheng Pan <chengpan@apache.org>
Signed-off-by: Cheng Pan <chengpan@apache.org>
2023-06-29 13:47:55 +08:00
zwangsheng
5068d6e897
[CELEBORN-105][TEST] Kubernetes Integration Test
### What changes were proposed in this pull request?
Add Kubernetes Integration Test
- [x] test helm install deploy
- [ ] test shuffle

### Why are the changes needed?
Add integration test

### Does this PR introduce _any_ user-facing change?
No

### How was this patch tested?
Ci test

Closes #1484 from zwangsheng/CELEBORN-105.

Authored-by: zwangsheng <2213335496@qq.com>
Signed-off-by: Cheng Pan <chengpan@apache.org>
2023-06-05 12:11:29 +08:00
Cheng Pan
ef8e556202
[CELEBORN-604][SPARK] Support Spark 3.4 (#1509) 2023-05-24 23:10:13 +08:00
Ethan Feng
114b1b4d62
[CELEBORN-548][FLINK] Support flink 1.17. (#1472) 2023-05-05 23:00:49 +08:00
Keyong Zhou
61416a828d
[CELEBORN-497]Fix and enable JDK 11 for CI (#1401) 2023-03-31 13:39:02 +08:00
Ethan Feng
9fc77980ba
[CELEBORN-380][FLINK] Enable flink integration test in GitHub CI. (#1312) 2023-03-08 10:52:14 +08:00
Cheng Pan
88976d9fd9
[CELEBORN-375][INFRA] Enable CI on branch-* (#1307) 2023-03-03 16:49:32 +08:00
Cheng Pan
0c29c5dd57
[CELEBORN-180][BUILD][FOLLOWUP] Update CI workflow and docs (#1134) 2023-01-03 17:58:51 +08:00
Cheng Pan
bf97a2227b
[CELEBORN-163][BUILD] Rename Flink modules and enable Flink CI (#1110) 2022-12-21 23:54:47 +08:00
Cheng Pan
7105f98829
[CELEBORN-160][BUILD] Spilt CI workflow (#1107) 2022-12-21 23:47:01 +08:00
Binjie Yang
853d0df191
[CELEBORN-149] Upload failure CI unit test logs for developer debug (#1094) 2022-12-16 04:31:13 +08:00
Cheng Pan
17f45453e3
[CELEBORN-135][INFRA] Remove unused GitHub slash workflow (#1080) 2022-12-14 10:13:13 +08:00
Ethan Feng
e68954dbae
[CELEBORN-81] Add codecov. (#1026) 2022-12-09 12:11:45 +08:00
Cheng Pan
9bf4c65357
[CELEBORN-72][DOCS] Remove unused website resources from main repo (#1014) 2022-11-28 09:47:30 +08:00
Binjie Yang
f51fae6c75
[REFACTOR] Replace the missing Remote Shuffle Service (#885) 2022-10-28 17:37:59 +08:00
Cheng Pan
873eeeb1ed
[BUILD] Add apache- prefix in release tarball name (#854) 2022-10-25 22:39:48 +08:00
Ethan Feng
196f3800c2
Fix incorrect action command type configs. (#836) 2022-10-24 10:05:11 +08:00
Ethan Feng
77ff94ebf0
[FEATURE]Add action to process stale pull requests. (#817) 2022-10-21 10:39:51 +08:00
Ethan Feng
6f914997ed
[FEATURE]Add slash regression trigger. (#823) 2022-10-20 23:35:25 +08:00
Ethan Feng
b708d63678
Optimize regression logic. (#793) 2022-10-18 20:31:46 +08:00
Ethan Feng
b4b19892eb
[Feature]Add ci scripts for regression and benchmark. (#766) 2022-10-17 16:46:27 +08:00
Cheng Pan
2c82e98a94
Use Google mirror in GA (#755) 2022-10-11 11:57:41 +08:00
Cheng Pan
f2ca6d68e4
[DOCS] Build website (#579) 2022-09-10 00:45:13 +08:00
Cheng Pan
4b42219595
Remove log4j1 (#501) 2022-09-05 19:30:15 +08:00
Cheng Pan
c88ce306be
Use Spotless to auto check and reformat Java/Scala code (#497) 2022-09-01 21:19:56 +08:00
Cheng Pan
3dddb65f31
Enable Apache Rat and fix license header (#492) 2022-08-31 23:53:33 +08:00
Cheng Pan
9b6ec58e2a
Add profile for Spark 3.2/3.3 (#380) 2022-08-17 22:27:43 +08:00
Cheng Pan
bb0c9b21fc
[ISSUE-350] Rewrite RssShuffleManager using Java to pass compile on Spark 3.1+ (#370) 2022-08-17 15:59:50 +08:00
Cheng Pan
f1f4b894af
Build: Enhance build system (#349) 2022-08-15 14:59:01 +08:00
Ethan Feng
9ad8254b0a
AQE support. (#67) 2022-04-01 20:19:01 +08:00
wangshengjie123
b2a6091b55
[Feature] Make log4j2 as optional in case to we can update log4j2.xml to change log level (#56) 2022-03-08 22:33:06 +08:00
zky.zhoukeyong
ba5920acde Initial Commit for RSS 2021-12-28 20:57:35 +08:00