Cheng Pan
|
96e969f46e
|
[BUILD] Extract project.version to Maven Property (#772)
|
2022-10-16 19:01:40 +08:00 |
|
AngersZhuuuu
|
c9b462dc02
|
[ISSUE-770][Refactor] Batch handle change partition should ignore empty batch and avoid print log of empty result (#771)
|
2022-10-14 21:49:37 +08:00 |
|
AngersZhuuuu
|
3bad403c8b
|
[ISSUE-768][REFACTOR] Shuffle data lost should show more clear about lost data in which worker (#769)
|
2022-10-14 11:41:15 +08:00 |
|
nafiy
|
373b4a744a
|
[ISSUE-750][Refactor] Add UserIdentifier as a field of file info (#759)
|
2022-10-13 23:15:44 +08:00 |
|
Cheng Pan
|
5829bda21a
|
Rework and migrate HA configuration system (#763)
|
2022-10-13 22:35:01 +08:00 |
|
Kerwin Zhang
|
5dc47de975
|
[FEATURE] Optimize ColumnarBatchbuilder to make it compatible with codegen logic (#761)
|
2022-10-12 22:28:38 +08:00 |
|
Binjie Yang
|
1ab0ab2dcc
|
[K8S] Should move common env to values.yml instead of set in each yaml #762
|
2022-10-12 15:50:20 +08:00 |
|
Cheng Pan
|
f01a696313
|
Migrate and refactor configuration for master endpoints (#752)
|
2022-10-11 21:33:21 +08:00 |
|
dxheming
|
7ef4144ced
|
[DOC] Modify build cmd (#758)
|
2022-10-11 14:23:01 +08:00 |
|
Kerwin Zhang
|
8c862b1486
|
[FEATURE] Add common parent class for columnar shuffle writer codegen (#754)
|
2022-10-11 13:56:19 +08:00 |
|
Cheng Pan
|
2c82e98a94
|
Use Google mirror in GA (#755)
|
2022-10-11 11:57:41 +08:00 |
|
AngersZhuuuu
|
bbb4f8e225
|
[ISSUE-306][IMPROVEMENT] Handle change partition request in batch (#622)
|
2022-10-10 18:31:37 +08:00 |
|
nafiy
|
3ed38f1e72
|
[ISSUE-642][FEATURE] worker storage manger store user to shuffke key relation and recover from level db (#706)
|
2022-10-10 18:18:34 +08:00 |
|
Cheng Pan
|
805b8e6aba
|
[BUILD] Unify name style for module celeborn-client-spark-common (#748)
|
2022-10-10 12:40:21 +08:00 |
|
Cheng Pan
|
189b7a4fa8
|
Celeborn should respect CELEBORN_* env vars (#749)
|
2022-10-10 12:39:48 +08:00 |
|
Keyong Zhou
|
645339b024
|
Update README.md
|
2022-10-10 11:57:29 +08:00 |
|
AngersZhuuuu
|
db9ce36608
|
[ISSUE-690][DOC] Storage resource quota doc (#703)
|
2022-10-09 20:01:50 +08:00 |
|
Kerwin Zhang
|
e97d3fb0e5
|
[FEATURE] Support dictionary decoding for columnar shuffle reader (#744)
|
2022-10-09 20:00:39 +08:00 |
|
Kerwin Zhang
|
899616c5c0
|
[BUG] Scala match exception in columnar shuffle writer (#742)
|
2022-10-09 15:41:41 +08:00 |
|
AngersZhuuuu
|
13aeb4b644
|
[ISSUE-736][BUG] Heartbeat worker should update disk info into WorkInfo too to keep consistence with master (#737)
|
2022-10-09 15:41:01 +08:00 |
|
Kerwin Zhang
|
e7f9415ca1
|
[BUG] In a certain scenario, the worker will still use HA when HA is turned off (#727)
|
2022-10-09 14:57:23 +08:00 |
|
Ethan Feng
|
59474c2f11
|
[INFRA]Update scripts and templates for new name. (#724)
|
2022-10-09 14:56:06 +08:00 |
|
AngersZhuuuu
|
f2a234f870
|
[ISSUE-739][REFACTOR] Use object wrap pb message method (#740)
|
2022-10-09 11:53:48 +08:00 |
|
AngersZhuuuu
|
e221dbc117
|
[ISSUE-588][FOLLOWUP] Keep same code as spark2 (#732)
|
2022-10-08 21:05:19 +08:00 |
|
AngersZhuuuu
|
ae4bb12d5e
|
[ISSUE-630][REFACTOR] Minor change of storage resource quota, include code style, comment unused code etc.. (#728)
|
2022-10-08 20:15:25 +08:00 |
|
Binjie Yang
|
7f9e263113
|
Rename helm template and values
|
2022-10-08 20:14:37 +08:00 |
|
Ethan Feng
|
96e550f81c
|
Fix a npe that stuck lifecycle manager when a worker is offline. (#733)
|
2022-10-08 20:11:42 +08:00 |
|
Ethan Feng
|
6deda248ac
|
[REFACTOR]move lifecycle manager to correct package. (#730)
|
2022-10-08 18:14:08 +08:00 |
|
Cheng Pan
|
ab16b4f101
|
[INFRA] Rename modules w/ celeborn prefix (#723)
|
2022-10-08 08:05:57 +08:00 |
|
Cheng Pan
|
2b0d7ba654
|
Drop control message Scala wrapper - WorkerLost/WorkerLostResponse (#719)
|
2022-10-07 19:08:57 +08:00 |
|
Cheng Pan
|
2add6313c8
|
[BUILD] Bump scala-maven-plugin from 3.3.2 to 4.7.2 (#722)
|
2022-10-07 12:42:00 +08:00 |
|
Cheng Pan
|
20976039ec
|
[BUILD] lz4 and zstd should respect Spark build-in versions (#721)
|
2022-10-07 12:41:33 +08:00 |
|
Cheng Pan
|
abb4ce6405
|
Drop control message Scala wrapper - Revive/PartitionSplit/ChangeLocationResponse (#720)
|
2022-10-07 12:40:23 +08:00 |
|
Cheng Pan
|
a719709a17
|
Drop control message Scala wrapper - UnregisterShuffle/UnregisterShuffleResponse (#718)
|
2022-10-07 12:29:10 +08:00 |
|
Cheng Pan
|
fff6c20a03
|
[BUILD] mvn clean shoud remove Spark generated temporary files (#717)
|
2022-10-06 23:38:21 +08:00 |
|
Cheng Pan
|
cda133e11f
|
Drop control message Scala wrapper - RegisterShuffle/RegisterShuffleResponse (#716)
|
2022-10-06 23:37:36 +08:00 |
|
Keyong Zhou
|
a2d2379153
|
[DOC] Replace RSS with Celeborn in docs (#715)
|
2022-10-06 10:37:46 +08:00 |
|
Keyong Zhou
|
7fbd8ef755
|
Replace foreach(println) to count() to shrink UT output (#714)
|
2022-10-06 09:53:20 +08:00 |
|
Kerwin Zhang
|
5da5ea950a
|
[DOC] Update columnar shuffle config (#713)
|
2022-10-06 08:48:35 +08:00 |
|
Cheng Pan
|
4880d78d6a
|
Extract spark tests and improve pom (#711)
|
2022-10-04 10:23:26 +08:00 |
|
Keyong Zhou
|
fe3b5988f2
|
[REFACTOR] Change package name to org.apache.celeborn (#710)
|
2022-10-02 18:10:29 +08:00 |
|
AngersZhuuuu
|
51e723dc86
|
[ISSUE-704][FEATURE] Master check quota when LifecycleManager request CheckQuota (#705)
|
2022-10-01 16:39:13 +08:00 |
|
nafiy
|
b317886429
|
[ISSUE-635][FEATURE] Worker collect user level resource usage (#708)
|
2022-10-01 16:38:26 +08:00 |
|
Cheng Pan
|
ecd314e65f
|
[PB] Simplify disks representation (#707)
|
2022-09-30 23:18:33 +08:00 |
|
Kerwin Zhang
|
10cfdec18f
|
[DOC] Update the calculation method of the worker's slot count (#702)
|
2022-09-30 16:02:59 +08:00 |
|
nafiy
|
4cf3398a2c
|
[ISSUE-636][FEATURE] worker sent user usage to master through register worker/heartbeat from worker and master update usage (#693)
|
2022-09-30 14:34:01 +08:00 |
|
nafiy
|
18befe58ff
|
[ISSUE-691][BUG] SortBasedPusher pass 0 to allocateArray when calling growPointerArrayIfNecessary (#700)
|
2022-09-30 14:31:11 +08:00 |
|
Kerwin Zhang
|
1ccd1861cd
|
[ISSUE-526][FEATURE]Support code generation in the process of columnar to row (#699)
|
2022-09-29 19:17:48 +08:00 |
|
Kerwin Zhang
|
b7ba4fd6b1
|
[FEATURE] Support columnar shuffle for RSS shuffle writer (#698)
|
2022-09-29 17:56:46 +08:00 |
|
AngersZhuuuu
|
343caba83c
|
[ISSUE-656][FEATURE] Support get user quota from quota conf setting (#659)
[ISSUE-656][FEATURE] Support get user quota from rssConf setting
|
2022-09-29 12:55:01 +08:00 |
|