Angerszhuuuu
|
cf308aa057
|
[CLEBORN-595] Refine code frame of CelebornConf (#1525)
|
2023-06-01 10:37:58 +08:00 |
|
Angerszhuuuu
|
6d5dd50915
|
[CELEBORN-595][FOLLOWUP] Fix change version to 0.3.0. (#1522)
|
2023-05-30 20:12:56 +08:00 |
|
Angerszhuuuu
|
62681ba85d
|
[CELEBORN-595] Rename and refactor the configuration doc. (#1501)
|
2023-05-30 15:14:12 +08:00 |
|
zhongqiangchen
|
f117cff776
|
[CELEBORN-618] [FLINK] worker side adds partition split configuration options (#1520)
|
2023-05-30 14:13:31 +08:00 |
|
Binjie Yang
|
d30f45ad63
|
[CELEBORN-450][HELM] Configurable volumes in the values.yaml (#1508)
* [CELEBORN-450] Configure the mount & volume in the Values.yaml
* fix comments
* fix wrong name
* fix comments
* fix typo
* fix into array
* Wiht User Note Comments
* fix comments
* Update charts/celeborn/templates/worker-statefulset.yaml
---------
Co-authored-by: Cheng Pan <pan3793@gmail.com>
|
2023-05-29 13:48:23 +08:00 |
|
Angerszhuuuu
|
d244f44518
|
[CELEBORN-593] Refine some RPC related default configurations (#1498)
|
2023-05-19 18:23:12 +08:00 |
|
Angerszhuuuu
|
615d9a111f
|
[CELEBORN-487] Remove wrong space of config SHUFFLE_CLIENT_PUSH_BLACK (#1500)
|
2023-05-19 14:27:57 +08:00 |
|
Angerszhuuuu
|
811e192bbd
|
[CELEBORN-446] Support rack aware during assign slots for ROUNDROBIN (#1370)
|
2023-05-18 13:58:51 +08:00 |
|
Ethan Feng
|
7015d2463a
|
[CELEBORN-583] Merge pooled memory allocators. (#1490)
|
2023-05-18 10:37:30 +08:00 |
|
Angerszhuuuu
|
791d72d45f
|
[CELEBORN-590] Remove hadoop prefix of WORKER_WORKING_DIR (#1494)
|
2023-05-17 17:57:27 +08:00 |
|
Angerszhuuuu
|
7c6cb2f3bb
|
[CELEBORN-588] Remove test conf's category (#1491)
|
2023-05-17 17:37:28 +08:00 |
|
Angerszhuuuu
|
64a3534f71
|
[CELEBORN-584] Worker side should expose push/replicate/fetch Netty allocator metrics (#1489)
|
2023-05-16 17:51:33 +08:00 |
|
Angerszhuuuu
|
d657f8268a
|
[CELEBORN-586] Add SystemMiscSource to indicate system running status (#1488)
|
2023-05-16 14:03:07 +08:00 |
|
zhongqiangchen
|
5769c3fdc7
|
[CELEBORN-552] Add HeartBeat between the client and worker to keep alive (#1457)
|
2023-05-10 19:35:51 +08:00 |
|
Angerszhuuuu
|
778b5440bc
|
[CELEBORN-556][BUG] ReserveSlot should not use default RPC time out since register shuffle max timeout is network timeout (#1461)
|
2023-05-10 12:29:06 +08:00 |
|
Ethan Feng
|
3e0d779962
|
[CELEBORN-576] Add static identity provider and manually settable identity provider for non-hadoop environment. (#1480)
|
2023-05-08 17:29:01 +08:00 |
|
Ethan Feng
|
91b757555e
|
[CELEBORN-570] Update docs about monitor and deployment. (#1478)
|
2023-05-08 17:07:42 +08:00 |
|
Angerszhuuuu
|
ef4c12e0fe
|
[CELEBORN-565] FETCH_MAX_RETRIES should double when enable replicates (#1471)
|
2023-04-28 14:27:35 +08:00 |
|
Angerszhuuuu
|
13ce04f8a1
|
[CELEBORN-557] HA_CLIENT_RPC_ASK_TIMEOUT should fallback to RPC_ASK_TIMEOUT (#1462)
* [CELEBORN-557] HA_CLIENT_RPC_ASK_TIMEOUT should fallback to RPC_ASK_TIMEOUT
|
2023-04-26 15:19:34 +08:00 |
|
Shuang
|
0b2e4877bd
|
[CELEBORN-553] Improve IO (#1458)
|
2023-04-25 21:14:06 +08:00 |
|
Angerszhuuuu
|
0c2d3e647d
|
[CELEBORN-532][METRICS] Refine push-related failure metrics (#1442)
* [CELEBORN-532][METRICS] Refine push-related failure metrics
|
2023-04-21 17:05:43 +08:00 |
|
Angerszhuuuu
|
181c1bfcd6
|
[CELEBORN-524][PERF] CongestionControl call too much ChannelsLimiter onTrim cause CPU stuck or occupy too much CPU cause no cpu for handlePushData (#1428)
|
2023-04-21 15:44:56 +08:00 |
|
Angerszhuuuu
|
6830cb61ef
|
[CELEBORN-540][Refactor] Add config entity of celeborn.rpc.io.threads (#1443)
* [CELEBORN-540][CONF] Add config entity of celeborn.rpc.io.threads
|
2023-04-21 11:21:41 +08:00 |
|
Angerszhuuuu
|
e319b99a1c
|
[CELEBORN-527][DOC] Fix incorrect monitor the arrangement of documents (#1432)
|
2023-04-17 11:12:19 +08:00 |
|
Angerszhuuuu
|
ecafbf41fc
|
[CELEBORN-516][FOLLOWUP] Remove removed RPC metrics in metric doc (#1431)
|
2023-04-17 10:46:04 +08:00 |
|
cxzl25
|
13f772e0c0
|
[CELEBORN-525] Fix wrong parameter celeborn.push.buffer.size
|
2023-04-14 20:45:25 +08:00 |
|
Cheng Pan
|
fb7b311c89
|
[CELEBORN-499] Move version specific resource to main repo (#1429)
* [CELEBORN-499] Move version specific resource to main repo
* license
|
2023-04-14 16:20:51 +08:00 |
|
Ethan Feng
|
9cccfc9872
|
[CELEBORN-431][FLINK] Support dynamic buffer allocation in reading map partition. (#1407)
|
2023-04-13 10:37:47 +08:00 |
|
Angerszhuuuu
|
e5722126e9
|
[CELEBORN-502][REFACTOR] Merge GetBlacklistResponse to HeartbeatFromApplication (#1408)
* [CELEBORN-502][REFACTOR] Merge GetBlacklistResponse to HeartbeatFromApplication
|
2023-04-12 14:59:32 +08:00 |
|
Angerszhuuuu
|
cad2836e85
|
[CELEBORN-505] Fix typo of SHUFFLE_CHUCK_SIZE (#1411)
|
2023-04-04 19:15:30 +08:00 |
|
Keyong Zhou
|
2e1598c011
|
[CELEBORN-485] Make celeborn.push.replicate.enabled default to false (#1394)
|
2023-04-03 16:36:29 +08:00 |
|
Angerszhuuuu
|
bf46336d54
|
[CELEBORN-487][PERF] ShuffleClientSide support blacklist to avoid client side timeout in same worker multiple times (#1399)
|
2023-04-03 11:50:04 +08:00 |
|
zhongqiangchen
|
cd92c423cd
|
[CELEBORN-475] Support extra tags for prometheus metrics (#1385)
[CELEBORN-475] Support extra tags for prometheus metrics
|
2023-03-28 21:22:28 +08:00 |
|
Keyong Zhou
|
cb19ed1c66
|
[CELEBORN-479][PERF] Refactor DataPushQueue.takePushTask to avoid busy wait (#1386)
|
2023-03-27 16:18:55 +08:00 |
|
Shuang
|
89b3f3887d
|
[CELEBORN-356] [FLINK] Support release single partition resource (#1314)
|
2023-03-24 17:15:28 +08:00 |
|
Ethan Feng
|
0ebad677d7
|
[CELEBORN-434] Add constrain about memory manager's parameters. (#1356)
|
2023-03-17 15:14:03 +08:00 |
|
Angerszhuuuu
|
4b334df7a6
|
[CELEBORN-399] Make fileSorterExecutors thread num can be customized (#1325)
|
2023-03-10 21:10:43 +08:00 |
|
Keyong Zhou
|
dcedf7b0a9
|
[CELEBORN-348] Support fetchTime in load-aware slots assignment strategy (#1287)
|
2023-03-02 18:31:50 +08:00 |
|
zhongqiangchen
|
cb76c4de4c
|
[CELEBORN-350][FLINK] Add PluginConf to be compatible with old configurations
|
2023-02-28 20:36:11 +08:00 |
|
Keyong Zhou
|
7adf1fca41
|
[CELEBORN-295] Optimize data push (#1232)
* [CELEBORN-295] Add double buffer for sort pusher
|
2023-02-28 10:35:55 +08:00 |
|
Ethan Feng
|
0c8bb83114
|
[CELEBORN-234] Implement buffer stream. (#1221)
|
2023-02-17 17:38:36 +08:00 |
|
Ethan Feng
|
3aacede5f8
|
[CELEBORN-283] Derive network layer for flink plugin. (#1222)
|
2023-02-17 14:12:54 +08:00 |
|
jiaoqingbo
|
3a92b0d911
|
[CELEBORN-284] fix typo in CelebornConf (#1218)
Co-authored-by: jiaoqb <jiaoqb@asiainfo.com>
|
2023-02-10 14:59:36 +08:00 |
|
Rex(Hui) An
|
bff6e91e0b
|
[CELEBORN-227] Support different push strategies to control the push speed (#1167)
|
2023-02-07 14:24:30 +08:00 |
|
Rex(Hui) An
|
bb113ec9be
|
[CELEBORN-207] Support network congestion control (#1066)
|
2023-02-07 12:06:18 +08:00 |
|
Angerszhuuuu
|
4b6f7e4593
|
[CELEBORN-239][IMPROVEMENT] Worker replicate should enable push data timeout too (#1185)
|
2023-02-03 11:53:15 +08:00 |
|
Angerszhuuuu
|
04427f2b16
|
[CELEBORN-247] Add metrics for each user's quota usage (#1182)
|
2023-02-02 18:31:08 +08:00 |
|
Angerszhuuuu
|
122da47815
|
[CELEBORN-241][IMPROVEMENT] limit inflight push timeout should > push data timeout (#1179)
|
2023-01-30 11:57:07 +08:00 |
|
zy.jordan
|
c5be79ee3d
|
[CELEBORN-55][FEATURE] Split maxReqsInFlight limitation into level of target worker (#1102)
|
2023-01-20 10:18:45 +08:00 |
|
Ethan Feng
|
a239f9f284
|
[CELEBORN-228]Refactor PartitionFileSorter to avoid specific JDK dependency. (#1168)
|
2023-01-16 20:06:47 +08:00 |
|