Angerszhuuuu
|
6830cb61ef
|
[CELEBORN-540][Refactor] Add config entity of celeborn.rpc.io.threads (#1443)
* [CELEBORN-540][CONF] Add config entity of celeborn.rpc.io.threads
|
2023-04-21 11:21:41 +08:00 |
|
Angerszhuuuu
|
e319b99a1c
|
[CELEBORN-527][DOC] Fix incorrect monitor the arrangement of documents (#1432)
|
2023-04-17 11:12:19 +08:00 |
|
Angerszhuuuu
|
ecafbf41fc
|
[CELEBORN-516][FOLLOWUP] Remove removed RPC metrics in metric doc (#1431)
|
2023-04-17 10:46:04 +08:00 |
|
cxzl25
|
13f772e0c0
|
[CELEBORN-525] Fix wrong parameter celeborn.push.buffer.size
|
2023-04-14 20:45:25 +08:00 |
|
Cheng Pan
|
fb7b311c89
|
[CELEBORN-499] Move version specific resource to main repo (#1429)
* [CELEBORN-499] Move version specific resource to main repo
* license
|
2023-04-14 16:20:51 +08:00 |
|
Ethan Feng
|
9cccfc9872
|
[CELEBORN-431][FLINK] Support dynamic buffer allocation in reading map partition. (#1407)
|
2023-04-13 10:37:47 +08:00 |
|
Angerszhuuuu
|
e5722126e9
|
[CELEBORN-502][REFACTOR] Merge GetBlacklistResponse to HeartbeatFromApplication (#1408)
* [CELEBORN-502][REFACTOR] Merge GetBlacklistResponse to HeartbeatFromApplication
|
2023-04-12 14:59:32 +08:00 |
|
Angerszhuuuu
|
cad2836e85
|
[CELEBORN-505] Fix typo of SHUFFLE_CHUCK_SIZE (#1411)
|
2023-04-04 19:15:30 +08:00 |
|
Keyong Zhou
|
2e1598c011
|
[CELEBORN-485] Make celeborn.push.replicate.enabled default to false (#1394)
|
2023-04-03 16:36:29 +08:00 |
|
Angerszhuuuu
|
bf46336d54
|
[CELEBORN-487][PERF] ShuffleClientSide support blacklist to avoid client side timeout in same worker multiple times (#1399)
|
2023-04-03 11:50:04 +08:00 |
|
zhongqiangchen
|
cd92c423cd
|
[CELEBORN-475] Support extra tags for prometheus metrics (#1385)
[CELEBORN-475] Support extra tags for prometheus metrics
|
2023-03-28 21:22:28 +08:00 |
|
Keyong Zhou
|
cb19ed1c66
|
[CELEBORN-479][PERF] Refactor DataPushQueue.takePushTask to avoid busy wait (#1386)
|
2023-03-27 16:18:55 +08:00 |
|
Shuang
|
89b3f3887d
|
[CELEBORN-356] [FLINK] Support release single partition resource (#1314)
|
2023-03-24 17:15:28 +08:00 |
|
Ethan Feng
|
0ebad677d7
|
[CELEBORN-434] Add constrain about memory manager's parameters. (#1356)
|
2023-03-17 15:14:03 +08:00 |
|
Angerszhuuuu
|
4b334df7a6
|
[CELEBORN-399] Make fileSorterExecutors thread num can be customized (#1325)
|
2023-03-10 21:10:43 +08:00 |
|
Keyong Zhou
|
dcedf7b0a9
|
[CELEBORN-348] Support fetchTime in load-aware slots assignment strategy (#1287)
|
2023-03-02 18:31:50 +08:00 |
|
zhongqiangchen
|
cb76c4de4c
|
[CELEBORN-350][FLINK] Add PluginConf to be compatible with old configurations
|
2023-02-28 20:36:11 +08:00 |
|
Keyong Zhou
|
7adf1fca41
|
[CELEBORN-295] Optimize data push (#1232)
* [CELEBORN-295] Add double buffer for sort pusher
|
2023-02-28 10:35:55 +08:00 |
|
Ethan Feng
|
0c8bb83114
|
[CELEBORN-234] Implement buffer stream. (#1221)
|
2023-02-17 17:38:36 +08:00 |
|
Ethan Feng
|
3aacede5f8
|
[CELEBORN-283] Derive network layer for flink plugin. (#1222)
|
2023-02-17 14:12:54 +08:00 |
|
jiaoqingbo
|
3a92b0d911
|
[CELEBORN-284] fix typo in CelebornConf (#1218)
Co-authored-by: jiaoqb <jiaoqb@asiainfo.com>
|
2023-02-10 14:59:36 +08:00 |
|
Rex(Hui) An
|
bff6e91e0b
|
[CELEBORN-227] Support different push strategies to control the push speed (#1167)
|
2023-02-07 14:24:30 +08:00 |
|
Rex(Hui) An
|
bb113ec9be
|
[CELEBORN-207] Support network congestion control (#1066)
|
2023-02-07 12:06:18 +08:00 |
|
Angerszhuuuu
|
4b6f7e4593
|
[CELEBORN-239][IMPROVEMENT] Worker replicate should enable push data timeout too (#1185)
|
2023-02-03 11:53:15 +08:00 |
|
Angerszhuuuu
|
04427f2b16
|
[CELEBORN-247] Add metrics for each user's quota usage (#1182)
|
2023-02-02 18:31:08 +08:00 |
|
Angerszhuuuu
|
122da47815
|
[CELEBORN-241][IMPROVEMENT] limit inflight push timeout should > push data timeout (#1179)
|
2023-01-30 11:57:07 +08:00 |
|
zy.jordan
|
c5be79ee3d
|
[CELEBORN-55][FEATURE] Split maxReqsInFlight limitation into level of target worker (#1102)
|
2023-01-20 10:18:45 +08:00 |
|
Ethan Feng
|
a239f9f284
|
[CELEBORN-228]Refactor PartitionFileSorter to avoid specific JDK dependency. (#1168)
|
2023-01-16 20:06:47 +08:00 |
|
zy.jordan
|
bb96700415
|
[CELEBORN-223] The default rpc thread num of pushServer/replicateServer/fetchServer should be the number of total of Flusher's thread (#1163)
|
2023-01-16 12:03:46 +08:00 |
|
Keyong Zhou
|
fa7ba43136
|
[CELEBORN-225] Add global default configuration for number of flusher… (#1165)
|
2023-01-14 13:20:44 +08:00 |
|
zhongqiangczq
|
411ab09ffb
|
[CELEBORN-158][Flink] Add ShuffleServiceFactory to Support MapPartition in … (#1105)
|
2023-01-13 16:38:46 +08:00 |
|
Shuang
|
1332362bff
|
[CELEBORN-213] Add configuration for whether to close idle connections in client side (#1157)
|
2023-01-10 19:13:33 +08:00 |
|
zy.jordan
|
19197b9190
|
[CELEBORN-214] Push/Replicate/Fetch io threads default value is 16 (#1158)
|
2023-01-10 17:46:56 +08:00 |
|
Angerszhuuuu
|
e155ec122a
|
[CELEBORN-190] doPushMergedData should also support revive multiple times, not only twice (#1136)
|
2023-01-10 11:39:40 +08:00 |
|
Angerszhuuuu
|
415452d9c4
|
[CELEBORN-189][IMPROVEMENT] PushDataFailedSlave should add slave worker to blacklist (#1135)
|
2023-01-05 20:12:07 +08:00 |
|
RexAn
|
6432a129be
|
[CELEBORN-61][CELEBORN-62][FOLLOW_UP] Fix some issues for slow start (#1119)
|
2022-12-29 12:07:20 +08:00 |
|
Ethan Feng
|
5aa959a335
|
[CELEBORN-157] Change prefix of configurations to celeborn. (#1104)
|
2022-12-21 15:17:28 +08:00 |
|
Keyong Zhou
|
2f0682265e
|
[CELEBORN-119] Add timeout for pushdata (#1097)
|
2022-12-20 20:40:42 +08:00 |
|
nafiy
|
c931663e5f
|
[CELEBORN-110][REFACTOR] Notify critical error after collecting a certain number of non-critical error (#1055)
|
2022-12-16 15:47:36 +08:00 |
|
nafiy
|
2e37830a0f
|
[CELEBORN-139][BUG] Fix read wrong yaml file format when loading config (#1083)
|
2022-12-14 20:56:04 +08:00 |
|
Angerszhuuuu
|
de3ef0d694
|
[CELEBORN-102][REFACTOR] TIMEOUT default value should be changed with network timeout (#1047)
* [CELEBORN-102][REFACTOR] TIMEOUT default value should be changed with network timeout
|
2022-12-06 14:41:23 +08:00 |
|
Ethan Feng
|
acfaf59ab3
|
[CELEBORN-91] Refactor memory tracker to support read buffer. (#1038)
* [CELEBORN-91] Refactor memory tracker to support read buffer.
|
2022-12-05 15:38:43 +08:00 |
|
nafiy
|
8e384cda5a
|
[CELEBORN-88][REFACTOR] Revive/PartitionSplit should set separated timeout configuration (#1046)
|
2022-12-05 10:36:43 +08:00 |
|
nafiy
|
44d45c2a27
|
[CELEBORN-90][REFACTOR] GetReducerFileGroup should support separated timeout configuration (#1045)
|
2022-12-02 22:53:51 +08:00 |
|
nafiy
|
13e1e24035
|
[CELEBORN-86][REFATCOR] Register shuffle should have separated timeout configuration (#1031)
* [CELEBORN-86][REFATCOR] Register shuffle should have separated timeout configuration
|
2022-12-01 18:39:56 +08:00 |
|
nafiy
|
d584211a75
|
[CELEBORN-95][REFACTOR]Rename CLIENT_RPC_ASK_TIMEOUT to HA_CLIENT_RPC_ASK_TIMEOUT (#1037)
|
2022-12-01 11:57:02 +08:00 |
|
zhongqiangczq
|
898d1126a6
|
[CELEBORN-11] ShuffleClient supports MapPartition shuffle write: send handshake/regionstart/regionfinish (#1035)
|
2022-12-01 11:20:55 +08:00 |
|
Angerszhuuuu
|
d26e73209b
|
[CELEBORN-76] Support batch commit hard split partition before stage end
|
2022-11-29 13:09:01 +08:00 |
|
Cheng Pan
|
9bf4c65357
|
[CELEBORN-72][DOCS] Remove unused website resources from main repo (#1014)
|
2022-11-28 09:47:30 +08:00 |
|
Keyong Zhou
|
f8bb2cd47d
|
[CELEBORN-12]Retry on CommitFile request (#1011)
|
2022-11-26 20:56:24 +08:00 |
|