Kerwin Zhang
|
461a03d72f
|
[ISSUE-672] Do not update stats for each record in columnar shuffle write (#686)
|
2022-09-28 18:34:04 +08:00 |
|
Ethan Feng
|
e4907ce3d7
|
remove chunkfetchsize metric. (#696)
|
2022-09-28 18:22:34 +08:00 |
|
AngersZhuuuu
|
0e531c7e59
|
[ISSUE-631][FOLLOWUP] UserIdentifier support to/from string (#695)
|
2022-09-28 17:51:17 +08:00 |
|
Binjie Yang
|
f36e0925ff
|
Remove useless case in StorageManager (#692)
|
2022-09-27 23:39:10 +08:00 |
|
nafiy
|
5d4533fb85
|
[ISSUE-632][FEATURE] LifecycleManager side ReserveSlots & RequestSlots RPC with UserIdentifier (#679)
|
2022-09-27 00:01:44 +08:00 |
|
Cheng Pan
|
552db652bc
|
Initial implement structured configuration system (#682)
|
2022-09-26 21:47:40 +08:00 |
|
Ethan Feng
|
ea726b1cfd
|
[BUG]Fix query metrics caused NPE when there are no chunk fetch data. (#689)
|
2022-09-26 18:34:31 +08:00 |
|
Ethan Feng
|
68c633fd1b
|
Fix UT failure. (#687)
|
2022-09-26 18:08:43 +08:00 |
|
Kerwin Zhang
|
2a789a76fc
|
[ISSUE-522] Support columnar shuffle for RSS shuffle reader (#683)
|
2022-09-26 16:12:24 +08:00 |
|
Cheng Pan
|
761a00b0f5
|
Drop control message Scala wrapper - RegisterWorker/RegisterWorkerResponse (#680)
|
2022-09-26 15:29:39 +08:00 |
|
Cheng Pan
|
b4a1eb2e75
|
Drop control message Scala wrapper V2 - CheckForWorkerTimeOut (#678)
|
2022-09-25 17:21:23 +08:00 |
|
zky.zhoukeyong
|
421a0ec3ae
|
Revert "Drop control message Scala wrapper - CheckForWorkerTimeOut (#674)"
This reverts commit 56bfe7fdd6.
|
2022-09-25 17:19:02 +08:00 |
|
zky.zhoukeyong
|
20c15a8e9d
|
Revert "Drop control message Scala wrapper - CheckForApplicationTimeOut (#675)"
This reverts commit 5a2ab73b55.
|
2022-09-25 17:18:53 +08:00 |
|
zky.zhoukeyong
|
a2522745d2
|
Revert "Drop control message Scala wrapper - RemoveExpiredShuffle (#676)"
This reverts commit a160cd90cb.
|
2022-09-25 17:18:41 +08:00 |
|
Cheng Pan
|
a160cd90cb
|
Drop control message Scala wrapper - RemoveExpiredShuffle (#676)
|
2022-09-24 23:23:36 +08:00 |
|
Cheng Pan
|
5a2ab73b55
|
Drop control message Scala wrapper - CheckForApplicationTimeOut (#675)
|
2022-09-24 22:24:28 +08:00 |
|
Cheng Pan
|
56bfe7fdd6
|
Drop control message Scala wrapper - CheckForWorkerTimeOut (#674)
|
2022-09-24 20:04:33 +08:00 |
|
Kerwin Zhang
|
7937124fc9
|
[ISSUE-670] [FEATURE] Add configuration for columnar shuffle (#671)
|
2022-09-24 17:56:21 +08:00 |
|
Kerwin Zhang
|
5b4c87ee1c
|
[ISSUE-668] [FEATURE] Add columnar shuffle configuration for RSS (#669)
|
2022-09-24 12:11:12 +08:00 |
|
Kerwin Zhang
|
720fde0c34
|
[ISSUE-664] [FEATURE] Add serializer for shuffle read and write (#665)
|
2022-09-23 21:47:32 +08:00 |
|
Ethan Feng
|
9822064c1c
|
[BUG]Fix flusher default thread count setting is not effective (#667)
|
2022-09-23 21:16:10 +08:00 |
|
Ethan Feng
|
30d4323cdb
|
[FEATURE] Add a configuration to enable a map id filter mechanism. #662 (#663)
|
2022-09-23 18:38:52 +08:00 |
|
Ethan Feng
|
4a7a7d42b5
|
[FEATURE] Add metrics about fetch chunk size, commit files time and get reducer file time (#661)
|
2022-09-23 16:05:28 +08:00 |
|
Ethan Feng
|
b4654d788c
|
[ISSUE-607]Add map ids info for each PartitionLocation to enable filtering for m… (#619)
|
2022-09-23 15:21:41 +08:00 |
|
AngersZhuuuu
|
9db42f24d2
|
[ISSUE-649][REFACTOR] Rewrite Spark2's RSSShuffleManager to keep consistence (#650)
|
2022-09-23 09:49:12 +08:00 |
|
AngersZhuuuu
|
a6b8af2b00
|
[ISSUE-637][FEATURE] Change CheckAlive to CheckAvailable and reply checkQuota result (#658)
|
2022-09-22 21:54:45 +08:00 |
|
Binjie Yang
|
1d6939bdf4
|
split (#657)
|
2022-09-22 17:53:42 +08:00 |
|
Binjie Yang
|
9f20aabb48
|
[IMPORVE] Fix grafana dashboard json metrics_OfferSlotsTime_Max & metrics_OfferSlotsTime_Mean target datasource (#655)
|
2022-09-22 17:45:38 +08:00 |
|
mcdull_zhang
|
cba7dc6f71
|
nit (#654)
|
2022-09-22 17:42:25 +08:00 |
|
nafiy
|
8e8645bb01
|
[ISSUE-640][Refactor] Refactor Protobuf related name format (#653)
|
2022-09-22 14:52:12 +08:00 |
|
Keyong Zhou
|
dd17ec4661
|
Minor refine (#648)
|
2022-09-21 18:09:35 +08:00 |
|
AngersZhuuuu
|
df5ba55ea5
|
[ISSUE-633][FEATURE] Support provider user identity by customized class and keep LifecycleManager and ShuffleClient user identity consistence (#646)
|
2022-09-21 17:35:59 +08:00 |
|
AngersZhuuuu
|
0ae096e56f
|
[ISSUE-634][FEATURE] Add ResourceConsumption class to indicate resource usage (#641)
|
2022-09-21 15:51:14 +08:00 |
|
Ethan Feng
|
3c917c577b
|
Fix worker replied ack at the wrong time when a soft split is triggered. (#645)
|
2022-09-21 15:07:21 +08:00 |
|
AngersZhuuuu
|
33ce3d3d33
|
[ISSUE-631][FEATURE] Add UserIdentifier proto class (#638)
|
2022-09-21 11:04:24 +08:00 |
|
Kerwin Zhang
|
b1d3de17f4
|
[ISSUE-521] Support columnar to row for shuffle reader (#628)
|
2022-09-20 23:34:55 +08:00 |
|
Cheng Pan
|
b51abeed96
|
Improve code smell (#624)
|
2022-09-20 10:03:02 +08:00 |
|
Keyong Zhou
|
30a5afb816
|
[ISSUE-625][BUG] Incorrect result when kill worker while pushMergedData (#627)
|
2022-09-20 00:05:15 +08:00 |
|
Cheng Pan
|
adfc344b4d
|
Correct propagating heartbeat values (#623)
|
2022-09-19 23:55:23 +08:00 |
|
nafiy
|
c4f40eed90
|
[ISSUE-610][BUG] PartitionFilesSorter sorting pendingBuffer not enough cause job failed (#616)
|
2022-09-19 19:43:04 +08:00 |
|
Kerwin Zhang
|
0a588f151b
|
[ISSUE-523] Support encoding for shuffle writer (#602)
|
2022-09-19 15:58:12 +08:00 |
|
Cheng Pan
|
618da0c70d
|
Correct environment variable RSS_LOCAL_IP (#618)
|
2022-09-19 14:54:49 +08:00 |
|
AngersZhuuuu
|
e48efb2e1c
|
[ISSUE-611][BUG] FetchHandler should handle PartitionFileSorter return null and we should enable retry for sorter exception (#615)
|
2022-09-19 14:51:46 +08:00 |
|
xunxunmimi5577
|
2cc47ccfa2
|
DeviceMonitor init failed because of NPE. (#608)
|
2022-09-18 20:24:04 +08:00 |
|
AngersZhuuuu
|
979c22a430
|
[ISSUE-612][Refactor] Refactor error log of PartitionFileSorter (#614)
|
2022-09-18 12:25:09 +08:00 |
|
nafiy
|
ff52f30592
|
[ISSUE-609][REFACTOR] Change SortBasedShuffleWriter push giant record log level (#613)
|
2022-09-18 12:23:32 +08:00 |
|
nafiy
|
75ca396e77
|
[ISSUE-600][Refactor] Translate Chinese comments to English (#605)
|
2022-09-15 22:24:39 +08:00 |
|
Keyong Zhou
|
0dc7e82006
|
improve revive log readability. (#603) (#604)
Co-authored-by: Ethan Feng <fengmingxiao.fmx@alibaba-inc.com>
|
2022-09-14 23:25:49 +08:00 |
|
AngersZhuuuu
|
a6acaa11e0
|
[ISSUE-597][REFACTOR] Unify Enum type name and correct wrong UN_KOWN (#598)
|
2022-09-13 19:07:48 +08:00 |
|
Kerwin Zhang
|
3c9ce46bf9
|
[ISSUE-519] Support row to columnar for shuffle writer (#560)
|
2022-09-13 16:54:45 +08:00 |
|