Cheng Pan
|
89a2056a07
|
Fix binary tarball name in Dockerfile (#596)
|
2022-09-13 11:54:56 +08:00 |
|
nafiy
|
01d138bea4
|
[ISSUE-578][FEATURE] Add unit test for codec (#586)
|
2022-09-11 17:08:45 +08:00 |
|
Keyong Zhou
|
e0c4779fac
|
[ISSUE-591][BUG] Incorrect result when revive and split happen concur… (#592)
|
2022-09-10 23:30:39 +08:00 |
|
Keyong Zhou
|
1d7fec84da
|
[ISSUE-588][BUG] Fix memory leak in shuffle read (#589)
|
2022-09-10 22:07:13 +08:00 |
|
nafiy
|
0a60b21b56
|
[ISSUE-551][BUG] CompressionMethod and checksum are not consistent when zstd level is negative (#577)
|
2022-09-10 21:39:51 +08:00 |
|
Cheng Pan
|
f2ca6d68e4
|
[DOCS] Build website (#579)
|
2022-09-10 00:45:13 +08:00 |
|
AngersZhuuuu
|
0cf6f65696
|
[ISSUE-584][REFACTOR] Create FileWriter failed should show clear pathan mount point to help debug (#585)
|
2022-09-09 23:37:25 +08:00 |
|
AngersZhuuuu
|
b038a12469
|
[ISSUE-580] Add sorted file related metrics to collect PartitionSorter status (#581)
|
2022-09-09 23:36:35 +08:00 |
|
Keyong Zhou
|
a2cd01b8ef
|
[ISSUE-567][FOLLOW-UP] remove entry from latestPartitionLocation in removeExpiredShuffle (#575)
|
2022-09-08 11:21:42 +08:00 |
|
Ethan Feng
|
27f361c635
|
fix ci failure. (#574)
|
2022-09-08 11:17:42 +08:00 |
|
AngersZhuuuu
|
5ad89a2661
|
[ISSUE-548][Refactor] Unify code about master/worker's startup and HttpServer (#550)
|
2022-09-07 23:28:28 +08:00 |
|
AngersZhuuuu
|
da7ac1721b
|
[ISSUE-565][REFACTOR] Unify RPC name HeartbeatXxxxx (#566)
|
2022-09-07 21:33:18 +08:00 |
|
Binjie Yang
|
9152906bbd
|
[REFACTOR] Switch docker base image to Eclipse Temurin (#509)
|
2022-09-07 21:22:58 +08:00 |
|
AngersZhuuuu
|
ab2ef4ec3f
|
[ISSUE-568][BUG] MiniClusterFeature.createWorker should use correct RpcEnv (#569)
|
2022-09-07 21:20:16 +08:00 |
|
Keyong Zhou
|
f0b6346c9f
|
[ISSUE-567] Optimize LifecycleManager.getLatestPartition (#570)
|
2022-09-07 21:06:49 +08:00 |
|
Keyong Zhou
|
1cbca2c09f
|
[ISSUE-496][BUG]Ensure all file channels write whole buffer. (#561)
|
2022-09-07 12:21:02 +08:00 |
|
nafiy
|
644471debb
|
[ISSUE-516][FEATURE] Worker should clean remaining directory when start before registering to Master (#540)
|
2022-09-06 23:37:47 +08:00 |
|
Binjie Yang
|
8da0dfa948
|
[BUG] Fix start up and defaults config map using rss-svc (#558)
|
2022-09-06 14:59:46 +08:00 |
|
Kerwin Zhang
|
c2746436cb
|
[ISSUE-518] Get schema from shuffle dependency (#554)
|
2022-09-06 14:42:27 +08:00 |
|
Cheng Pan
|
cc4e32b146
|
Generate TransportMessages.proto into multiple files (#549)
|
2022-09-06 00:26:24 +08:00 |
|
AngersZhuuuu
|
4f24483cc9
|
[ISSUE-537][FEATURE] RPCSource implement Master RPC (#538)
|
2022-09-06 00:06:57 +08:00 |
|
Cheng Pan
|
b0580ce4c7
|
Bump latest Spark patched version (#547)
|
2022-09-06 00:01:05 +08:00 |
|
AngersZhuuuu
|
35d5b587ec
|
[Refactor] Modify package name of utils to keep consistence (#536)
|
2022-09-05 20:06:54 +08:00 |
|
Cheng Pan
|
29210fe9b7
|
[BUILD] Build in serial mode (#545)
|
2022-09-05 20:05:33 +08:00 |
|
AngersZhuuuu
|
c227dc4630
|
[ISSUE-543][FEATURE] Worker should enable HttpServer even not enable metric system (#544)
|
2022-09-05 19:57:31 +08:00 |
|
AngersZhuuuu
|
d4c794d25c
|
[Refactor] Remove unused isRegistered in controller (#542)
|
2022-09-05 19:53:51 +08:00 |
|
AngersZhuuuu
|
f7211204f2
|
[ISSUE-534][REFACTOR] Refactor log when call handleGetReducerFileGroup (#535)
|
2022-09-05 19:48:57 +08:00 |
|
Cheng Pan
|
82566148d8
|
Use different artifact name for shuffle manager 2/3 (#541)
|
2022-09-05 19:47:24 +08:00 |
|
Cheng Pan
|
4b42219595
|
Remove log4j1 (#501)
|
2022-09-05 19:30:15 +08:00 |
|
AngersZhuuuu
|
0f6617b74b
|
[ISSUE-531][REFACTOR] Fix wrong MetricsSystem.WORKER_ROLE (#532)
|
2022-09-05 14:36:31 +08:00 |
|
Cheng Pan
|
a9a69a16bc
|
[WORKER] Fast fail when rss.shuffle.maxChunksBeingTransferred exceeded (#530)
|
2022-09-05 13:48:29 +08:00 |
|
Kerwin Zhang
|
46892c271c
|
[issue-517] Spark3 patch to support columnar shuffle (#528)
|
2022-09-05 11:34:53 +08:00 |
|
Cheng Pan
|
5c2514a5c1
|
[WORKER] Cleanup StreamState when channel inactive (#527)
|
2022-09-05 11:31:03 +08:00 |
|
nafiy
|
02156f897b
|
[ISSUE-498][FEATURE] Worker should clean shuffle data if not enable graceful shutdown (#515)
|
2022-09-03 20:11:33 +08:00 |
|
Flyangz
|
79ede2262e
|
fix slots release when cleanup expired shuffle (#514)
|
2022-09-02 23:09:22 +08:00 |
|
Cheng Pan
|
f00b5a39bc
|
Extract OpenByteArrayOutputStream (#507)
|
2022-09-02 21:01:58 +08:00 |
|
AngersZhuuuu
|
1811c92afd
|
[ISSUE-511][DOC] Keep rss.ha.ratis.snapshot.auto.trigger.enabled 's default value same in code and doc (#512)
|
2022-09-02 18:26:29 +08:00 |
|
Cheng Pan
|
ba964d83f0
|
Skip leveldb test on Apple Silicon (#502)
|
2022-09-02 14:40:42 +08:00 |
|
Cheng Pan
|
ef593238a5
|
Recover maven property rss.shuffle.manager (#503)
|
2022-09-02 10:46:38 +08:00 |
|
Cheng Pan
|
7bc99ff7b5
|
HTTP server netty thread should has prefix and allow to bind host (#499)
|
2022-09-02 00:48:26 +08:00 |
|
Cheng Pan
|
e74a5f2a09
|
Remove unused git maven plugin (#500)
|
2022-09-02 00:45:55 +08:00 |
|
Cheng Pan
|
99e58e8e23
|
Improve logging for RetryingChunkClient (#470)
|
2022-09-02 00:44:26 +08:00 |
|
Cheng Pan
|
c88ce306be
|
Use Spotless to auto check and reformat Java/Scala code (#497)
|
2022-09-01 21:19:56 +08:00 |
|
AngersZhuuuu
|
87f529da35
|
[ISSUE-484][FEATURE] Add Worker related RPC metrics (#488)
|
2022-09-01 16:47:31 +08:00 |
|
DonJ
|
56e46763d9
|
Fix the problem of write loss when the buffer is too large (#495)
|
2022-09-01 16:01:04 +08:00 |
|
AngersZhuuuu
|
781a3bade8
|
[ISSUE-493][BUG] Should sync update sortingFiles and sortedFiles (#494)
|
2022-09-01 11:55:48 +08:00 |
|
AngersZhuuuu
|
74c1596d3a
|
[ISSUE-489][FEATURE] Implement more info for master and worker (#490)
|
2022-09-01 01:01:03 +08:00 |
|
Cheng Pan
|
3dddb65f31
|
Enable Apache Rat and fix license header (#492)
|
2022-08-31 23:53:33 +08:00 |
|
Ethan Feng
|
1a1145a86f
|
[ISSUE-334] read shuffle from hdfs. (#481)
|
2022-08-31 14:51:07 +08:00 |
|
AngersZhuuuu
|
2046a38293
|
[ISSUE-485][Refactor] Remove unused NetWorkSource (#486)
|
2022-08-30 21:04:55 +08:00 |
|