13 Commits

Author	SHA1	Message	Date
Angerszhuuuu	14c6e5719f	[CELEBORN-811] Refine monitoring doc ... ### What changes were proposed in this pull request? Refine monitoring doc 1. Remove unnecessary left side navigator 2. Add TOC in right side 3. fix list indentation Before  After  ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? Closes #1734 from AngersZhuuuu/CELEBORN-811. Authored-by: Angerszhuuuu <angers.zhu@gmail.com> Signed-off-by: Cheng Pan <chengpan@apache.org>	2023-07-19 20:53:21 +08:00
onebox-li	405b2801fa	[CELEBORN-810] Fix some typos and grammar ... ### What changes were proposed in this pull request? Fix some typos and grammar ### Why are the changes needed? Ditto ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? manually test Closes #1733 from onebox-li/fix-typo. Authored-by: onebox-li <lyh-36@163.com> Signed-off-by: zky.zhoukeyong <zky.zhoukeyong@alibaba-inc.com>	2023-07-19 18:35:38 +08:00
Fu Chen	17c1e01874	[CELEBORN-726] Update data replication terminology from master/slave to primary/replica for configurations and metrics ... ### What changes were proposed in this pull request? This pull PR is an integral component of #1639 . It primarily focuses on updating configuration settings and metrics terminology, while ensuring compatibility with older client versions by refraining from introducing changes related to RPC. ### Why are the changes needed? In order to distinguish it from the existing master/worker, refactor data replication terminology to 'primary/replica' for improved clarity and inclusivity in the codebase ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? existing tests. Closes #1650 from cfmcgrady/primary-replica-metrics. Authored-by: Fu Chen <cfmcgrady@gmail.com> Signed-off-by: Cheng Pan <chengpan@apache.org>	2023-06-29 09:47:02 +08:00
Angerszhuuuu	3985a5cbd7	[CELEBORN-666][FOLLOWUP] Unify all blacklist related code and comment ... ### What changes were proposed in this pull request? Unify all blacklist related code and comment ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? Closes #1638 from AngersZhuuuu/CELEBORN-666-FOLLOWUP. Authored-by: Angerszhuuuu <angers.zhu@gmail.com> Signed-off-by: zky.zhoukeyong <zky.zhoukeyong@alibaba-inc.com>	2023-06-28 16:28:03 +08:00
Angerszhuuuu	1ba6dee324	[CELEBORN-680][DOC] Refresh celeborn configurations in doc ... ### What changes were proposed in this pull request? Refresh celeborn configurations in doc ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? Closes #1592 from AngersZhuuuu/CELEBORN-680. Authored-by: Angerszhuuuu <angers.zhu@gmail.com> Signed-off-by: Angerszhuuuu <angers.zhu@gmail.com>	2023-06-15 13:59:38 +08:00
onebox-li	0c869ac9a0	[CELEBORN-642] Improve metrics and update grafana ... ### What changes were proposed in this pull request? Change in grafana （ALL） add: JVMCPUTime LastMinuteSystemLoad AvailableProcessors （For Master） add: LostWorkers IsActiveMaster PartitionSize （For Worker） add: PushDataFailCount -> WriteDataFailCount ReplicateDataFailCount ReplicateDataWriteFailCount ReplicateDataCreateConnectionFailCount ReplicateDataConnectionExceptionCount ReplicateDataTimeoutCount SortedFileSize PushDataHandshakeFailCount RegionStartFailCount RegionFinishFailCount MasterPushDataHandshakeTime SlavePushDataHandshakeTime MasterRegionStartTime SlaveRegionStartTime MasterRegionFinishTime SlaveRegionFinishTime PotentialConsumeSpeed UserProduceSpeed WorkerConsumeSpeed DeviceOSFreeBytes DeviceCelebornFreeBytes push usedHeapMemory/usedDirectMemory fetch usedHeapMemory/usedDirectMemory replicate usedHeapMemory/usedDirectMemory remove: dup ReserveSlotsTime Change dashboard layout. Fix support for multiple labels. Modify some metrics docs. ### Why are the changes needed? For better use of metrics. ### Does this PR introduce _any_ user-facing change? Below metrics change name, extract some value to the label. DeviceOSFreeCapacity(B) -> DeviceOSFreeBytes DeviceOSTotalCapacity(B) -> DeviceOSTotalBytes DeviceCelebornFreeCapacity(B) -> DeviceCelebornFreeBytes DeviceCelebornTotalCapacity(B) -> DeviceCelebornTotalBytes push usedHeapMemory/usedDirectMemory fetch usedHeapMemory/usedDirectMemory replicate usedHeapMemory/usedDirectMemory ### How was this patch tested? Cluster test. Closes #1557 from onebox-li/improve-metrics. Authored-by: onebox-li <lyh-36@163.com> Signed-off-by: Cheng Pan <chengpan@apache.org>	2023-06-08 18:10:06 +08:00
Angerszhuuuu	64a3534f71	[CELEBORN-584] Worker side should expose push/replicate/fetch Netty allocator metrics (#1489)	2023-05-16 17:51:33 +08:00
Angerszhuuuu	d657f8268a	[CELEBORN-586] Add SystemMiscSource to indicate system running status (#1488)	2023-05-16 14:03:07 +08:00
Ethan Feng	91b757555e	[CELEBORN-570] Update docs about monitor and deployment. (#1478)	2023-05-08 17:07:42 +08:00
Angerszhuuuu	0c2d3e647d	[CELEBORN-532][METRICS] Refine push-related failure metrics (#1442) ... * [CELEBORN-532][METRICS] Refine push-related failure metrics	2023-04-21 17:05:43 +08:00
Angerszhuuuu	e319b99a1c	[CELEBORN-527][DOC] Fix incorrect monitor the arrangement of documents (#1432)	2023-04-17 11:12:19 +08:00
Angerszhuuuu	ecafbf41fc	[CELEBORN-516][FOLLOWUP] Remove removed RPC metrics in metric doc (#1431)	2023-04-17 10:46:04 +08:00
Cheng Pan	fb7b311c89	[CELEBORN-499] Move version specific resource to main repo (#1429) ... * [CELEBORN-499] Move version specific resource to main repo * license	2023-04-14 16:20:51 +08:00