7b185a2562
### What changes were proposed in this pull request? Support specifying the number of dispatcher threads for each role, especially shuffle client side. For shuffle client, there is only RpcEndpointVerifier endpoint which handles not many requests, one thread is enough. The rpc env of other roles has only two endpoints at most, using a shared event loop is reasonable. I am not sure if there is a need to add rpc requests to shuffle client. So add specific parameters to specify the dispatcher threads here. And change the dispatcher thread pool name in order to distinguish it from spark's. ### Why are the changes needed? Ditto ### Does this PR introduce _any_ user-facing change? Yes, add params celeborn.\<role>.rpc.dispatcher.threads ### How was this patch tested? Manual test and UT Closes #2003 from onebox-li/my_dev. Authored-by: onebox-li <lyh-36@163.com> Signed-off-by: zky.zhoukeyong <zky.zhoukeyong@alibaba-inc.com> |
||
|---|---|---|
| .. | ||
| src | ||
| pom.xml | ||