celeborn/worker/src
Chandni Singh d5a1bcdb6d [CELEBORN-1256] Added internal port and auth support to Celeborn worker
### What changes were proposed in this pull request?

This adds an internal port and auth support to Celeborn Wokers.
1. Internal port is used by a worker to receive messages from Celeborn Master.
2. Authentication support for secure communication with clients. This change doesn't add the support in clients to communicate to the Workers securely. That will be in a future change.

This change targets just adding the port and auth support to Worker. The following items from the proposal are still pending:

- Persisting the app secrets in Ratis.
- Forwarding secrets to Workers and having ability for the workers to pull registration info from the Master.
- Secured communication between workers and clients.

### Why are the changes needed?
It is needed for adding authentication support to Celeborn ([CELEBORN-1011](https://issues.apache.org/jira/browse/CELEBORN-1011))

### Does this PR introduce _any_ user-facing change?
Yes

### How was this patch tested?
Part of a bigger change. For this change, only modified existing UTs.

Closes #2292 from otterc/CELEBORN-1256.

Authored-by: Chandni Singh <singh.chandni@gmail.com>
Signed-off-by: waitinfuture <zky.zhoukeyong@alibaba-inc.com>
2024-02-29 10:09:22 +08:00
..
main [CELEBORN-1256] Added internal port and auth support to Celeborn worker 2024-02-29 10:09:22 +08:00
test [CELEBORN-1230] Check working directory read and write error without init delay 2024-02-16 00:07:01 +08:00