apache/celeborn
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
ae41cb5ade
celeborn/openapi/openapi-client
History
Wang, Fei ae41cb5ade [CELEBORN-1537] Support to remove workers unavailable info with RESTful api 
### What changes were proposed in this pull request?
In [CELEBORN-1535](https://issues.apache.org/jira/browse/CELEBORN-1535), we support to disable master workerUnavilableInfo expiration.

 In this PR,  a new RestAPI  introduced for manually remove unavailable workers. Then it can be used on demand.

### Why are the changes needed?
To cleanup the works unavailable info on demand manually if we disable the expiration.

### Does this PR introduce _any_ user-facing change?
Yes, a new RESTful API.

### How was this patch tested?
UT.

Closes #2658 from turboFei/support_cleanup.

Authored-by: Wang, Fei <fwang12@ebay.com>
Signed-off-by: Shuang <lvshuang.xjs@alibaba-inc.com>
2024-08-19 11:10:33 +08:00
..
src/main [CELEBORN-1537] Support to remove workers unavailable info with RESTful api 2024-08-19 11:10:33 +08:00
pom.xml [CELEBORN-1477] Using openapi-generator apache-httpclient library instead of jersey2 2024-07-31 15:02:41 +08:00
README.md [CELEBORN-1477] Using openapi-generator apache-httpclient library instead of jersey2 2024-07-31 15:02:41 +08:00

README.md

Celeborn OpenAPI Client

To update the OpenAPI specification

  • just update the specification under openapi/openapi-client/src/main/openapi3/ and keep the schema definitions consistent between master and worker.
  • Install JDK 11 or above by whatever mechanism is appropriate for your system, and set that version to be the default Java version (e.g., by setting env variable JAVA_HOME)
  • run the following: 
    build/mvn -pl openapi/openapi-client clean package -Pgenerate
    or 
    build/sbt "clean;celeborn-openapi-client/generate"
    This will regenerate the OpenAPI data models + APIs in the celeborn-openapi-client SDK.