apache/celeborn
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

[MINOR] Fix configuration version

Browse Source 
### What changes were proposed in this pull request?

Change the `.version("0.3.2")` to `.version("0.3.1")`

### Why are the changes needed?

0.3.1 is not release yet.

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Pass GA.

Closes #1948 from pan3793/minor-version.

Lead-authored-by: Cheng Pan <chengpan@apache.org>
Co-authored-by: Cheng Pan <pan3793@gmail.com>
Signed-off-by: Cheng Pan <chengpan@apache.org>
This commit is contained in:
Cheng Pan 2023-09-28 19:58:06 +08:00
parent 78553f1418
commit ab68a4ae1b
No known key found for this signature in database
GPG Key ID: 8001952629BCC75D
3 changed files with 5 additions and 7 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala
View File

@ -1587,7 +1587,7 @@ object CelebornConf extends Logging {
val WORKER_UNAVAILABLE_INFO_EXPIRE_TIMEOUT: ConfigEntry[Long] =
buildConf("celeborn.master.workerUnavailableInfo.expireTimeout")
.categories("master")
.version("0.3.2")
.version("0.3.1")
.doc("Worker unavailable info would be cleared when the retention period is expired")
.timeConf(TimeUnit.MILLISECONDS)
.createWithDefaultString("1800s")
@ -2223,7 +2223,7 @@ object CelebornConf extends Logging {
"the range fetch phase, as both the original and sorted files will be retained until the " +
"shuffle is finished. Note that the default value is configured as 'false' as a " +
"temporary workaround for CELEBORN-980. see CELEBORN-980 for more details.")
.version("0.3.2")
.version("0.3.1")
.internal
.booleanConf
.createWithDefault(false)

2
docs/configuration/master.md
View File

@ -35,7 +35,7 @@ license: |
| celeborn.master.slot.assign.maxWorkers | 10000 | Max workers that slots of one shuffle can be allocated on. Will choose the smaller positive one from Master side and Client side, see `celeborn.client.slot.assign.maxWorkers`. | 0.3.1 |
| celeborn.master.slot.assign.policy | ROUNDROBIN | Policy for master to assign slots, Celeborn supports two types of policy: roundrobin and loadaware. Loadaware policy will be ignored when `HDFS` is enabled in `celeborn.storage.activeTypes` | 0.3.0 |
| celeborn.master.userResourceConsumption.update.interval | 30s | Time length for a window about compute user resource consumption. | 0.3.0 |
| celeborn.master.workerUnavailableInfo.expireTimeout | 1800s | Worker unavailable info would be cleared when the retention period is expired | 0.3.2 |
| celeborn.master.workerUnavailableInfo.expireTimeout | 1800s | Worker unavailable info would be cleared when the retention period is expired | 0.3.1 |
| celeborn.storage.activeTypes | HDD,SSD | Enabled storage levels. Available options: HDD,SSD,HDFS. | 0.3.0 |
| celeborn.storage.hdfs.dir | &lt;undefined&gt; | HDFS base directory for Celeborn to store shuffle data. | 0.2.0 |
<!--end-include-->

6
docs/migration.md
View File

@ -30,14 +30,12 @@ license: |
- Since 0.4.0, Celeborn changed the default value of `celeborn.<module>.io.numConnectionsPerPeer` from `2` to `1`.
## Upgrading from 0.3.1 to 0.3.2
- Since 0.3.2, Celeborn changed the default value of `celeborn.worker.monitor.disk.check.interval` from `60` to `30`.
## Upgrading from 0.3.0 to 0.3.1
- Since 0.3.1, Celeborn changed the default value of `celeborn.worker.directMemoryRatioToResume` from `0.5` to `0.7`.
- Since 0.3.1, Celeborn changed the default value of `celeborn.worker.monitor.disk.check.interval` from `60` to `30`.
## Upgrading from 0.2 to 0.3.0
- Celeborn 0.2 Client is compatible with 0.3 Master/Server, it allows to upgrade Master/Worker first then Client.