celeborn/project
SteNicholas 12c3779805 [CELEBORN-1330] Bump rocksdbjni version from 8.5.3 to 8.11.3
### What changes were proposed in this pull request?

Bump `rocksdbjni` version from 8.5.3 to 8.11.3.

### Why are the changes needed?

The new version bring some bug fixes:

- Fix a corner case with auto_readahead_size where Prev Operation returns NOT SUPPORTED error when scans direction is changed from forward to backward.
- Avoid destroying the periodic task scheduler's default timer in order to prevent static destruction order issues.
- Fix double counting of BYTES_WRITTEN ticker when doing writes with transactions.
- Fix a WRITE_STALL counter that was reporting wrong value in few cases.
- A lookup by MultiGet in a TieredCache that goes to the local flash cache and finishes with very low latency, i.e before the subsequent call to WaitAll, is ignored, resulting in a false negative and a memory leak.
- Fix bug in auto_readahead_size that combined with IndexType::kBinarySearchWithFirstKey + fails or iterator lands at a wrong key
- Fixed some cases in which DB file corruption was detected but ignored on creating a backup with BackupEngine.
- Fix bugs where rocksdb.blobdb.blob.file.synced includes blob files failed to get synced and rocksdb.blobdb.blob.file.bytes.written includes blob bytes failed to get written.
- Fixed a possible memory leak or crash on a failure (such as I/O error) in automatic atomic flush of multiple column families.
- Fixed some cases of in-memory data corruption using mmap reads with BackupEngine, sst_dump, or ldb.
- Fixed issues with experimental preclude_last_level_data_seconds option that could interfere with expected data tiering.
- Fixed the handling of the edge case when all existing blob files become unreferenced. Such files are now correctly deleted.

The full release notes as follows: [rocksdbjni releases](https://github.com/facebook/rocksdb/releases).

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

CI.

Closes #2389 from SteNicholas/CELEBORN-1330.

Authored-by: SteNicholas <programgeek@163.com>
Signed-off-by: SteNicholas <programgeek@163.com>
2024-03-14 18:01:03 +08:00
..
AddMetaInfLicenseFiles.scala [CELEBORN-1204] Update NOTICE year 2024 2024-01-02 15:55:52 +08:00
build.properties [CELEBORN-921] Upgrade sbt to 1.9.4 2023-08-25 17:59:04 +08:00
BuildTools.scala [CELEBORN-989] Add support for making distribution package via SBT 2023-09-20 10:03:01 +08:00
CelebornBuild.scala [CELEBORN-1330] Bump rocksdbjni version from 8.5.3 to 8.11.3 2024-03-14 18:01:03 +08:00
JDKTools.scala [CELEBORN-1092] Introduce JVM monitoring in Celeborn Worker using JVMQuake 2023-11-28 20:45:08 +08:00
plugins.sbt [CELEBORN-1194] Add sbt-pgp plugin for publishing signed artifacts 2023-12-21 19:27:09 +08:00