apache/celeborn
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

[MINOR] Add spec link to JavaSerializer

Browse Source 
### What changes were proposed in this pull request?

Document [Java Object Serialization Specification](https://docs.oracle.com/javase/8/docs/platform/serialization/spec/protocol.html) on `JavaSerializer`

### Why are the changes needed?

To help developers who extend the `Serializer` to understand the existing `JavaSerializer` protocol.

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Review.

Closes #3194 from pan3793/minor-docs.

Authored-by: Cheng Pan <chengpan@apache.org>
Signed-off-by: Cheng Pan <chengpan@apache.org>
This commit is contained in:
Cheng Pan 2025-04-02 14:26:32 +08:00
parent 0d923c37bf
commit dfeaef1355
No known key found for this signature in database
GPG Key ID: 8001952629BCC75D
1 changed files with 3 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
common/src/main/scala/org/apache/celeborn/common/serializer/JavaSerializer.scala
View File

@ -136,6 +136,9 @@ private[celeborn] class JavaSerializerInstance(
* @note This serializer is not guaranteed to be wire-compatible across different versions of
* Spark. It is intended to be used to serialize/de-serialize data within a single
* Spark application.
*
* @note Java Object Serialization Specification:
* https://docs.oracle.com/javase/8/docs/platform/serialization/spec/protocol.html
*/
class JavaSerializer(conf: CelebornConf) extends Serializer with Externalizable {
private var counterReset = conf.getInt("spark.serializer.objectStreamReset", 100)