celeborn/docs/developers
Weijie Guo a759efb6dd [CELEBORN-1543] Support Flink 1.20
1.20 was the last non-bug-fix release before Flink 2.0, you can found all main upgrade features in this [release note](https://nightlies.apache.org/flink/flink-docs-release-1.20/release-notes/flink-1.20/). I think the most important feature related to Celeborn is we expose some interface to support Flink hybrid shuffle integration with Celeborn([FLIP-459](https://cwiki.apache.org/confluence/display/FLINK/FLIP-459%3A+Support+Flink+hybrid+shuffle+integration+with+Apache+Celeborn)). This(supporting hybrid shuffle in Celeborn side) is also a follow-up stuff to this PR.

incompatible changes in 1.20:
- 1.20 use enum `CompressionCodec` instead of `String` to construct `BufferDecompressor` and `BufferCompressor`.
- 1.20 introduce a new method(`notifyPartitionRecoveryStarted`) to `JobShuffleContext` in a non-compatible way.

I've already done the adaptation in this PR.

Closes #2662 from reswqa/support-120.

Authored-by: Weijie Guo <reswqa@163.com>
Signed-off-by: Shuang <lvshuang.xjs@alibaba-inc.com>
2024-08-09 17:05:58 +08:00
..
client.md [CELEBORN-853][DOC] Document on LifecycleManager 2023-07-31 17:36:42 +08:00
configuration.md [CELEBORN-1286] Introduce configuration.md to document dynamic config and config service 2024-02-28 11:49:28 +08:00
faulttolerant.md [CELEBORN-860][DOC] Document on ShuffleClient 2023-07-31 20:07:20 +08:00
glutensupport.md [CELEBORN-1486] Introduce ClickHouse Backend in Gluten Support document 2024-07-01 16:38:49 +08:00
helm-charts.md [CELEBORN-1425][HELM] Add helm chart unit tests to ensure manifests are rendered as expected 2024-05-15 19:17:30 +08:00
integrate.md [CELEBORN-1341][FOLLOWUP] Improve Celeborn document 2024-03-22 16:34:25 +08:00
jvmprofiler.md [CELEBORN-1299] Introduce JVM profiling in Celeborn Worker using async-profiler 2024-03-25 14:05:50 +08:00
lifecyclemanager.md [MINOR] Fix some typos 2023-10-12 20:34:07 +08:00
master.md [CELEBORN-853][DOC] Document on LifecycleManager 2023-07-31 17:36:42 +08:00
overview.md [INFRA] Remove incubator/incubating for graduation 2024-03-27 13:54:47 +08:00
sbt.md [CELEBORN-1543] Support Flink 1.20 2024-08-09 17:05:58 +08:00
shuffleclient.md [CELEBORN-1341][FOLLOWUP] Improve Celeborn document 2024-03-22 16:34:25 +08:00
slotsallocation.md [MINOR] Fix style and Gluten link in Developers Doc 2024-03-11 12:07:01 +08:00
storage.md [CELEBORN-1341] Improve Celeborn document 2024-03-20 15:02:05 +08:00
trafficcontrol.md [MINOR] Fix incorrect default resume ratio in trafficcontrol doc 2023-09-21 11:18:48 +08:00
worker.md [CELEBORN-877][DOC] Document on SBT 2023-08-11 12:17:55 +08:00
workerexclusion.md [CELEBORN-869][DOC] Document on Integrating Celeborn 2023-08-02 17:22:41 +08:00