### _Why are the changes needed?_ Implements AtlasLineageDispatcher to send lineage to Apache Atlas. close #4814 Atlas Spark Model Definition: https://github.com/apache/atlas/blob/master/addons/models/1000-Hadoop/1100-spark_model.json spark process:  table lineage:  column lineage:  ### _How was this patch tested?_ - [X] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [X] Add screenshots for manual tests if appropriate - [ ] [Run test](https://kyuubi.readthedocs.io/en/master/develop_tools/testing.html#running-tests) locally before make a pull request Closes #4815 from wForget/KYUUBI-4814. Closes #4814 3df8a7ec9 [wforget] comments c58eae7c5 [wforget] comments 926bcf211 [wforget] comment e0b4067c3 [wforget] comment e4cc3e3f8 [wforget] comments adc72b96f [Bowen Liang] Update extensions/spark/kyuubi-spark-lineage/src/main/scala/org/apache/kyuubi/plugin/lineage/dispatcher/atlas/AtlasEntityHelper.scala e3bdd1c65 [Bowen Liang] Update extensions/spark/kyuubi-spark-lineage/src/main/scala/org/apache/kyuubi/plugin/lineage/dispatcher/atlas/AtlasEntityHelper.scala baf1711ac [Bowen Liang] Update extensions/spark/kyuubi-spark-lineage/src/test/scala/org/apache/kyuubi/plugin/lineage/dispatcher/atlas/AtlasLineageDispatcherSuite.scala 61e79f3d5 [Bowen Liang] Update extensions/spark/kyuubi-spark-lineage/src/test/scala/org/apache/kyuubi/plugin/lineage/dispatcher/atlas/AtlasLineageDispatcherSuite.scala 541df3780 [Bowen Liang] Update extensions/spark/kyuubi-spark-lineage/src/test/scala/org/apache/kyuubi/plugin/lineage/dispatcher/atlas/AtlasLineageDispatcherSuite.scala 5dd310657 [wforget] fix cea1e137d [wforget] fix f028d4b09 [wforget] fix 0c9b4516b [wforget] fix 6f8113032 [wforget] add close atlas client shutdown hook 3f4d2a7db [wforget] add remote user a0db58afc [wforget] comments 6dd3c66df [wforget] comments f2b2a30dc [wforget] style 83eb1e481 [wforget] add atlas.column.lineage.enable configuration 0719a2b65 [wforget] doc 05f936005 [wforget] fix d169b661d [wforget] fix 6da80d742 [wforget] fix 820ae5c5f [wforget] column lineages dabe8173e [wforget] license f22e044d2 [wforget] test b948bce90 [wforget] fix and add test 0aef1be6b [wforget] fix 368b5ab3f [wforget] [KYUUBI-4814] Implements AtlasLineageDispatcher to send lineage to Apache Atlas Lead-authored-by: wforget <643348094@qq.com> Co-authored-by: Bowen Liang <bowenliang@apache.org> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|---|---|---|
| .. | ||
| engines | ||
| server | ||
| index.rst | ||