apache/kyuubi
1
0
Fork 0
Code Issues Pull Requests Actions 5 Packages Projects Releases Wiki Activity

[KYUUBI #531] Refactor repo key words (#531)

Browse Source 
<!--
Thanks for sending a pull request!

Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
  2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
  3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->

### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the use case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->
Refactor the key words after repo renamed.


### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request
This commit is contained in:
feiwang 2021-04-15 17:13:02 +08:00 committed by GitHub
parent c458d853c4
commit 4e81e6b230
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
15 changed files with 53 additions and 66 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
.github/PULL_REQUEST_TEMPLATE vendored
View File

@ -3,7 +3,7 @@ Thanks for sending a pull request!
Here are some tips for you: Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html 1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
2. If the PR is related to an issue in https://github.com/yaooqinn/kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'. 2. If the PR is related to an issue in https://github.com/NetEase/kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'. 3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
--> -->

2
.github/pr-badge.yml vendored
View File

@ -5,7 +5,7 @@
- label: "Preview" - label: "Preview"
message: "Closes #$prNumber" message: "Closes #$prNumber"
color: "blue" color: "blue"
url: "https://github.com/yaooqinn/kyuubi/pull/$prNumber" url: "https://github.com/NetEase/kyuubi/pull/$prNumber"
- label: "+" - label: "+"
message: "$additions" message: "$additions"

20
README.md
View File

@ -1,15 +1,13 @@
![](docs/imgs/kyuubi_logo.png) ![](docs/imgs/kyuubi_logo.png)
[![License](https://img.shields.io/badge/license-Apache%202-4EB1BA.svg)](https://www.apache.org/licenses/LICENSE-2.0.html) [![License](https://img.shields.io/badge/license-Apache%202-4EB1BA.svg)](https://www.apache.org/licenses/LICENSE-2.0.html)
[![](https://tokei.rs/b1/github/yaooqinn/kyuubi)](https://github.com/yaooqinn/kyuubi) [![](https://tokei.rs/b1/github/NetEase/kyuubi)](https://github.com/NetEase/kyuubi)
![GitHub top language](https://img.shields.io/github/languages/top/yaooqinn/kyuubi) ![GitHub top language](https://img.shields.io/github/languages/top/NetEase/kyuubi)
[![GitHub release](https://img.shields.io/github/release/yaooqinn/kyuubi.svg)](https://github.com/yaooqinn/kyuubi/releases) [![GitHub release](https://img.shields.io/github/release/NetEaes/kyuubi.svg)](https://github.com/NetEase/kyuubi/releases)
[![codecov](https://codecov.io/gh/yaooqinn/kyuubi/branch/master/graph/badge.svg)](https://codecov.io/gh/yaooqinn/kyuubi) [![codecov](https://codecov.io/gh/NetEase/kyuubi/branch/master/graph/badge.svg)](https://codecov.io/gh/NetEase/kyuubi)
[![HitCount](http://hits.dwyl.io/yaooqinn/kyuubi.svg)](http://hits.dwyl.io/yaooqinn/kyuubi) [![Travis](https://travis-ci.org/NetEase/kyuubi.svg?branch=master)](https://travis-ci.org/NetEase/kyuubi)
[![Travis](https://travis-ci.org/yaooqinn/kyuubi.svg?branch=master)](https://travis-ci.org/yaooqinn/kyuubi) ![GitHub Workflow Status](https://img.shields.io/github/workflow/status/NetEase/kyuubi/Kyuubi/master?style=plastic)
![GitHub Workflow Status](https://img.shields.io/github/workflow/status/yaooqinn/kyuubi/Kyuubi/master?style=plastic)
[![Documentation Status](https://readthedocs.org/projects/kyuubi/badge/?version=latest)](https://kyuubi.readthedocs.io/en/latest/?badge=latest) [![Documentation Status](https://readthedocs.org/projects/kyuubi/badge/?version=latest)](https://kyuubi.readthedocs.io/en/latest/?badge=latest)
[![DepShield Badge](https://depshield.sonatype.org/badges/yaooqinn/kyuubi/depshield.svg)](https://depshield.github.io)
Kyuubi is a high-performance universal JDBC and SQL execution engine, built on top of [Apache Spark](http://spark.apache.org). Kyuubi is a high-performance universal JDBC and SQL execution engine, built on top of [Apache Spark](http://spark.apache.org).
The goal of Kyuubi is to facilitate users to handle big data like ordinary data. The goal of Kyuubi is to facilitate users to handle big data like ordinary data.
@ -45,7 +43,7 @@ You can find the specific version of Kyuubi documentation as listed below.
- [v1.0.1](https://kyuubi.readthedocs.io/en/v1.0.1/) - [v1.0.1](https://kyuubi.readthedocs.io/en/v1.0.1/)
- [v1.0.0](https://kyuubi.readthedocs.io/en/v1.0.0/) - [v1.0.0](https://kyuubi.readthedocs.io/en/v1.0.0/)
For 0.8 and earlier versions, please check the [Github Pages](https://yaooqinn.github.io/kyuubi/) directly. For 0.8 and earlier versions, please check the [Github Pages](https://NetEase.github.io/kyuubi/) directly.
## Quick Start ## Quick Start
@ -57,8 +55,8 @@ All bits of help are welcome. You can make various types of contributions to Kyu
- Help new users in chat channel or share your success stories with us - [![Gitter](https://badges.gitter.im/kyuubi-on-spark/Lobby.svg)](https://gitter.im/kyuubi-on-spark/Lobby?utm_source=badge&utm_medium=badge&utm_campaign=pr-badge) - Help new users in chat channel or share your success stories with us - [![Gitter](https://badges.gitter.im/kyuubi-on-spark/Lobby.svg)](https://gitter.im/kyuubi-on-spark/Lobby?utm_source=badge&utm_medium=badge&utm_campaign=pr-badge)
- Improve Documentation - [![Documentation Status](https://readthedocs.org/projects/kyuubi/badge/?version=latest)](https://kyuubi.readthedocs.io/en/latest/?badge=latest) - Improve Documentation - [![Documentation Status](https://readthedocs.org/projects/kyuubi/badge/?version=latest)](https://kyuubi.readthedocs.io/en/latest/?badge=latest)
- Test releases - [![GitHub release](https://img.shields.io/github/release/yaooqinn/kyuubi.svg)](https://github.com/yaooqinn/kyuubi/releases) - Test releases - [![GitHub release](https://img.shields.io/github/release/NetEase/kyuubi.svg)](https://github.com/NetEase/kyuubi/releases)
- Improve test coverage - [![codecov](https://codecov.io/gh/yaooqinn/kyuubi/branch/master/graph/badge.svg)](https://codecov.io/gh/yaooqinn/kyuubi) - Improve test coverage - [![codecov](https://codecov.io/gh/NetEase/kyuubi/branch/master/graph/badge.svg)](https://codecov.io/gh/NetEase/kyuubi)
- Report bugs and better help developers to reproduce - Report bugs and better help developers to reproduce
- Review changes - Review changes
- Make a pull request - Make a pull request

2
dev/merge_kyuubi_pr.py
View File

@ -32,7 +32,7 @@ KYUUBI_HOME = os.environ.get("KYUUBI_HOME", os.getcwd())
PR_REMOTE_NAME = os.environ.get("PR_REMOTE_NAME", "origin") PR_REMOTE_NAME = os.environ.get("PR_REMOTE_NAME", "origin")
PUSH_REMOTE_NAME = os.environ.get("PUSH_REMOTE_NAME", "origin") PUSH_REMOTE_NAME = os.environ.get("PUSH_REMOTE_NAME", "origin")
GITHUB_OAUTH_KEY = os.environ.get("GITHUB_OAUTH_KEY") GITHUB_OAUTH_KEY = os.environ.get("GITHUB_OAUTH_KEY")
GITHUB_API_BASE = "https://api.github.com/repos/yaooqinn/kyuubi" GITHUB_API_BASE = "https://api.github.com/repos/NetEase/kyuubi"
BRANCH_PREFIX = "PR_TOOL" BRANCH_PREFIX = "PR_TOOL"

14
docs/community/badges.md
View File

@ -1,10 +1,10 @@
<script async defer src="https://buttons.github.io/buttons.js"></script> <script async defer src="https://buttons.github.io/buttons.js"></script>
# Community [![Gitter](https://badges.gitter.im/kyuubi-on-spark/Lobby.svg)](https://gitter.im/kyuubi-on-spark/Lobby?utm_source=badge&utm_medium=badge&utm_campaign=pr-badge) # Community [![Gitter](https://badges.gitter.im/kyuubi-on-spark/Lobby.svg)](https://gitter.im/kyuubi-on-spark/Lobby?utm_source=badge&utm_medium=badge&utm_campaign=pr-badge)
<a class="github-button" href="https://github.com/yaooqinn/kyuubi/subscription" data-color-scheme="no-preference: light; light: dark; dark: light;" data-icon="octicon-eye" data-show-count="true" aria-label="Watch yaooqinn/kyuubi on GitHub">Watch</a> <a class="github-button" href="https://github.com/NetEase/kyuubi/subscription" data-color-scheme="no-preference: light; light: dark; dark: light;" data-icon="octicon-eye" data-show-count="true" aria-label="Watch NetEase/kyuubi on GitHub">Watch</a>
<a class="github-button" href="https://github.com/yaooqinn/kyuubi" data-color-scheme="no-preference: light; light: dark; dark: light;" data-icon="octicon-star" data-show-count="true" aria-label="Star yaooqinn/kyuubi on GitHub">Star</a> <a class="github-button" href="https://github.com/NetEase/kyuubi" data-color-scheme="no-preference: light; light: dark; dark: light;" data-icon="octicon-star" data-show-count="true" aria-label="Star NetEase/kyuubi on GitHub">Star</a>
<a class="github-button" href="https://github.com/yaooqinn/kyuubi/fork" data-color-scheme="no-preference: light; light: dark; dark: light;" data-icon="octicon-repo-forked" data-show-count="true" aria-label="Fork yaooqinn/kyuubi on GitHub">Fork</a> <a class="github-button" href="https://github.com/NetEase/kyuubi/fork" data-color-scheme="no-preference: light; light: dark; dark: light;" data-icon="octicon-repo-forked" data-show-count="true" aria-label="Fork NetEase/kyuubi on GitHub">Fork</a>
<a class="github-button" href="https://github.com/yaooqinn/kyuubi/issues" data-color-scheme="no-preference: light; light: dark; dark: light;" data-icon="octicon-issue-opened" data-show-count="true" aria-label="Issue yaooqinn/kyuubi on GitHub">Issue</a> <a class="github-button" href="https://github.com/NetEase/kyuubi/issues" data-color-scheme="no-preference: light; light: dark; dark: light;" data-icon="octicon-issue-opened" data-show-count="true" aria-label="Issue NetEase/kyuubi on GitHub">Issue</a>
<a class="github-button" href="https://github.com/yaooqinn/kyuubi/releases" data-color-scheme="no-preference: light; light: dark; dark: light;" data-icon="octicon-download" aria-label="Download yaooqinn/kyuubi on GitHub">Download</a> <a class="github-button" href="https://github.com/NetEase/kyuubi/releases" data-color-scheme="no-preference: light; light: dark; dark: light;" data-icon="octicon-download" aria-label="Download NetEase/kyuubi on GitHub">Download</a>
<a class="github-button" href="https://github.com/yaooqinn" data-color-scheme="no-preference: light; light: dark; dark: light;" data-show-count="true" aria-label="Follow @yaooqinn on GitHub">Follow @yaooqinn</a> <a class="github-button" href="https://github.com/NetEase" data-color-scheme="no-preference: light; light: dark; dark: light;" data-show-count="true" aria-label="Follow @Netease on GitHub">Follow @NetEase</a>
<a class="github-button" href="https://github.com/sponsors/yaooqinn" data-color-scheme="no-preference: light; light: dark; dark: light;" data-icon="octicon-heart" aria-label="Sponsor @yaooqinn on GitHub">Sponsor</a> <a class="github-button" href="https://github.com/sponsors/NetEase" data-color-scheme="no-preference: light; light: dark; dark: light;" data-icon="octicon-heart" aria-label="Sponsor @NetEase on GitHub">Sponsor</a>

2
docs/community/collaborators.md
View File

@ -7,4 +7,4 @@ ulysses-you | @ulysses-you | NetEase Inc
Cheng Pan | @pan3793 | 问卷网 Cheng Pan | @pan3793 | 问卷网
Fei Wang | @turbofei | eBay Inc Fei Wang | @turbofei | eBay Inc
See full contributor list at [contributors](https://github.com/yaooqinn/kyuubi/graphs/contributors). See full contributor list at [contributors](https://github.com/NetEase/kyuubi/graphs/contributors).

8
docs/community/contributions.md
View File

@ -2,12 +2,12 @@
# Contribution Guidelines # Contribution Guidelines
**Kyuubi** is an [Apache License v2.0](https://github.com/yaooqinn/kyuubi/blob/master/LICENSE) open source software. **Kyuubi** is an [Apache License v2.0](https://github.com/NetEase/kyuubi/blob/master/LICENSE) open source software.
Contributing to Kyuubi including source code, documents, tests e.t.c. means that you agree to the Apache License v2.0. Contributing to Kyuubi including source code, documents, tests e.t.c. means that you agree to the Apache License v2.0.
- Better to search the issue history first before reporting an <a class="github-button" href="https://github.com/yaooqinn/kyuubi/issues" data-color-scheme="no-preference: light; light: dark; dark: light;" data-icon="octicon-issue-opened" data-show-count="true" aria-label="Issue yaooqinn/kyuubi on GitHub">Issue</a> - Better to search the issue history first before reporting an <a class="github-button" href="https://github.com/NetEase/kyuubi/issues" data-color-scheme="no-preference: light; light: dark; dark: light;" data-icon="octicon-issue-opened" data-show-count="true" aria-label="Issue NetEase/kyuubi on GitHub">Issue</a>
- Better to create an <a class="github-button" href="https://github.com/yaooqinn/kyuubi/issues" data-color-scheme="no-preference: light; light: dark; dark: light;" data-icon="octicon-issue-opened" data-show-count="true" aria-label="Issue yaooqinn/kyuubi on GitHub">Issue</a> to describe the feature or bug first before make a pull request. - Better to create an <a class="github-button" href="https://github.com/NetEase/kyuubi/issues" data-color-scheme="no-preference: light; light: dark; dark: light;" data-icon="octicon-issue-opened" data-show-count="true" aria-label="Issue NetEase/kyuubi on GitHub">Issue</a> to describe the feature or bug first before make a pull request.
- Better to use English for world widely understanding. - Better to use English for world widely understanding.
- Ask us anything - Ask us anything
@ -31,7 +31,7 @@ Here are some tips for you:
### _Which issue are you going to fix?_ ### _Which issue are you going to fix?_
<!-- <!--
Replace ${ID} below with the actual issue id from Replace ${ID} below with the actual issue id from
https://github.com/yaooqinn/kyuubi/issues, https://github.com/NetEase/kyuubi/issues,
so that the issue will be linked and automatically closed after merging so that the issue will be linked and automatically closed after merging
--> -->

2
docs/conf.py
View File

@ -102,7 +102,7 @@ pygments_style = 'sphinx'
html_static_path = ['_static'] html_static_path = ['_static']
htmlhelp_basename = 'Recommonmarkdoc' htmlhelp_basename = 'Recommonmarkdoc'
github_doc_root = 'https://github.com/yaooqinn/kyuubi/tree/master/docs/' github_doc_root = 'https://github.com/NetEase/kyuubi/tree/master/docs/'
def setup(app): def setup(app):
app.add_config_value('recommonmark_config', { app.add_config_value('recommonmark_config', {
'url_resolver': lambda url: github_doc_root + url, 'url_resolver': lambda url: github_doc_root + url,

9
docs/deployment/high_availability_guide.md
View File

@ -51,12 +51,3 @@ kyuubi\.ha\.zookeeper<br>\.connection\.timeout|<div style='width: 80pt;word-wrap
kyuubi\.ha\.zookeeper<br>\.namespace|<div style='width: 80pt;word-wrap: break-word;white-space: normal'>kyuubi</div>|<div style='width: 200pt;word-wrap: break-word;white-space: normal'>The root directory for the service to deploy its instance uri. Additionally, it will creates a -[username] suffixed root directory for each application</div>|<div style='width: 20pt'>1.0.0</div> kyuubi\.ha\.zookeeper<br>\.namespace|<div style='width: 80pt;word-wrap: break-word;white-space: normal'>kyuubi</div>|<div style='width: 200pt;word-wrap: break-word;white-space: normal'>The root directory for the service to deploy its instance uri. Additionally, it will creates a -[username] suffixed root directory for each application</div>|<div style='width: 20pt'>1.0.0</div>
kyuubi\.ha\.zookeeper<br>\.quorum|<div style='width: 80pt;word-wrap: break-word;white-space: normal'></div>|<div style='width: 200pt;word-wrap: break-word;white-space: normal'>The connection string for the zookeeper ensemble</div>|<div style='width: 20pt'>1.0.0</div> kyuubi\.ha\.zookeeper<br>\.quorum|<div style='width: 80pt;word-wrap: break-word;white-space: normal'></div>|<div style='width: 200pt;word-wrap: break-word;white-space: normal'>The connection string for the zookeeper ensemble</div>|<div style='width: 20pt'>1.0.0</div>
kyuubi\.ha\.zookeeper<br>\.session\.timeout|<div style='width: 80pt;word-wrap: break-word;white-space: normal'>60000</div>|<div style='width: 200pt;word-wrap: break-word;white-space: normal'>The timeout(ms) of a connected session to be idled</div>|<div style='width: 20pt'>1.0.0</div> kyuubi\.ha\.zookeeper<br>\.session\.timeout|<div style='width: 80pt;word-wrap: break-word;white-space: normal'>60000</div>|<div style='width: 200pt;word-wrap: break-word;white-space: normal'>The timeout(ms) of a connected session to be idled</div>|<div style='width: 20pt'>1.0.0</div>
## Additional Documentations
[Building Kyuubi](https://yaooqinn.github.io/kyuubi/docs/building.html)
[Kyuubi Deployment Guide](https://yaooqinn.github.io/kyuubi/docs/deploy.html)
[Kyuubi Containerization Guide](https://yaooqinn.github.io/kyuubi/docs/containerization.html)
[Configuration Guide](https://yaooqinn.github.io/kyuubi/docs/configurations.html)
[Authentication/Security Guide](https://yaooqinn.github.io/kyuubi/docs/authentication.html)
[Kyuubi ACL Management Guide](https://yaooqinn.github.io/kyuubi/docs/authorization.html)
[Kyuubi Architecture](https://yaooqinn.github.io/kyuubi/docs/architecture.html)

10
docs/integrations/kudu.md
View File

@ -125,13 +125,13 @@ java.lang.UnsupportedOperationException: overwrite is not yet supported
at org.apache.spark.sql.Dataset.<init>(Dataset.scala:190) at org.apache.spark.sql.Dataset.<init>(Dataset.scala:190)
at org.apache.spark.sql.Dataset$.ofRows(Dataset.scala:75) at org.apache.spark.sql.Dataset$.ofRows(Dataset.scala:75)
at org.apache.spark.sql.SparkSQLUtils$.toDataFrame(SparkSQLUtils.scala:39) at org.apache.spark.sql.SparkSQLUtils$.toDataFrame(SparkSQLUtils.scala:39)
at yaooqinn.kyuubi.operation.statement.ExecuteStatementInClientMode.execute(ExecuteStatementInClientMode.scala:152) at org.apache.kyuubi.operation.statement.ExecuteStatementInClientMode.execute(ExecuteStatementInClientMode.scala:152)
at yaooqinn.kyuubi.operation.statement.ExecuteStatementOperation$$anon$1$$anon$2.run(ExecuteStatementOperation.scala:74) at org.apache.kyuubi.operation.statement.ExecuteStatementOperation$$anon$1$$anon$2.run(ExecuteStatementOperation.scala:74)
at yaooqinn.kyuubi.operation.statement.ExecuteStatementOperation$$anon$1$$anon$2.run(ExecuteStatementOperation.scala:70) at org.apache.kyuubi.operation.statement.ExecuteStatementOperation$$anon$1$$anon$2.run(ExecuteStatementOperation.scala:70)
at java.security.AccessController.doPrivileged(Native Method) at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422) at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698)
at yaooqinn.kyuubi.operation.statement.ExecuteStatementOperation$$anon$1.run(ExecuteStatementOperation.scala:70) at org.apache.kyuubi.operation.statement.ExecuteStatementOperation$$anon$1.run(ExecuteStatementOperation.scala:70)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
@ -164,5 +164,5 @@ No rows selected (0.611 seconds)
## References ## References
[https://kudu.apache.org/](https://kudu.apache.org/) [https://kudu.apache.org/](https://kudu.apache.org/)
[https://kudu.apache.org/docs/developing.html#_kudu_integration_with_spark](https://kudu.apache.org/docs/developing.html#_kudu_integration_with_spark) [https://kudu.apache.org/docs/developing.html#_kudu_integration_with_spark](https://kudu.apache.org/docs/developing.html#_kudu_integration_with_spark)
[https://github.com/yaooqinn/kyuubi](https://github.com/yaooqinn/kyuubi) [https://github.com/NetEase/kyuubi](https://github.com/NetEase/kyuubi)
[https://spark.apache.org/docs/latest/sql-data-sources.html](https://spark.apache.org/docs/latest/sql-data-sources.html) [https://spark.apache.org/docs/latest/sql-data-sources.html](https://spark.apache.org/docs/latest/sql-data-sources.html)

2
docs/quick_start/quick_start.md
View File

@ -12,7 +12,7 @@
Currently, Kyuubi maintains all releases on GitHub directly. You can get the most recent stable release of Kyuubi here: Currently, Kyuubi maintains all releases on GitHub directly. You can get the most recent stable release of Kyuubi here:
<a class="github-button" href="https://github.com/yaooqinn/kyuubi/releases" data-color-scheme="no-preference: light; light: dark; dark: light;" data-icon="octicon-download" data-size="large" aria-label="Download yaooqinn/kyuubi on GitHub">Download</a> <a class="github-button" href="https://github.com/NetEase/kyuubi/releases" data-color-scheme="no-preference: light; light: dark; dark: light;" data-icon="octicon-download" data-size="large" aria-label="Download NetEase/kyuubi on GitHub">Download</a>
## Requirements ## Requirements

32
docs/security/authorization.md
View File

@ -8,7 +8,7 @@
<h2 id="1">Authorization Modes</h2> <h2 id="1">Authorization Modes</h2>
Three primary modes for Kyuubi authorization are available by [spark-authorizer](https://github.com/yaooqinn/spark-authorizer): Three primary modes for Kyuubi authorization are available by [Submarine Spark Security](https://github.com/apache/submarine/tree/master/submarine-security/spark-security):
<h4 id="1.1">Storage-Based Authorization</h4> <h4 id="1.1">Storage-Based Authorization</h4>
@ -16,30 +16,28 @@ Enabling Storage Based Authorization in the `Hive Metastore Server` uses the HDF
Storage-Based Authorization offers users with Database, Table and Partition-level coarse-gained access control. Storage-Based Authorization offers users with Database, Table and Partition-level coarse-gained access control.
Please refer to the [Storage-Based Authorization Guide](https://yaooqinn.github.io/spark-authorizer/docs/storage_based_authorization.html) in the online documentation for an overview on how to configure Storage-Based Authorization for Kyuubi.
<h4 id="1.2">SQL-Standard Based Authorization</h4> <h4 id="1.2">SQL-Standard Based Authorization</h4>
Enabling SQL-Standard Based Authorization gives users more fine-gained control over access comparing with Storage Based Authorization. Besides of the ability of Storage Based Authorization, SQL-Standard Based Authorization can improve it to Views and Column-level. Unfortunately, Spark SQL does not support grant/revoke statements which controls access, this might be done only through the HiveServer2. But it's gratifying that [spark-authorizer](https://github.com/yaooqinn/spark-authorizer) makes Spark SQL be able to understand this fine-grain access control granted or revoked by Hive. Enabling SQL-Standard Based Authorization gives users more fine-gained control over access comparing with Storage Based Authorization. Besides of the ability of Storage Based Authorization, SQL-Standard Based Authorization can improve it to Views and Column-level. Unfortunately, Spark SQL does not support grant/revoke statements which controls access, this might be done only through the HiveServer2. But it's gratifying that [Submarine Spark Security](https://github.com/apache/submarine/tree/master/submarine-security/spark-security) makes Spark SQL be able to understand this fine-grain access control granted or revoked by Hive.
With [Kyuubi](https://github.com/yaooqinn/kyuubi), the SQL-Standard Based Authorization is guaranteed for the security configurations, metadata, and storage information is preserved from end users. With [Kyuubi](https://github.com/NetEase/kyuubi), the SQL-Standard Based Authorization is guaranteed for the security configurations, metadata, and storage information is preserved from end users.
Please refer to the [SQL-Standard Based Authorization Guide](https://yaooqinn.github.io/spark-authorizer/docs/sql_std_based_authorization.html) in the online documentation for an overview on how to configure SQL-Standard Based Authorization for Spark SQL. Please refer to the [Submarine Spark Security](https://submarine.apache.org/docs/userDocs/submarine-security/spark-security/README) in the online documentation for an overview on how to configure SQL-Standard Based Authorization for Spark SQL.
<h4 id="1.3">Ranger Security Support (Recommended)</h4> <h4 id="1.3">Ranger Security Support (Recommended)</h4>
[Apache Ranger](https://ranger.apache.org/) is a framework to enable, monitor and manage comprehensive data security across the Hadoop platform but end before Spark or Spark SQL. The [spark-authorizer](https://github.com/yaooqinn/spark-authorizer) enables Kyuubi with control access ability reusing [Ranger Plugin for Hive MetaStore [Apache Ranger](https://ranger.apache.org/) is a framework to enable, monitor and manage comprehensive data security across the Hadoop platform but end before Spark or Spark SQL. The [Submarine Spark Security](https://github.com/apache/submarine/tree/master/submarine-security/spark-security) enables Kyuubi with control access ability reusing [Ranger Plugin for Hive MetaStore
](https://cwiki.apache.org/confluence/display/RANGER/Ranger+Plugin+for+Hive+MetaStore). [Apache Ranger](https://ranger.apache.org/) makes the scope of existing SQL-Standard Based Authorization expanded but without supporting Spark SQL. [spark-authorizer](https://github.com/yaooqinn/spark-authorizer) sticks them together. ](https://cwiki.apache.org/confluence/display/RANGER/Ranger+Plugin+for+Hive+MetaStore). [Apache Ranger](https://ranger.apache.org/) makes the scope of existing SQL-Standard Based Authorization expanded but without supporting Spark SQL. [Submarine Spark Security](https://github.com/apache/submarine/tree/master/submarine-security/spark-security) sticks them together.
Please refer to the [Spark SQL Ranger Security Support Guide](https://yaooqinn.github.io/spark-authorizer/docs/ranger_authorization.html) in the online documentation for an overview on how to configure Ranger for Spark SQL. Please refer to the [Submarine Spark Security](https://submarine.apache.org/docs/userDocs/submarine-security/spark-security/README) in the online documentation for an overview on how to configure Ranger for Spark SQL.
## Additional Documentations ## Additional Documentations
[Building Kyuubi](https://yaooqinn.github.io/kyuubi/docs/building.html) [Building Kyuubi](https://NetEase.github.io/kyuubi/docs/building.html)
[Kyuubi Deployment Guide](https://yaooqinn.github.io/kyuubi/docs/deploy.html) [Kyuubi Deployment Guide](https://NetEase.github.io/kyuubi/docs/deploy.html)
[Kyuubi Containerization Guide](https://yaooqinn.github.io/kyuubi/docs/containerization.html) [Kyuubi Containerization Guide](https://NetEase.github.io/kyuubi/docs/containerization.html)
[High Availability Guide](https://yaooqinn.github.io/kyuubi/docs/high_availability_guide.html) [High Availability Guide](https://NetEase.github.io/kyuubi/docs/high_availability_guide.html)
[Configuration Guide](https://yaooqinn.github.io/kyuubi/docs/configurations.html) [Configuration Guide](https://NetEase.github.io/kyuubi/docs/configurations.html)
[Authentication/Security Guide](https://yaooqinn.github.io/kyuubi/docs/authentication.html) [Authentication/Security Guide](https://NetEase.github.io/kyuubi/docs/authentication.html)
[Kyuubi Architecture](https://yaooqinn.github.io/kyuubi/docs/architecture.html) [Kyuubi Architecture](https://NetEase.github.io/kyuubi/docs/architecture.html)
[Home Page](https://yaooqinn.github.io/kyuubi/) [Home Page](https://NetEase.github.io/kyuubi/)

2
docs/tools/distribution.md
View File

@ -6,7 +6,7 @@
# Building a Runnable Distribution # Building a Runnable Distribution
To create a Kyuubi distribution like those distributed by [Kyuubi Release Page](https://github.com/yaooqinn/kyuubi/releases), To create a Kyuubi distribution like those distributed by [Kyuubi Release Page](https://github.com/NetEase/kyuubi/releases),
and that is laid out so as to be runnable, use `./build/dist` in the project root directory. and that is laid out so as to be runnable, use `./build/dist` in the project root directory.
For more information on usage, run `./build/dist --help` For more information on usage, run `./build/dist --help`

10
kyuubi-common/src/test/scala/org/apache/kyuubi/config/KyuubiConfSuite.scala
View File

@ -99,16 +99,16 @@ class KyuubiConfSuite extends KyuubiFunSuite {
test("get user specific defaults") { test("get user specific defaults") {
val conf = KyuubiConf(false) val conf = KyuubiConf(false)
.set("spark.user.test", "a") .set("spark.user.test", "a")
.set("___kent___.spark.user.test", "b") .set("___userb___.spark.user.test", "b")
.set("___yao___.spark.user.test", "c") .set("___userc___.spark.user.test", "c")
val all1 = conf.getUserDefaults("yaooqinn").getAll val all1 = conf.getUserDefaults("kyuubi").getAll
assert(all1.size === 1) assert(all1.size === 1)
assert(all1("spark.user.test") === "a") assert(all1("spark.user.test") === "a")
val all2 = conf.getUserDefaults("kent").getAll val all2 = conf.getUserDefaults("userb").getAll
assert(all2.size === 1) assert(all2.size === 1)
assert(all2("spark.user.test") === "b") assert(all2("spark.user.test") === "b")
assert(conf.getUserDefaults("yao").getOption("spark.user.test").get === "c") assert(conf.getUserDefaults("userc").getOption("spark.user.test").get === "c")
} }
test("time config test") { test("time config test") {

2
pom.xml
View File

@ -90,7 +90,7 @@
<maven.plugin.antrun.version>3.0.0</maven.plugin.antrun.version> <maven.plugin.antrun.version>3.0.0</maven.plugin.antrun.version>
<maven.plugin.compiler.version>3.8.1</maven.plugin.compiler.version> <maven.plugin.compiler.version>3.8.1</maven.plugin.compiler.version>
<!-- DO NOT bump 4.4.0, see https://github.com/yaooqinn/kyuubi/pull/441 --> <!-- DO NOT bump 4.4.0, see https://github.com/NetEase/kyuubi/pull/441 -->
<maven.plugin.scala.version>4.3.0</maven.plugin.scala.version> <maven.plugin.scala.version>4.3.0</maven.plugin.scala.version>
<maven.plugin.surefire.version>2.22.0</maven.plugin.surefire.version> <maven.plugin.surefire.version>2.22.0</maven.plugin.surefire.version>
<maven.plugin.scalatest.version>2.0.0</maven.plugin.scalatest.version> <maven.plugin.scalatest.version>2.0.0</maven.plugin.scalatest.version>