apache/kyuubi
1
0
Fork 0
Code Issues Pull Requests Actions 5 Packages Projects Releases Wiki Activity
678 Commits 23 Branches 0 Tags 65 MiB
Scala 69.7%
Java 23.5%
Python 2.8%
Shell 1.4%
Vue 1%
Other 1.5%
d44afdb346
Go to file
ulysses-you d44afdb346
[KYUUBI #303] Add host:port msg if we failed to initialize 
![ulysses-you](https://badgen.net/badge/Hello/ulysses-you/green) [![PR 303](https://badgen.net/badge/Preview/PR%20303/blue)](https://github.com/yaooqinn/kyuubi/pull/303) [&#10088;?&#10089;](https://pullrequestbadge.com/?utm_medium=github&utm_source=yaooqinn&utm_campaign=badge_info)<!-- PR-BADGE: PLEASE DO NOT REMOVE THIS COMMENT -->

<!--
Thanks for sending a pull request!  Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
-->

<!-- replace ${issue ID} with the actual issue id -->
Fixes #303

<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the user case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->

Before this PR, if we start Kyuubi with an already used port, we will get this error msg.
It's better to print host:port which we bind.
```
Exception in thread "main" org.apache.kyuubi.KyuubiException: Failed to initialize frontend service
	at org.apache.kyuubi.service.FrontendService.initialize(FrontendService.scala:102)
	at org.apache.kyuubi.service.CompositeService.$anonfun$initialize$1(CompositeService.scala:40)
	at org.apache.kyuubi.service.CompositeService.$anonfun$initialize$1$adapted(CompositeService.scala:40)
	at scala.collection.mutable.ResizableArray.foreach(ResizableArray.scala:62)
	at scala.collection.mutable.ResizableArray.foreach$(ResizableArray.scala:55)
	at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:49)
	at org.apache.kyuubi.service.CompositeService.initialize(CompositeService.scala:40)
	at org.apache.kyuubi.service.Serverable.initialize(Serverable.scala:37)
	at org.apache.kyuubi.server.KyuubiServer.initialize(KyuubiServer.scala:88)
	at org.apache.kyuubi.server.KyuubiServer$.startServer(KyuubiServer.scala:45)
	at org.apache.kyuubi.server.KyuubiServer$.main(KyuubiServer.scala:74)
	at org.apache.kyuubi.server.KyuubiServer.main(KyuubiServer.scala)
Caused by: java.net.BindException: Address already in use
	at java.net.PlainSocketImpl.socketBind(Native Method)
	at java.net.AbstractPlainSocketImpl.bind(AbstractPlainSocketImpl.java:387)
	at java.net.ServerSocket.bind(ServerSocket.java:375)
	at java.net.ServerSocket.<init>(ServerSocket.java:237)
	at org.apache.kyuubi.service.FrontendService.initialize(FrontendService.scala:77)
	... 11 more
```

- Add some test cases that check the changes thoroughly including negative and positive cases if possible
- Add screenshots for manual tests if appropriate
- [Run test](https://kyuubi.readthedocs.io/en/latest/tools/testing.html#running-tests) locally before make a pull request
Squashed commit of the following:

commit c3f5ffa3dae5d9822ae9b0d8eec879e971ccdea2
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Tue Jan 26 18:23:40 2021 +0800

    fix

commit 42d333de2c1edc0373c737053ff6c28b48a41cf7
Author: ulysses-you <ulyssesyou18@gmail.com>
Date:   Tue Jan 26 14:44:35 2021 +0800

    err msg
2021-01-26 18:39:19 +08:00
.github [KYUUBI #291] Add a quick start guide for DBeaver (#291) 2021-01-16 16:04:15 +08:00
bin add HADOOP_CONF_DIR to classpath 2020-11-19 00:30:25 +08:00
build [KYUUBI #297] Remove unused property from build properties file 2021-01-18 14:26:11 +08:00
conf Spark Conf temp 2020-12-31 15:02:21 +08:00
dev Tune pom 2021-01-09 23:30:46 +08:00
docs [KYUUBI #291] Add a quick start guide for DBeaver (#291) 2021-01-16 16:04:15 +08:00
externals [KYUUBI #296] Add spark 2.4 profile and shade hive-sevice-rpc to engine jar to fix thrift build err (#296) 2021-01-18 14:23:31 +08:00
kyuubi-assembly Tune pom 2021-01-09 23:30:46 +08:00
kyuubi-common [KYUUBI #303] Add host:port msg if we failed to initialize 2021-01-26 18:39:19 +08:00
kyuubi-ha Tune pom 2021-01-09 23:30:46 +08:00
kyuubi-main [KYUUBI #302]fix zk client not release if open session failed 2021-01-20 14:43:17 +08:00
_config.yml [KYUUBI #295][INFRA] Add licenses for some yml files 2021-01-18 10:24:13 +08:00
.gitignore [KYUUBI #297] Remove unused property from build properties file 2021-01-18 14:26:11 +08:00
.readthedocs.yml [KYUUBI #295][INFRA] Add licenses for some yml files 2021-01-18 10:24:13 +08:00
.travis.yml [KYUUBI #295][INFRA] Add licenses for some yml files 2021-01-18 10:24:13 +08:00
CODE_OF_CONDUCT.md Create CODE_OF_CONDUCT.md 2018-03-07 15:54:22 +08:00
codecov.yml [KYUUBI #295][INFRA] Add licenses for some yml files 2021-01-18 10:24:13 +08:00
LICENSE Initial commit 2017-12-18 17:05:10 +08:00
pom.xml [KYUUBI #296] Add spark 2.4 profile and shade hive-sevice-rpc to engine jar to fix thrift build err (#296) 2021-01-18 14:23:31 +08:00
README.md [MINOR] Show Github Actions build status in readme 2021-01-15 15:40:43 +08:00
scalastyle-config.xml Create Kyuubi Project Spark SQL Engine 2020-06-09 10:34:47 +08:00

README.md

Kyuubi

License GitHub top language GitHub release codecov HitCount Travis GitHub Workflow Status Documentation Status DepShield Badge

Kyuubi is a high-performance universal JDBC and SQL execution engine, built on top of Apache Spark. The goal of Kyuubi is to facilitate users to handle big data like ordinary data.

It provides a standardized JDBC interface with easy-to-use data access in big data scenarios. End-users can focus on developing their own business systems and mining data value without having to be aware of the underlying big data platform (compute engines, storage services, metadata management, etc.).

Kyuubi relies on Apache Spark to provide high-performance data query capabilities, and every improvement in the engine's capabilities can help Kyuubi's performance make a qualitative leap. In addition, Kyuubi improves ad-hoc responsiveness through the engine caching, and enhances concurrency through horizontal scaling and load balancing. It provides complete authentication and authentication services to ensure data and metadata security. It provides robust high availability and load balancing to help you guarantee the SLA commitment. It provides a two-level elastic resource management architecture to effectively improve resource utilization while covering the performance and response requirements of all scenarios including interactive, or batch processing and point queries, or full table scans. It embraces Spark and builds an ecosystem on top of it, which allows Kyuubi to quickly expand its existing ecosystem and introduce new features, such as cloud-native support and Data Lake/Lake House support.

Kyuubi's vision is to build on top of Apache Spark and Data Lake technologies to unify the portal and become an ideal data lake management platform. It can support data processing e.g. ETL, and analytics e.g. BI in a pure SQL way. All workloads can be done on one platform, using one copy of data, with one SQL interface.

Online Documentation

Since Kyuubi 1.0.0, the Kyuubi online documentation is hosted by https://readthedocs.org/. You can find the specific version of Kyuubi documentation as listed below.

For 0.8 and earlier versions, please check the project docs folder directly.

Quick Start

Ready? Getting Started with Kyuubi.

Contributing

All bits of help are welcome. You can make various types of contributions to Kyuubi, including the following but not limited to,

  • Help new users in chat channel or share your success stories w/ us - Gitter
  • Improve Documentation - Documentation Status
  • Test releases - GitHub release
  • Improve test coverage - codecov
  • Report bugs and better help developers to reproduce
  • Review changes
  • Make a pull request
  • Promote to others
  • Click the star button if you like this project

Aside

The project took its name from a character of a popular Japanese manga - Naruto. The character is named Kyuubi Kitsune/Kurama, which is a nine-tailed fox in mythology. Kyuubi spread the power and spirit of fire, which is used here to represent the powerful Apache Spark. It's nine tails stands for end-to end multi-tenancy support of this project.