From 0fe00d9c5bab418be15b4ea5e6205f278fcbfcb4 Mon Sep 17 00:00:00 2001 From: Cheng Pan Date: Wed, 8 Nov 2023 10:44:20 +0800 Subject: [PATCH] [KYUUBI #5640] Upgrade playground to Kyuubi 1.8.0 and Spark 3.4.1 ### _Why are the changes needed?_ Promote [1.8.0](https://kyuubi.apache.org/release/1.8.0.html), the docker images already uploaded to DockerHub ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [x] Add screenshots for manual tests if appropriate Go to `docker/playground`, and use `docker compose up -d` to run compose services as daemon ``` docker exec -it kyuubi /opt/kyuubi/bin/beeline -u 'jdbc:hive2://0.0.0.0:10009/tpcds/tiny' ``` ``` 0: jdbc:hive2://0.0.0.0:10009/tpcds/tiny> select kyuubi_version(); 2023-11-07 06:12:57.332 INFO org.apache.kyuubi.operation.ExecuteStatement: Processing anonymous's query[41fe38d5-dc3f-4fc3-8a25-3e3c4200ce31]: PENDING_STATE -> RUNNING_STATE, statement: select kyuubi_version() 23/11/07 06:12:57 INFO ExecuteStatement: Processing anonymous's query[41fe38d5-dc3f-4fc3-8a25-3e3c4200ce31]: PENDING_STATE -> RUNNING_STATE, statement: select kyuubi_version() 23/11/07 06:12:57 INFO ExecuteStatement: Spark application name: kyuubi_USER_SPARK_SQL_anonymous_default_1d81daf7-9136-4b0d-97f6-2cd71bcb74fb application ID: local-1699337554479 application web UI: http://0.0.0.0:4040 master: local[*] deploy mode: client version: 3.4.1 Start time: 2023-11-07T06:12:33.491 User: anonymous 23/11/07 06:12:57 INFO ExecuteStatement: Execute in incremental collect mode 23/11/07 06:12:57 INFO CodeGenerator: Code generated in 14.080013 ms 23/11/07 06:12:57 INFO ExecuteStatement: Processing anonymous's query[41fe38d5-dc3f-4fc3-8a25-3e3c4200ce31]: RUNNING_STATE -> FINISHED_STATE, time taken: 0.126 seconds 2023-11-07 06:12:57.461 INFO org.apache.kyuubi.operation.ExecuteStatement: Query[41fe38d5-dc3f-4fc3-8a25-3e3c4200ce31] in FINISHED_STATE 2023-11-07 06:12:57.461 INFO org.apache.kyuubi.operation.ExecuteStatement: Processing anonymous's query[41fe38d5-dc3f-4fc3-8a25-3e3c4200ce31]: RUNNING_STATE -> FINISHED_STATE, time taken: 0.129 seconds +-------------------+ | kyuubi_version() | +-------------------+ | 1.8.0 | +-------------------+ 1 row selected (0.329 seconds) 0: jdbc:hive2://0.0.0.0:10009/tpcds/tiny> ``` - [ ] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request ### _Was this patch authored or co-authored using generative AI tooling?_ No Closes #5640 from pan3793/play-180. Closes #5640 f8c6cf19d [Cheng Pan] Upgrade playground to Kyuubi 1.8.0 and Spark 3.4.1 Authored-by: Cheng Pan Signed-off-by: Cheng Pan --- docker/playground/.env | 12 ++++++------ 1 file changed, 6 insertions(+), 6 deletions(-) diff --git a/docker/playground/.env b/docker/playground/.env index 24284bd39..3e0c3d41b 100644 --- a/docker/playground/.env +++ b/docker/playground/.env @@ -18,13 +18,13 @@ AWS_JAVA_SDK_VERSION=1.12.367 HADOOP_VERSION=3.3.6 HIVE_VERSION=2.3.9 -ICEBERG_VERSION=1.3.1 -KYUUBI_VERSION=1.7.3 -KYUUBI_HADOOP_VERSION=3.3.5 +ICEBERG_VERSION=1.4.2 +KYUUBI_VERSION=1.8.0 +KYUUBI_HADOOP_VERSION=3.3.6 POSTGRES_VERSION=12 POSTGRES_JDBC_VERSION=42.3.4 SCALA_BINARY_VERSION=2.12 -SPARK_VERSION=3.3.3 -SPARK_BINARY_VERSION=3.3 -SPARK_HADOOP_VERSION=3.3.2 +SPARK_VERSION=3.4.1 +SPARK_BINARY_VERSION=3.4 +SPARK_HADOOP_VERSION=3.3.4 ZOOKEEPER_VERSION=3.6.3