[KYUUBI #3881] Upgrade playground components to latest versions

### _Why are the changes needed?_

This PR upgrades Kyuubi playground components to latest versions, including Spark 3.3.1, Kyuubi 1.6.1-incubating, Iceberg 1.1.0, and reorganizes the files in catalog folders.

The images has been uploaded to Docker Hub.

### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [x] Add screenshots for manual tests if appropriate

```
cd docker/playground
docker compose up -d
```

```
docker exec -it kyuubi /opt/kyuubi/bin/beeline -u 'jdbc:hive2://0.0.0.0:10009/tpcds/tiny'
```

<img width="1416" alt="image" src="https://user-images.githubusercontent.com/26535726/204845474-b0dff173-d335-43bf-b61f-d8c34ee26ff8.png">

- [ ] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests) locally before make a pull request

Closes #3881 from pan3793/playground.

Closes #3881

a3d42377 [Cheng Pan] Upgrade playground components to latest versions

Authored-by: Cheng Pan <chengpan@apache.org>
Signed-off-by: Cheng Pan <chengpan@apache.org>

docker/playground/.env

@@ -18,13 +18,13 @@
 AWS_JAVA_SDK_VERSION=1.12.239
 HADOOP_VERSION=3.3.1
 HIVE_VERSION=2.3.9
-ICEBERG_VERSION=0.14.1
-KYUUBI_VERSION=1.6.0-incubating
+ICEBERG_VERSION=1.1.0
+KYUUBI_VERSION=1.6.1-incubating
 KYUUBI_HADOOP_VERSION=3.3.4
 POSTGRES_VERSION=12
 POSTGRES_JDBC_VERSION=42.3.4
 SCALA_BINARY_VERSION=2.12
-SPARK_VERSION=3.3.0
+SPARK_VERSION=3.3.1
 SPARK_BINARY_VERSION=3.3
 SPARK_HADOOP_VERSION=3.3.2
 ZOOKEEPER_VERSION=3.6.3

docker/playground/README.md

@@ -6,28 +6,28 @@ Playground
 ### Setup
 
 1. Install [Docker](https://docs.docker.com/get-docker/) and [Docker Compose](https://docs.docker.com/compose/);
-2. Go to `docker/playground`, and use `docker compose up` to start compose services in the foreground, or use `docker compose up -d` to run compose services as daemon;
+2. Go to `docker/playground`, and use `docker compose up -d` to run compose services as daemon;
 
 ### Play
 
 1. Connect using `beeline`
 
-`docker exec -it kyuubi /opt/kyuubi/bin/beeline -u 'jdbc:hive2://0.0.0.0:10009/'`;
+`docker exec -it kyuubi /opt/kyuubi/bin/beeline -u 'jdbc:hive2://0.0.0.0:10009/tpcds/tiny'`;
 
 2. Connect using DBeaver
 
 Add a Kyuubi datasource with
 
-- connection url `jdbc:hive2://0.0.0.0:10009/`
+- connection url `jdbc:hive2://0.0.0.0:10009/tpcds/tiny`
 - username: `anonymous`
 - password: `<empty>`
 
-3. Using built-in dataset
+3. Use built-in dataset
 
-Kyuubi supply some built-in dataset, After the Kyuubi starts, you can run the following command to load the different datasets:
+Kyuubi supply some built-in dataset, after Kyuubi started, you can run the following command to load the different datasets:
 
-- For loading TPC-DS tiny dataset to spark_catalog.tpcds_tiny, run `docker exec -it kyuubi /opt/kyuubi/bin/beeline -u 'jdbc:hive2://0.0.0.0:10009/' -f /opt/load_data/load-dataset-tpcds-tiny.sql`
-- For loading TPC-H tiny dataset to spark_catalog.tpch_tiny, run `docker exec -it kyuubi /opt/kyuubi/bin/beeline -u 'jdbc:hive2://0.0.0.0:10009/' -f /opt/load_data/load-dataset-tpch-tiny.sql`
+- For loading TPC-DS tiny dataset to `spark_catalog.tpcds_tiny`, run `docker exec -it kyuubi /opt/kyuubi/bin/beeline -u 'jdbc:hive2://0.0.0.0:10009/' -f /opt/load_data/load-dataset-tpcds-tiny.sql`
+- For loading TPC-H  tiny dataset to `spark_catalog.tpch_tiny`,  run `docker exec -it kyuubi /opt/kyuubi/bin/beeline -u 'jdbc:hive2://0.0.0.0:10009/' -f /opt/load_data/load-dataset-tpch-tiny.sql`
 
 ### Access Service
 
@@ -37,8 +37,7 @@ Kyuubi supply some built-in dataset, After the Kyuubi starts, you can run the fo
 
 ### Shutdown
 
-1. Stop compose services by pressing `CTRL+C` if they are running on the foreground, or by `docker compose down` if they are running as daemon;
-2. Remove the stopped containers `docker compose rm`;
+1. Stop compose services by `docker compose down`;
 
 ## For Maintainers
 

docker/playground/build-image.sh

@@ -19,9 +19,8 @@
 
 set -e
 
-
 APACHE_MIRROR=${APACHE_MIRROR:-https://dlcdn.apache.org}
-MAVEN_MIRROR=${MAVEN_MIRROR:-https://repo1.maven.org/maven2}
+MAVEN_MIRROR=${MAVEN_MIRROR:-https://maven-central-asia.storage-download.googleapis.com/maven2}
 BUILD_CMD="docker build"
 
 if [ $BUILDX ]; then

docker/playground/compose.yml

@@ -39,8 +39,8 @@ services:
     ports:
       - 5432:5432
     volumes:
-      - ./image/hive-schema-2.3.0.postgres.sql:/docker-entrypoint-initdb.d/hive-schema-2.3.0.postgres.sql
-      - ./image/hive-txn-schema-2.3.0.postgres.sql:/docker-entrypoint-initdb.d/hive-txn-schema-2.3.0.postgres.sql
+      - ./script/hive-schema-2.3.0.postgres.sql:/docker-entrypoint-initdb.d/hive-schema-2.3.0.postgres.sql
+      - ./script/hive-txn-schema-2.3.0.postgres.sql:/docker-entrypoint-initdb.d/hive-txn-schema-2.3.0.postgres.sql
 
   zookeeper:
     image: zookeeper:${ZOOKEEPER_VERSION}
@@ -56,8 +56,8 @@ services:
     ports:
       - 9083
     volumes:
-      - ./image/core-site.xml:/etc/hadoop/conf/core-site.xml
-      - ./image/hive-site.xml:/etc/hive/conf/hive-site.xml
+      - ./conf/core-site.xml:/etc/hadoop/conf/core-site.xml
+      - ./conf/hive-site.xml:/etc/hive/conf/hive-site.xml
     depends_on:
       - postgres
 
@@ -69,13 +69,13 @@ services:
       - 4040-4050:4040-4050
       - 10009:10009
     volumes:
-      - ./image/core-site.xml:/etc/hadoop/conf/core-site.xml
-      - ./image/hive-site.xml:/etc/hive/conf/hive-site.xml
-      - ./image/spark-defaults.conf:/etc/spark/conf/spark-defaults.conf
-      - ./image/kyuubi-defaults.conf:/etc/kyuubi/conf/kyuubi-defaults.conf
-      - ./image/kyuubi-log4j2.xml:/etc/kyuubi/conf/log4j2.xml
-      - ./image/load-dataset-tpcds-tiny.sql:/opt/load_data/load-dataset-tpcds-tiny.sql
-      - ./image/load-dataset-tpch-tiny.sql:/opt/load_data/load-dataset-tpch-tiny.sql
+      - ./conf/core-site.xml:/etc/hadoop/conf/core-site.xml
+      - ./conf/hive-site.xml:/etc/hive/conf/hive-site.xml
+      - ./conf/spark-defaults.conf:/etc/spark/conf/spark-defaults.conf
+      - ./conf/kyuubi-defaults.conf:/etc/kyuubi/conf/kyuubi-defaults.conf
+      - ./conf/kyuubi-log4j2.xml:/etc/kyuubi/conf/log4j2.xml
+      - ./script/load-dataset-tpcds-tiny.sql:/opt/load_data/load-dataset-tpcds-tiny.sql
+      - ./script/load-dataset-tpch-tiny.sql:/opt/load_data/load-dataset-tpch-tiny.sql
     depends_on:
       - metastore
       - minio

docker/playground/conf/kyuubi-defaults.conf

@@ -18,9 +18,9 @@
 ## Kyuubi Configurations
 
 kyuubi.authentication=NONE
-kyuubi.frontend.bind.host=0.0.0.0
-kyuubi.frontend.bind.port=10009
-kyuubi.ha.zookeeper.quorum=zookeeper:2181
+kyuubi.frontend.thrift.binary.bind.host=0.0.0.0
+kyuubi.frontend.thrift.binary.bind.port=10009
+kyuubi.ha.addresses=zookeeper:2181
 kyuubi.session.engine.idle.timeout=PT5M
 kyuubi.operation.incremental.collect=true
 kyuubi.operation.progress.enabled=true