9075fbb623
# 🔍 Description ## Issue References 🔗 This pull request fixes #6281 ## Describe Your Solution 🔧 The change initialize a CI job to run unit testing on python client, including: - Set up Github Action based on docker-compose - Update test cases and test succeeded for dialect `presto` and `trino` - Temporary disabled hive related test due to test cases are not valid, not about connection - Update dev dependencies to support python 3.10 - Speed up testing with `pytest-xdist` plugin ## Types of changes 🔖 - [ ] Bugfix (non-breaking change which fixes an issue) - [ ] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) ## Test Plan 🧪 #### Behavior Without This Pull Request ⚰️ Not able to ran unit test in local and on CI #### Behavior With This Pull Request 🎉 Able to run and partially cover a couple of test cases #### Related Unit Tests No ## Additional notes Next action is about fixing failing test cases or considering skipping some of them if necessary --- # Checklist 📝 - [ ] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html) **Be nice. Be informative.** Closes #6343 from sudohainguyen/ci/init. Closes #6281 682e575c4 [Harry] Remove xdist out of scope dc42ca1ff [Harry] Pin pytest packages version 469f1d955 [Harry] Pin ubuntu version 00cef476a [Harry] Use v4 checkout action 96ef83148 [Harry] Remove unnecessary steps 732344a2c [Harry] Add step to tear down containers 1e2c2481a [Harry] Resolved trino and presto test 5b33e3924 [Harry] Make tests runnable 1be033ba3 [Harry] Remove randome flag which causes failed test run 2bc6dc036 [Harry] Switch action setup provider to docker ea2a76319 [Harry] Initialize github action for python unit testing Authored-by: Harry <quanghai.ng1512@gmail.com> Signed-off-by: Cheng Pan <chengpan@apache.org>
31 lines
1.6 KiB
Bash
31 lines
1.6 KiB
Bash
HIVE_SITE_CONF_javax_jdo_option_ConnectionURL=jdbc:postgresql://hive-metastore-postgresql/metastore
|
|
HIVE_SITE_CONF_javax_jdo_option_ConnectionDriverName=org.postgresql.Driver
|
|
HIVE_SITE_CONF_javax_jdo_option_ConnectionUserName=hive
|
|
HIVE_SITE_CONF_javax_jdo_option_ConnectionPassword=hive
|
|
HIVE_SITE_CONF_datanucleus_autoCreateSchema=false
|
|
HIVE_SITE_CONF_hive_metastore_uris=thrift://hive-metastore:9083
|
|
HDFS_CONF_dfs_namenode_datanode_registration_ip___hostname___check=false
|
|
|
|
CORE_CONF_fs_defaultFS=hdfs://namenode:8020
|
|
CORE_CONF_hadoop_http_staticuser_user=root
|
|
CORE_CONF_hadoop_proxyuser_hue_hosts=*
|
|
CORE_CONF_hadoop_proxyuser_hue_groups=*
|
|
|
|
HDFS_CONF_dfs_webhdfs_enabled=true
|
|
HDFS_CONF_dfs_permissions_enabled=false
|
|
|
|
YARN_CONF_yarn_log___aggregation___enable=true
|
|
YARN_CONF_yarn_resourcemanager_recovery_enabled=true
|
|
YARN_CONF_yarn_resourcemanager_store_class=org.apache.hadoop.yarn.server.resourcemanager.recovery.FileSystemRMStateStore
|
|
YARN_CONF_yarn_resourcemanager_fs_state___store_uri=/rmstate
|
|
YARN_CONF_yarn_nodemanager_remote___app___log___dir=/app-logs
|
|
YARN_CONF_yarn_log_server_url=http://historyserver:8188/applicationhistory/logs/
|
|
YARN_CONF_yarn_timeline___service_enabled=true
|
|
YARN_CONF_yarn_timeline___service_generic___application___history_enabled=true
|
|
YARN_CONF_yarn_resourcemanager_system___metrics___publisher_enabled=true
|
|
YARN_CONF_yarn_resourcemanager_hostname=resourcemanager
|
|
YARN_CONF_yarn_timeline___service_hostname=historyserver
|
|
YARN_CONF_yarn_resourcemanager_address=resourcemanager:8032
|
|
YARN_CONF_yarn_resourcemanager_scheduler_address=resourcemanager:8030
|
|
YARN_CONF_yarn_resourcemanager_resource__tracker_address=resourcemanager:8031
|