kyuubi/extensions
tian bao 47063d9264
[KYUUBI #7129] Support PARQUET hive table pushdown filter
### Why are the changes needed?

Previously, the `HiveScan` class was used to read data. If it is determined to be PARQUET type, the `ParquetScan` from Spark datasourcev2 can be used. `ParquetScan` supports pushfilter down, but `HiveScan` does not yet support it.

The conversation can be controlled by setting `spark.sql.kyuubi.hive.connector.read.convertMetastoreParquet`. When enabled, the data source PARQUET reader is used to process PARQUET tables created by using the HiveQL syntax, instead of Hive SerDe.

close https://github.com/apache/kyuubi/issues/7129

### How was this patch tested?

added unit test

### Was this patch authored or co-authored using generative AI tooling?

No

Closes #7130 from flaming-archer/master_parquet_filterdown.

Closes #7129

d7059dca4 [tian bao] Support PARQUET hive table pushdown filter

Authored-by: tian bao <2011xuesong@gmail.com>
Signed-off-by: Cheng Pan <chengpan@apache.org>
2025-07-17 14:42:46 +08:00
..
flink/kyuubi-flink-token-provider [KYUUBI #6820] Explicitly disable attach-scaladocs for pure Java modules 2024-11-22 17:12:00 +08:00
server/kyuubi-server-plugin [KYUUBI #6820] Explicitly disable attach-scaladocs for pure Java modules 2024-11-22 17:12:00 +08:00
spark [KYUUBI #7129] Support PARQUET hive table pushdown filter 2025-07-17 14:42:46 +08:00
README.md

For developers

This folder contains plugins/extension for kyuubi server and different engine types.

  • ext
    • kyuubi-server
    • spark
    • flink
    • trino
    • hive
    • others
    • ...