kyuubi/externals
Fu Chen 77b28e9398
[KYUUBI #4895] [ARROW] Reflective calls to the function ArrowConverters#fromBatchIterator
### _Why are the changes needed?_

to adapt Spark 3.5

the signature of function `ArrowConverters#fromBatchIterator` is changed in [SPARK-43528](https://github.com/apache/spark/pull/41190) (since Spark 3.5)

Spark 3.4 or previous

```scala
  private[sql] def fromBatchIterator(
      arrowBatchIter: Iterator[Array[Byte]],
      schema: StructType,
      timeZoneId: String,
      context: TaskContext): Iterator[InternalRow]
```

Spark 3.5 or later

```scala
  private[sql] def fromBatchIterator(
      arrowBatchIter: Iterator[Array[Byte]],
      schema: StructType,
      timeZoneId: String,
      errorOnDuplicatedFieldNames: Boolean,
      context: TaskContext): Iterator[InternalRow]
```

### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [x] [Run test](https://kyuubi.readthedocs.io/en/master/develop_tools/testing.html#running-tests) locally before make a pull request

Closes #4895 from cfmcgrady/arrow-spark35.

Closes #4895

87d5b7240 [Fu Chen] fix ci
b37b321d5 [Fu Chen] adapt Spark 3.5

Authored-by: Fu Chen <cfmcgrady@gmail.com>
Signed-off-by: Cheng Pan <chengpan@apache.org>
2023-05-30 15:45:05 +08:00
..
kyuubi-chat-engine [KYUUBI #4870] Add kyuubi-util and kyuubi-util-scala modules 2023-05-22 22:13:56 +08:00
kyuubi-download [KYUUBI #4348] [INFRA] Cache engine archives in CI jobs for maven download plugin 2023-02-18 22:34:02 +08:00
kyuubi-flink-sql-engine [KYUUBI #4870] Add kyuubi-util and kyuubi-util-scala modules 2023-05-22 22:13:56 +08:00
kyuubi-hive-sql-engine [KYUUBI #4852] Switch to Kyuubi Shaded Zookeeper 2023-05-21 20:49:00 +08:00
kyuubi-jdbc-engine [KYUUBI #4739] Add operation lock instead of locking state Enumeration 2023-04-21 10:49:21 +08:00
kyuubi-spark-sql-engine [KYUUBI #4895] [ARROW] Reflective calls to the function ArrowConverters#fromBatchIterator 2023-05-30 15:45:05 +08:00
kyuubi-trino-engine [KYUUBI #4792] [MINOR] Enhance hardcode session keywords and remove unused code 2023-05-12 08:30:18 +08:00