kyuubi/externals
吴梓溢 0a53415d92
[KYUUBI #6469] Lazily initialize RecordReaderIterator to avoid driver oom when fetching big result set
# 🔍 Description
## Issue References 🔗

This pull request fixes https://github.com/apache/kyuubi/issues/6469

## Describe Your Solution 🔧

Instead of initializing all RecordReaderIterator when create OrcFileIterator,we can lazily initialize the RecordReaderIterator to make sure that there is only one RecordReaderIterator which reads file current fetching by client in driver memory.

## Types of changes 🔖

- [x] Bugfix (non-breaking change which fixes an issue)
- [ ] New feature (non-breaking change which adds functionality)
- [ ] Breaking change (fix or feature that would cause existing functionality to change)

## Test Plan 🧪

#### Behavior Without This Pull Request ⚰️

#### Behavior With This Pull Request 🎉

#### Related Unit Tests

---

# Checklist 📝

- [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html)

Closes #6470 from Z1Wu/bugfix-fetch-big-resultset-lazily.

Closes #6469

83208018c [吴梓溢] update
56284e68e [吴梓溢] update

Authored-by: 吴梓溢 <wuziyi02@corp.netease.com>
Signed-off-by: Cheng Pan <chengpan@apache.org>
2024-06-20 11:06:20 +08:00
..
kyuubi-chat-engine [KYUUBI #6376] Improve closeEngine method names and logs due to closeSession 2024-05-11 11:10:56 +08:00
kyuubi-download [RELEASE] Bump 1.10.0-SNAPSHOT 2024-03-13 14:24:49 +08:00
kyuubi-flink-sql-engine [KYUUBI #6458] Remove commons-logging from binary release 2024-06-11 11:32:30 +08:00
kyuubi-hive-sql-engine [KYUUBI #6439] kyuubi-util-scala test jar leaked to compile scope 2024-06-04 11:31:58 +08:00
kyuubi-jdbc-engine [KYUUBI #6439] kyuubi-util-scala test jar leaked to compile scope 2024-06-04 11:31:58 +08:00
kyuubi-spark-sql-engine [KYUUBI #6469] Lazily initialize RecordReaderIterator to avoid driver oom when fetching big result set 2024-06-20 11:06:20 +08:00
kyuubi-trino-engine [KYUUBI #6387] [TRINO] Trino engine improve operation log 2024-05-15 16:38:54 +08:00