# bolt-parquet-reader

**Repository Path**: ByteDance/bolt-parquet-reader

## Basic Information

- **Project Name**: bolt-parquet-reader
- **Description**: No description available
- **Primary Language**: Unknown
- **License**: Apache-2.0
- **Default Branch**: main
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2024-03-19
- **Last Updated**: 2026-02-11

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

<!---
  Copyright (c) ByteDance, Inc. and its affiliates.

  Licensed under the Apache License, Version 2.0 (the "License");
  you may not use this file except in compliance with the License.
  You may obtain a copy of the License at
 
      http://www.apache.org/licenses/LICENSE-2.0

  Unless required by applicable law or agreed to in writing, software
  distributed under the License is distributed on an "AS IS" BASIS,
  WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
  See the License for the specific language governing permissions and
  limitations under the License.
-->

> [!NOTE]
> This repo is achvieved, please checkout the project [Bolt](https://github.com/bytedance/bolt) for the same requirements


# ByteDance Bolt Parquet Reader
ByteDance's next generation universal high-performance Parquet Reader.

# Design Goal
The Bolt Parquet Reader is a native Parquet Reader in Rust language.

This design supports steaming reading, which allows to read the whole batch in smaller batches and reduce the peak memory cost. And, as a result, it is able to increase the overall parallelism.

Moreover, Bolt Parquet Reader is designed with a sophisticated filter push down strategies and range selectivity operations. Considering the consecutive reading progress, this feature is able to reduce unnecessary branching operations.

# Roadmap
This project is under actively development. You are more than welcomed to make contributions.

# How to Compile

### 1. Pull the code
```
git clone https://github.com/bytedance/bolt-parquet-reader.git
```

### 2. Prepare Rust Environment
```
# We recommend to use this version to enable zero copy features.
rustup install nightly-2023-11-13
```

### 3. Compile and Execute
```
cargo +nightly-2023-11-13 fmt --all -- --check
cargo +nightly-2023-11-13 build --package bolt-parquet-reader --lib
cargo +nightly-2023-11-13 test --verbose
cargo +nightly-2023-11-13 clippy --verbose
```

# License
The Bolt Parquet Reader is licensed under Apache 2.0.

During the development, we referenced a lot to Rust Arrow 2 implementation and would like to express our appreciation the authors.