From e6918187568dbd01842d8d1d2c808ce16a894239 Mon Sep 17 00:00:00 2001 From: Daniel Baumann Date: Sun, 21 Apr 2024 13:54:28 +0200 Subject: Adding upstream version 18.2.2. Signed-off-by: Daniel Baumann --- .../cpp/submodules/parquet-testing/data/README.md | 58 ++++++++++++++++++++++ 1 file changed, 58 insertions(+) create mode 100644 src/arrow/cpp/submodules/parquet-testing/data/README.md (limited to 'src/arrow/cpp/submodules/parquet-testing/data/README.md') diff --git a/src/arrow/cpp/submodules/parquet-testing/data/README.md b/src/arrow/cpp/submodules/parquet-testing/data/README.md new file mode 100644 index 000000000..80674f303 --- /dev/null +++ b/src/arrow/cpp/submodules/parquet-testing/data/README.md @@ -0,0 +1,58 @@ + + +# Test data files for Parquet compatibility and regression testing + +| File | Description | +|---|---| +| delta_binary_packed.parquet | INT32 and INT64 columns with DELTA_BINARY_PACKED encoding. See [delta_binary_packed.md](delta_binary_packed.md) for details. | +| nested_structs.rust.parquet | Used to test that the Rust Arrow reader can lookup the correct field from a nested struct. See [ARROW-11452](https://issues.apache.org/jira/browse/ARROW-11452) | + +TODO: Document what each file is in the table above. + +## Encrypted Files + +Tests files with .parquet.encrypted suffix are encrypted using Parquet Modular Encryption. + +A detailed description of the Parquet Modular Encryption specification can be found here: +``` + https://github.com/apache/parquet-format/blob/encryption/Encryption.md +``` + +Following are the keys and key ids (when using key\_retriever) used to encrypt the encrypted columns and footer in the all the encrypted files: +* Encrypted/Signed Footer: + * key: {0,1,2,3,4,5,6,7,8,9,0,1,2,3,4,5} + * key_id: "kf" +* Encrypted column named double_field: + * key: {1,2,3,4,5,6,7,8,9,0,1,2,3,4,5,0} + * key_id: "kc1" +* Encrypted column named float_field: + * key: {1,2,3,4,5,6,7,8,9,0,1,2,3,4,5,1} + * key_id: "kc2" + +The following files are encrypted with AAD prefix "tester": +1. encrypt\_columns\_and\_footer\_disable\_aad\_storage.parquet.encrypted +2. encrypt\_columns\_and\_footer\_aad.parquet.encrypted + + +A sample that reads and checks these files can be found at the following tests: +``` +cpp/src/parquet/encryption-read-configurations-test.cc +cpp/src/parquet/test-encryption-util.h +``` -- cgit v1.2.3