1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
|
<!--
~ Licensed to the Apache Software Foundation (ASF) under one
~ or more contributor license agreements. See the NOTICE file
~ distributed with this work for additional information
~ regarding copyright ownership. The ASF licenses this file
~ to you under the Apache License, Version 2.0 (the
~ "License"); you may not use this file except in compliance
~ with the License. You may obtain a copy of the License at
~
~ http://www.apache.org/licenses/LICENSE-2.0
~
~ Unless required by applicable law or agreed to in writing,
~ software distributed under the License is distributed on an
~ "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
~ KIND, either express or implied. See the License for the
~ specific language governing permissions and limitations
~ under the License.
-->
`delta_binary_packed.parquet` is generated with parquet-mr version 1.10.0.
The expected file contents are in `delta_binary_packed_expect.csv`.
Each column is DELTA_BINARY_PACKED-encoded, with a different delta bitwidth
for each column.
Each column has 200 rows including 1 first value and 2 blocks. The first block
has 4 miniblocks, the second block has 3. Each miniblock contains 32 values,
except the last one which only contains 7 values (1 + 6 \* 32 + 7 == 200).
Here is the file structure:
```
File Name: /home/antoine/parquet/testing/data/delta_binary_packed.parquet
Version: 1.0
Created By: parquet-mr version 1.10.0 (build 031a6654009e3b82020012a18434c582bd74c73a)
Total rows: 200
Number of RowGroups: 1
Number of Real Columns: 66
Number of Columns: 66
Number of Selected Columns: 66
Column 0: bitwidth0 (INT64)
Column 1: bitwidth1 (INT64)
Column 2: bitwidth2 (INT64)
Column 3: bitwidth3 (INT64)
Column 4: bitwidth4 (INT64)
Column 5: bitwidth5 (INT64)
Column 6: bitwidth6 (INT64)
Column 7: bitwidth7 (INT64)
Column 8: bitwidth8 (INT64)
Column 9: bitwidth9 (INT64)
Column 10: bitwidth10 (INT64)
Column 11: bitwidth11 (INT64)
Column 12: bitwidth12 (INT64)
Column 13: bitwidth13 (INT64)
Column 14: bitwidth14 (INT64)
Column 15: bitwidth15 (INT64)
Column 16: bitwidth16 (INT64)
Column 17: bitwidth17 (INT64)
Column 18: bitwidth18 (INT64)
Column 19: bitwidth19 (INT64)
Column 20: bitwidth20 (INT64)
Column 21: bitwidth21 (INT64)
Column 22: bitwidth22 (INT64)
Column 23: bitwidth23 (INT64)
Column 24: bitwidth24 (INT64)
Column 25: bitwidth25 (INT64)
Column 26: bitwidth26 (INT64)
Column 27: bitwidth27 (INT64)
Column 28: bitwidth28 (INT64)
Column 29: bitwidth29 (INT64)
Column 30: bitwidth30 (INT64)
Column 31: bitwidth31 (INT64)
Column 32: bitwidth32 (INT64)
Column 33: bitwidth33 (INT64)
Column 34: bitwidth34 (INT64)
Column 35: bitwidth35 (INT64)
Column 36: bitwidth36 (INT64)
Column 37: bitwidth37 (INT64)
Column 38: bitwidth38 (INT64)
Column 39: bitwidth39 (INT64)
Column 40: bitwidth40 (INT64)
Column 41: bitwidth41 (INT64)
Column 42: bitwidth42 (INT64)
Column 43: bitwidth43 (INT64)
Column 44: bitwidth44 (INT64)
Column 45: bitwidth45 (INT64)
Column 46: bitwidth46 (INT64)
Column 47: bitwidth47 (INT64)
Column 48: bitwidth48 (INT64)
Column 49: bitwidth49 (INT64)
Column 50: bitwidth50 (INT64)
Column 51: bitwidth51 (INT64)
Column 52: bitwidth52 (INT64)
Column 53: bitwidth53 (INT64)
Column 54: bitwidth54 (INT64)
Column 55: bitwidth55 (INT64)
Column 56: bitwidth56 (INT64)
Column 57: bitwidth57 (INT64)
Column 58: bitwidth58 (INT64)
Column 59: bitwidth59 (INT64)
Column 60: bitwidth60 (INT64)
Column 61: bitwidth61 (INT64)
Column 62: bitwidth62 (INT64)
Column 63: bitwidth63 (INT64)
Column 64: bitwidth64 (INT64)
Column 65: int_value (INT32)
--- Row Group: 0 ---
--- Total Bytes: 65467 ---
--- Total Compressed Bytes: 0 ---
--- Rows: 200 ---
Column 0
Values: 200, Null Values: 0, Distinct Values: 0
Max: 6374628540732951412, Min: 6374628540732951412
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 95, Compressed Size: 95
Column 1
Values: 200, Null Values: 0, Distinct Values: 0
Max: 0, Min: -104
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 114, Compressed Size: 114
Column 2
Values: 200, Null Values: 0, Distinct Values: 0
Max: 0, Min: -82
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 144, Compressed Size: 144
Column 3
Values: 200, Null Values: 0, Distinct Values: 0
Max: 0, Min: -96
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 172, Compressed Size: 172
Column 4
Values: 200, Null Values: 0, Distinct Values: 0
Max: 0, Min: -132
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 200, Compressed Size: 200
Column 5
Values: 200, Null Values: 0, Distinct Values: 0
Max: 24, Min: -290
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 228, Compressed Size: 228
Column 6
Values: 200, Null Values: 0, Distinct Values: 0
Max: 259, Min: -93
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 256, Compressed Size: 256
Column 7
Values: 200, Null Values: 0, Distinct Values: 0
Max: 476, Min: -64
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 284, Compressed Size: 284
Column 8
Values: 200, Null Values: 0, Distinct Values: 0
Max: 387, Min: -732
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 314, Compressed Size: 314
Column 9
Values: 200, Null Values: 0, Distinct Values: 0
Max: 194, Min: -1572
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 342, Compressed Size: 342
Column 10
Values: 200, Null Values: 0, Distinct Values: 0
Max: 5336, Min: -2353
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 370, Compressed Size: 370
Column 11
Values: 200, Null Values: 0, Distinct Values: 0
Max: 13445, Min: -8028
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 398, Compressed Size: 398
Column 12
Values: 200, Null Values: 0, Distinct Values: 0
Max: 2017, Min: -35523
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 426, Compressed Size: 426
Column 13
Values: 200, Null Values: 0, Distinct Values: 0
Max: 48649, Min: -4096
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 454, Compressed Size: 454
Column 14
Values: 200, Null Values: 0, Distinct Values: 0
Max: 65709, Min: -8244
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 482, Compressed Size: 482
Column 15
Values: 200, Null Values: 0, Distinct Values: 0
Max: 69786, Min: -106702
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 512, Compressed Size: 512
Column 16
Values: 200, Null Values: 0, Distinct Values: 0
Max: 162951, Min: -347012
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 540, Compressed Size: 540
Column 17
Values: 200, Null Values: 0, Distinct Values: 0
Max: 0, Min: -1054098
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 568, Compressed Size: 568
Column 18
Values: 200, Null Values: 0, Distinct Values: 0
Max: 664380, Min: -372793
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 596, Compressed Size: 596
Column 19
Values: 200, Null Values: 0, Distinct Values: 0
Max: 4001179, Min: -402775
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 624, Compressed Size: 624
Column 20
Values: 200, Null Values: 0, Distinct Values: 0
Max: 788039, Min: -4434785
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 652, Compressed Size: 652
Column 21
Values: 200, Null Values: 0, Distinct Values: 0
Max: 12455554, Min: -1070042
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 680, Compressed Size: 680
Column 22
Values: 200, Null Values: 0, Distinct Values: 0
Max: 2189135, Min: -17987827
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 710, Compressed Size: 710
Column 23
Values: 200, Null Values: 0, Distinct Values: 0
Max: 25967351, Min: -19361900
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 738, Compressed Size: 738
Column 24
Values: 200, Null Values: 0, Distinct Values: 0
Max: 95688064, Min: -17271207
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 766, Compressed Size: 766
Column 25
Values: 200, Null Values: 0, Distinct Values: 0
Max: 169215083, Min: -18759951
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 794, Compressed Size: 794
Column 26
Values: 200, Null Values: 0, Distinct Values: 0
Max: 163626565, Min: -168761837
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 822, Compressed Size: 822
Column 27
Values: 200, Null Values: 0, Distinct Values: 0
Max: 131734874, Min: -736933601
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 850, Compressed Size: 850
Column 28
Values: 200, Null Values: 0, Distinct Values: 0
Max: 913547745, Min: -490714808
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 878, Compressed Size: 878
Column 29
Values: 200, Null Values: 0, Distinct Values: 0
Max: 500305035, Min: -5834684238
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 908, Compressed Size: 908
Column 30
Values: 200, Null Values: 0, Distinct Values: 0
Max: 566280334, Min: -7728643109
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 936, Compressed Size: 936
Column 31
Values: 200, Null Values: 0, Distinct Values: 0
Max: 18831788461, Min: -2498101101
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 964, Compressed Size: 964
Column 32
Values: 200, Null Values: 0, Distinct Values: 0
Max: 23720914586, Min: -2147483648
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 992, Compressed Size: 992
Column 33
Values: 200, Null Values: 0, Distinct Values: 0
Max: 24075494509, Min: -4817999329
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1020, Compressed Size: 1020
Column 34
Values: 200, Null Values: 0, Distinct Values: 0
Max: 12118456329, Min: -156025641218
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1048, Compressed Size: 1048
Column 35
Values: 200, Null Values: 0, Distinct Values: 0
Max: 41614351758, Min: -114682966820
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1076, Compressed Size: 1076
Column 36
Values: 200, Null Values: 0, Distinct Values: 0
Max: 82484946621, Min: -244178626927
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1106, Compressed Size: 1106
Column 37
Values: 200, Null Values: 0, Distinct Values: 0
Max: 361459323159, Min: -275190620271
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1134, Compressed Size: 1134
Column 38
Values: 200, Null Values: 0, Distinct Values: 0
Max: 1665294434042, Min: -420452598502
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1162, Compressed Size: 1162
Column 39
Values: 200, Null Values: 0, Distinct Values: 0
Max: 110454290134, Min: -2926211785103
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1190, Compressed Size: 1190
Column 40
Values: 200, Null Values: 0, Distinct Values: 0
Max: 3215717068302, Min: -4988823342986
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1218, Compressed Size: 1218
Column 41
Values: 200, Null Values: 0, Distinct Values: 0
Max: 2166086616318, Min: -6488418568768
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1246, Compressed Size: 1246
Column 42
Values: 200, Null Values: 0, Distinct Values: 0
Max: 10182365256028, Min: -8738522616121
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1274, Compressed Size: 1274
Column 43
Values: 200, Null Values: 0, Distinct Values: 0
Max: 22909885827147, Min: -21214625470327
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1304, Compressed Size: 1304
Column 44
Values: 200, Null Values: 0, Distinct Values: 0
Max: 67902133645749, Min: -9796939892175
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1332, Compressed Size: 1332
Column 45
Values: 200, Null Values: 0, Distinct Values: 0
Max: 199494208930939, Min: -102473613757961
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1360, Compressed Size: 1360
Column 46
Values: 200, Null Values: 0, Distinct Values: 0
Max: 18564971260296, Min: -359696498357610
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1388, Compressed Size: 1388
Column 47
Values: 200, Null Values: 0, Distinct Values: 0
Max: 65624006999260, Min: -933995610201533
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1416, Compressed Size: 1416
Column 48
Values: 200, Null Values: 0, Distinct Values: 0
Max: 983500521840940, Min: -878019827431629
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1444, Compressed Size: 1444
Column 49
Values: 200, Null Values: 0, Distinct Values: 0
Max: 975533803684560, Min: -2091164446177739
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1472, Compressed Size: 1472
Column 50
Values: 200, Null Values: 0, Distinct Values: 0
Max: 1276327559487856, Min: -5741928190724373
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1502, Compressed Size: 1502
Column 51
Values: 200, Null Values: 0, Distinct Values: 0
Max: 0, Min: -15996275819941210
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1530, Compressed Size: 1530
Column 52
Values: 200, Null Values: 0, Distinct Values: 0
Max: 12697545666077932, Min: -8823113595895130
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1558, Compressed Size: 1558
Column 53
Values: 200, Null Values: 0, Distinct Values: 0
Max: 4785870085681342, Min: -24800000653307089
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1586, Compressed Size: 1586
Column 54
Values: 200, Null Values: 0, Distinct Values: 0
Max: 26202576654140994, Min: -94647392931900711
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1614, Compressed Size: 1614
Column 55
Values: 200, Null Values: 0, Distinct Values: 0
Max: 358302517069012889, Min: -32197353745654772
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1642, Compressed Size: 1642
Column 56
Values: 200, Null Values: 0, Distinct Values: 0
Max: 678791154000627912, Min: -36028797018963968
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1670, Compressed Size: 1670
Column 57
Values: 200, Null Values: 0, Distinct Values: 0
Max: 1444945950888122232, Min: -79246600304853010
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1700, Compressed Size: 1700
Column 58
Values: 200, Null Values: 0, Distinct Values: 0
Max: 140747723990970254, Min: -1492687553985044679
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1728, Compressed Size: 1728
Column 59
Values: 200, Null Values: 0, Distinct Values: 0
Max: 6318360990909070, Min: -3778424577629102559
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1756, Compressed Size: 1756
Column 60
Values: 200, Null Values: 0, Distinct Values: 0
Max: 4574162334421819801, Min: -576460752303423488
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1784, Compressed Size: 1784
Column 61
Values: 200, Null Values: 0, Distinct Values: 0
Max: 8803535686130338880, Min: -1155450847100943978
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1812, Compressed Size: 1812
Column 62
Values: 200, Null Values: 0, Distinct Values: 0
Max: 9026687750017193101, Min: -4454039315625288390
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1840, Compressed Size: 1840
Column 63
Values: 200, Null Values: 0, Distinct Values: 0
Max: 9150047972721273816, Min: -9220123451143279334
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1868, Compressed Size: 1868
Column 64
Values: 200, Null Values: 0, Distinct Values: 0
Max: 8846115173408951296, Min: -9223372036854775808
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1898, Compressed Size: 1898
Column 65
Values: 200, Null Values: 0, Distinct Values: 0
Max: 2142811258, Min: -2078683524
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 980, Compressed Size: 980
```
|
