The file is segmented into what are called buckets. A bucket is a collection of consecutive records/events that are optionally compressed together. Buckets are intended to be O(MB)-sized, i.e. large enough for efficient compression and optimal for fast decompression.
The bucket consist of an optionally compressed set of consecutive tuples (size, record)
- size: a value of type
uint32which holds record size - record: binary data of arbitrary length
The entire bucket is compressed together, and must be uncompressed prior to deserializing records.