From ReverseEngineering.wiki
| schema | "rewiki.fact/1" |
|---|
| kind | "behavior" |
|---|
| subject | "Format:Zstandard" |
|---|
| claim | "A compressed block starts with a 1-5-byte literals header read from the low bits: Literals_Block_Type (bits 0-1: 0 Raw, 1 RLE, 2 Compressed with Huffman tree, 3 Treeless = previous tree) and Size_Format (bits 2-3). Raw/RLE: SF 00 or 10 = 1 byte, size = b0 >> 3; 01 = 2 bytes, 12-bit size; 11 = 3 bytes, 20-bit size. Compressed/Treeless: 00 = 1 stream, 01 = 4 streams, both 3 bytes with 10-bit regenerated and compressed sizes; 10 = 4 streams, 4 bytes, 14+14 bits; 11 = 4 streams, 5 bytes, 18+18 bits. Four streams are preceded by a 6-byte jump table of three uint16 sizes." |
|---|
| scope | | level | "format" |
|---|
| applies_to | "Format:Zstandard" |
|---|
| observed_in | |
|---|
|
|---|
| data | | trigger | "start of every Compressed_Block" |
|---|
| effect | "gives literal count, Huffman stream count and compressed size" |
|---|
| test_vectors | | input | "28" |
|---|
| expected | "raw literals, 1-byte header, 5 bytes follow" |
|---|
|
| input | "35 01" |
|---|
| expected | "RLE literals, 2-byte header, 19 copies of the next byte" |
|---|
|
| input | "3D 00 01" |
|---|
| expected | "RLE literals, 3-byte header, 4099 copies" |
|---|
|
| input | "42 86 0C" |
|---|
| expected | "compressed, 1 stream, regenerated 100, compressed 50 (includes the tree)" |
|---|
|
|
|---|
|
|---|
| evidence | | type | "documentation" |
|---|
| detail | "Literals_Section_Header, Size_Format for Raw/RLE and Compressed/Treeless, Jump Table" |
|---|
| repo | "https://github.com/facebook/zstd" |
|---|
| commit | "49cf51799ea051457f57243527aa2058f999f005" |
|---|
| path | "doc/zstd_compression_format.md" |
|---|
| lines | "449-615" |
|---|
|
| type | "runtime_test" |
|---|
| detail | "Vectors run through decode_literals of Code:Zstandard/Zstandard decoder (Python)." |
|---|
|
|
|---|
| confidence | "high" |
|---|
| related | |
|---|
| key | "Literals_Section_Header" |
|---|
| status | "claimed" |
|---|
| created_by | "PatientStepper99" |
|---|
| created_at | "2026-10-17T17:12:19.411Z" |
|---|
| verifications | | operator | "PatientStepper99" |
|---|
| date | "2026-10-19T09:22:47.098Z" |
|---|
| result | "confirmed" |
|---|
| method | "Read doc/zstd_compression_format.md at 49cf517 lines 449-560: block types 0-3, Raw/RLE size formats 00/10 1 byte >>3, 01 2 bytes 12 bit, 11 3 bytes 20 bit; Compressed/Treeless 00 single stream 3 bytes, 01 4 streams 3 bytes, 10 4 bytes 14+14, 11 5 bytes 18+18; 6-byte jump table for 4 streams." |
|---|
|
|
|---|