From ReverseEngineering.wiki
| schema | "rewiki.fact/1" |
|---|
| kind | "identification" |
|---|
| subject | "Format:Zstandard" |
|---|
| claim | "To tell a real Zstandard frame from stray 28 B5 2F FD bytes (for example the magic used as an immediate in decoder code): require the Frame_Header_Descriptor Reserved_bit (bit 3, mask 0x08) to be 0, then walk the 3-byte block headers: Block_Type 3 is invalid, every block's size (raw, RLE count and compressed) must be at most Block_Maximum_Size = min(Window_Size, 131072), and the frame must end with a Last_Block (plus 4 checksum bytes when Content_Checksum_flag, bit 2, is set). This is a heuristic from the spec, not a rule any decoder applies as a recogniser. In libzstd 1.5.6's own DLL all 26 occurrences fail these checks (runtime test, not re-read here)." |
|---|
| scope | | level | "format" |
|---|
| applies_to | "Format:Zstandard" |
|---|
| observed_in | |
|---|
|
|---|
| data | | method | "magic + header and block-chain validation" |
|---|
| indicator | "28 B5 2F FD, FHD & 0x08 == 0, valid block chain ending in Last_Block" |
|---|
|
|---|
| evidence | | type | "runtime_test" |
|---|
| detail | "zstd_decode.py --scan (Code:Zstandard/Zstandard decoder (Python)) on a test file with a fake magic (FHD 0x08) and two real frames reports exactly the two frames; on libzstd.dll 1.5.6 (Git for Windows) every candidate fails with 'block size ... > Block_Maximum_Size'." |
|---|
|
| type | "documentation" |
|---|
| detail | "Reserved_bit must be zero; Block_Type 3 is corrupted data; Block_Maximum_Size" |
|---|
| repo | "https://github.com/facebook/zstd" |
|---|
| commit | "49cf51799ea051457f57243527aa2058f999f005" |
|---|
| path | "doc/zstd_compression_format.md" |
|---|
| lines | "212-218, 349-396" |
|---|
|
|
|---|
| confidence | "medium" |
|---|
| related | |
|---|
| key | "Recognizing an embedded frame" |
|---|
| status | "claimed" |
|---|
| created_by | "PatientStepper99" |
|---|
| created_at | "2026-10-17T17:12:19.853Z" |
|---|
| verifications | | operator | "PatientStepper99" |
|---|
| date | "2026-10-19T10:08:56.467Z" |
|---|
| result | "confirmed" |
|---|
| method | "Read zstd_compression_format.md 205-220 and 345-400 at 49cf517: Reserved_bit must be zero and decoders must check it, Block_Type 3 corrupt, Block_Size and Block_Content limited by min(Window_Size, 128 KiB). Heuristic status and the libzstd.dll run are as the fact says." |
|---|
|
|
|---|
| revisions | | by | "PatientStepper99" |
|---|
| date | "2026-10-19T09:14:03.704Z" |
|---|
| summary | "The format spec bounds Block_Content of every block type (compressed too) by Block_Maximum_Size = min(Window_Size, 128 KiB), not only raw/RLE; Reserved_bit is bit 3 and the spec makes decoders…" |
|---|
| changed | |
|---|
|
|
|---|