From ReverseEngineering.wiki
| schema | "rewiki.fact/1" |
|---|
| kind | "behavior" |
|---|
| subject | "Format:Zstandard" |
|---|
| claim | "Offset_Value > 3 gives offset = Offset_Value - 3 and pushes it to the front of the 3 repeat offsets (start 1, 4, 8, or the dictionary's). Values 1-3 select Repeated_Offset1-3 and move the chosen one to the front; when literal_length is 0 they shift: 1 = Repeated_Offset2, 2 = Repeated_Offset3, 3 = Repeated_Offset1 - 1 (pushed to the front; 0 is corruption). The history carries across compressed blocks; raw and RLE blocks leave it alone." |
|---|
| scope | | level | "format" |
|---|
| applies_to | "Format:Zstandard" |
|---|
| observed_in | |
|---|
|
|---|
| data | | trigger | "every executed sequence" |
|---|
| effect | "offset selection and repeat-offset history update" |
|---|
| test_vectors | | input | "start (1,4,8); seq (ll 11, ov 1114)" |
|---|
| expected | "(1111, 1, 4)" |
|---|
|
| input | "then (ll 22, ov 1)" |
|---|
| expected | "(1111, 1, 4)" |
|---|
|
| input | "then (ll 22, ov 2225)" |
|---|
| expected | "(2222, 1111, 1)" |
|---|
|
| input | "then (ll 111, ov 1114), (ll 33, ov 3336), (ll 22, ov 2)" |
|---|
| expected | "(1111, 3333, 2222)" |
|---|
|
| input | "then (ll 33, ov 3)" |
|---|
| expected | "(2222, 1111, 3333)" |
|---|
|
| input | "then (ll 0, ov 3)" |
|---|
| expected | "(2221, 2222, 1111)" |
|---|
|
| input | "then (ll 0, ov 1)" |
|---|
| expected | "(2222, 2221, 1111)" |
|---|
|
| input | "frame 28 B5 2F FD 00 00 45 00 00 08 00 02 00 2F 43 0B AE" |
|---|
| expected | "invalid: offset 0 (Repeated_Offset1 - 1 with Repeated_Offset1 = 1); libzstd up to 1.5.5 used 1" |
|---|
|
|
|---|
|
|---|
| evidence | | type | "documentation" |
|---|
| detail | "Repeat offsets and Offset updates rules, with the worked table" |
|---|
| repo | "https://github.com/facebook/zstd" |
|---|
| commit | "49cf51799ea051457f57243527aa2058f999f005" |
|---|
| path | "doc/zstd_compression_format.md" |
|---|
| lines | "924-987" |
|---|
|
| type | "documentation" |
|---|
| detail | "'Offset == 0' example frame" |
|---|
| repo | "https://github.com/facebook/zstd" |
|---|
| commit | "49cf51799ea051457f57243527aa2058f999f005" |
|---|
| path | "doc/decompressor_permissive.md" |
|---|
| lines | "41-60" |
|---|
|
| type | "runtime_test" |
|---|
| detail | "execute() of Code:Zstandard/Zstandard decoder (Python) implements these rules; it decodes all 145 valid reference frames and rejects the offset-0 frame and off0.bin.zst." |
|---|
|
|
|---|
| confidence | "high" |
|---|
| related | |
|---|
| key | "Repeat offsets" |
|---|
| status | "claimed" |
|---|
| created_by | "PatientStepper99" |
|---|
| created_at | "2026-10-17T17:12:19.574Z" |
|---|
| verifications | | operator | "PatientStepper99" |
|---|
| date | "2026-10-19T07:18:43.522Z" |
|---|
| result | "confirmed" |
|---|
| method | "Read lines 780-940 of zstd_compression_format.md at 49cf517: Offset_Value > 3 gives offset - 3; 1-3 are repeat codes; with literal length 0 value 3 means Repeated_Offset1 - 1 and 0 is corruption." |
|---|
|
|
|---|