Commit 82f8898
committed
Add configurable input buffer size for decompression (--ibuf-size)
This feature addresses performance issues when decompressing large files
on mechanical hard drives with excessive disk seek operations.
Changes:
- Add 'inputBufferSize' field to FIO_prefs_t in fileio_types.h
- Implement FIO_setInputBufferSize() setter function
- Use configured buffer size in FIO_createDResources()
- Add --ibuf-size command-line option with help text
The option allows users to specify input buffer size (default: 0 for
automatic). For large files on slow drives, using --ibuf-size=1024M
to --ibuf-size=5120M can significantly improve throughput by reducing
disk seek operations.
Backward compatible: defaults to ZSTD_DStreamInSize when not specified.1 parent 92505de commit 82f8898
4 files changed
+13
-1
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
573 | 573 | | |
574 | 574 | | |
575 | 575 | | |
| 576 | + | |
576 | 577 | | |
577 | 578 | | |
578 | 579 | | |
| |||
682 | 683 | | |
683 | 684 | | |
684 | 685 | | |
| 686 | + | |
| 687 | + | |
| 688 | + | |
| 689 | + | |
685 | 690 | | |
686 | 691 | | |
687 | 692 | | |
| |||
2611 | 2616 | | |
2612 | 2617 | | |
2613 | 2618 | | |
2614 | | - | |
| 2619 | + | |
| 2620 | + | |
2615 | 2621 | | |
2616 | 2622 | | |
2617 | 2623 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
87 | 87 | | |
88 | 88 | | |
89 | 89 | | |
| 90 | + | |
90 | 91 | | |
91 | 92 | | |
92 | 93 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
59 | 59 | | |
60 | 60 | | |
61 | 61 | | |
| 62 | + | |
62 | 63 | | |
63 | 64 | | |
64 | 65 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
245 | 245 | | |
246 | 246 | | |
247 | 247 | | |
| 248 | + | |
248 | 249 | | |
249 | 250 | | |
250 | 251 | | |
| |||
912 | 913 | | |
913 | 914 | | |
914 | 915 | | |
| 916 | + | |
915 | 917 | | |
916 | 918 | | |
917 | 919 | | |
| |||
1096 | 1098 | | |
1097 | 1099 | | |
1098 | 1100 | | |
| 1101 | + | |
1099 | 1102 | | |
1100 | 1103 | | |
1101 | 1104 | | |
| |||
1615 | 1618 | | |
1616 | 1619 | | |
1617 | 1620 | | |
| 1621 | + | |
1618 | 1622 | | |
1619 | 1623 | | |
1620 | 1624 | | |
| |||
0 commit comments