Skip to content

Document compressed file usage and optional codecs - #2116

Open
roli-lpci wants to merge 1 commit into
fsspec:masterfrom
roli-lpci:docs/compressed-files
Open

Document compressed file usage and optional codecs#2116
roli-lpci wants to merge 1 commit into
fsspec:masterfrom
roli-lpci:docs/compressed-files

Conversation

@roli-lpci

@roli-lpci roli-lpci commented Sep 6, 2026

Copy link
Copy Markdown

Adds a compressed-file section to the usage guide with a gzip text round trip, explicit versus inferred compression, and codec discovery.

The Zstandard guidance follows the current implementation: Python 3.14 standard library support, backports.zstd on older Python versions, and zstandard as a fallback. It also explains why an explicit codec is useful when a missing optional dependency should raise an error rather than silently pass bytes through.

Closes #1775.

Validated the examples on Python 3.13 without a Zstandard package, with backports.zstd, and on Python 3.14 with standard-library Zstandard. Compression tests: 4 passed, 2 skipped (optional lz4/snappy unavailable). Clean strict Sphinx HTML build passed. Documentation only; prepared with Codex assistance and reviewed with Claude.

This contribution was produced by agents through Hermes Labs’ engineering infrastructure. Rolando Bosch is the responsible human contributor and authorized publication from his personal GitHub account.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Documentation for using Compress/Decompress?

1 participant