Skip to content

fix(hf): download the shards the safetensors index names - #336

Merged
jason-fxz merged 1 commit into
mainfrom
refactor/hf-download-index-first
Sep 2, 2026
Merged

jason-fxz merged 1 commit into
mainfrom
refactor/hf-download-index-first

Conversation

@jason-fxz

Copy link
Copy Markdown
Collaborator

Take the shard list from model.safetensors.index.json instead of globbing *.safetensors: this lands the index the loaders need (closes #124, supersedes #129) and stops pulling duplicate shards from subdirectories (gpt-oss-120b 130 GB -> 65 GB).

@jason-fxz
jason-fxz merged commit a80b4d3 into main Sep 2, 2026
@jason-fxz
jason-fxz deleted the refactor/hf-download-index-first branch September 2, 2026 02:43
cadocruz pushed a commit to cadocruz/FreeToken that referenced this pull request Sep 2, 2026
Traz 3 commits oficiais novos:
- feat(glm5_next): support GLM-5.3-Flash (FlashML-org#332)
- fix(hf): download the shards the safetensors index names (FlashML-org#336)
- fix(models): detect nvfp4 experts behind a mixed-precision compressed-tensors format (FlashML-org#343)

Sem conflito com o trabalho local do fork (sm_120 Blackwell optimizations,
2e79d96) -- confirmado via 'git merge-tree --write-tree', arquivos
tocados nao se sobrepoem.
jomcgi added a commit to jomcgi/FreeToken that referenced this pull request Sep 4, 2026
…lashML-org#336 hf shard download

Cherry-picked from FlashML-org/FreeToken 092ce4a; FlashML-org#343 is redundant with the
fork's compressed-tensors NVFP4 detection and FlashML-org#319 conflicts with the
kernel backend, both left out. Box tests 408 passed with the known
order-dependent parity failure (FlashML-org#18).

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01A88MCbnLtwsFSHmqwuJezY
trcwebdesign pushed a commit to trcwebdesign/FreeToken that referenced this pull request Sep 21, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

NVFP4 checkpoints fail to load: model.safetensors.index.json is not downloaded, but the NVFP4 bank loader requires it

1 participant