Skip to content

[Refactor] Refactor the modelscope download module #1683

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
wangxingjun778 merged 14 commits into from
Apr 21, 2026
Merged

[Refactor] Refactor the modelscope download module #1683

Changes from 1 commit
Commits
Show all changes
14 commits
Select commit Hold shift + click to select a range
a632006
bump version
wangxingjun778 Apr 14, 2026
e294366
ok Merge branch 'master' of github.com:modelscope/modelscope into rel…
wangxingjun778 Apr 14, 2026
454a180
fix docker pip version
wangxingjun778 Apr 14, 2026
195feeb
remove pynini for stable image
wangxingjun778 Apr 14, 2026
4a54747
update release time
wangxingjun778 Apr 20, 2026
0d74560
ok Merge branch 'master' of github.com:modelscope/modelscope into rel…
wangxingjun778 Apr 20, 2026
6672149
update docker-image.yaml for node24
wangxingjun778 Apr 20, 2026
dfae2f4
merge release/1.36
wangxingjun778 Apr 20, 2026
d7a1590
remove unused dockerfile
wangxingjun778 Apr 20, 2026
38acc9f
improve fetch file list for large-scale datasets
wangxingjun778 Apr 21, 2026
4581a80
add fault tolerant for file downloading
wangxingjun778 Apr 21, 2026
6d3d269
add producer-consumer pipeline for downloading files
wangxingjun778 Apr 21, 2026
3ca72c5
add FileDownloadError for download single file
wangxingjun778 Apr 21, 2026
1773564
set DEFAULT_DATASET_PAGE_SIZE 200
wangxingjun778 Apr 21, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
ok Merge branch 'master' of github.com:modelscope/modelscope into rel… 
…ease/1.36
  • Loading branch information
@wangxingjun778
wangxingjun778 committed Apr 14, 2026
commit e294366efedd95800f079d0ac42b38daf6799ce4

This merge commit was added into this branch cleanly.

There are no new changes to show, but you can still view the diff.