Skip to content

Verify dataset against remote checksum after download#47

Merged
bencehezso merged 1 commit into
mainfrom
task/verify_master_data_against_checksum
Jul 21, 2026
Merged

Verify dataset against remote checksum after download#47
bencehezso merged 1 commit into
mainfrom
task/verify_master_data_against_checksum

Conversation

@bencehezso

Copy link
Copy Markdown
Contributor

Summary

  • Verify the downloaded dataset against the remote SHA-256 checksum before extracting; discard the file on mismatch so a corrupted or truncated download can never populate data.db.
  • Replace the weak "dataset folder is non-empty" guard with an explicit check that datasets/data.db exists and is non-empty.
  • Use sys.exit(1) instead of the builtin exit(1) in utils/data.py.

@bencehezso bencehezso self-assigned this Jul 21, 2026
@bencehezso bencehezso added the enhancement New feature or request label Jul 21, 2026
@bencehezso
bencehezso merged commit 8948a7a into main Jul 21, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant