File← All files
FineWeb: large-scale filtered web text for pretraining
English web pages from Common Crawl, filtered and deduplicated to keep higher-quality text. Smaller random samples (10B, 100B and 350B tokens) are provided for experiments that do not need the full corpus.
| Maintainer | Hugging Face |
|---|---|
| License | ODC-By 1.0 (plus Common Crawl terms of use) |
| Format | Parquet |
Official page: huggingface.co/datasets/HuggingFaceFW/fineweb
SolxLab links to the official source and does not re-host this dataset. Follow the license and terms on the official page.
FileParquet shards (sample-10BT subset available)
SizeFull set is many TB; sample-10BT is ~25-30 GB
DatasetsNLP