| Name | DL | Torrents | Total Size |
reddit (79925 files)
 subreddits24/0ju1_comments.zst |
3.31kB |
| subreddits24/0ju1_submissions.zst |
16.69MB |
| subreddits24/0ka1_comments.zst |
0.79kB |
| subreddits24/0ka1_submissions.zst |
13.53MB |
| subreddits24/0sanitymemes_comments.zst |
32.53MB |
| subreddits24/0sanitymemes_submissions.zst |
11.68MB |
| subreddits24/0ti1_comments.zst |
0.89kB |
| subreddits24/0ti1_submissions.zst |
19.18MB |
| subreddits24/0ue5_comments.zst |
1.49kB |
| subreddits24/0ue5_submissions.zst |
15.25MB |
| subreddits24/0x10c_comments.zst |
4.33MB |
| subreddits24/0x10c_submissions.zst |
582.67kB |
| subreddits24/0x3642_comments.zst |
164.75kB |
| subreddits24/0x3642_submissions.zst |
18.46MB |
| subreddits24/0xPolygon_comments.zst |
16.81MB |
| subreddits24/0xPolygon_submissions.zst |
6.88MB |
| subreddits24/0xProject_comments.zst |
2.83MB |
| subreddits24/0xProject_submissions.zst |
1.61MB |
| subreddits24/0yb6_comments.zst |
4.05kB |
| subreddits24/0yb6_submissions.zst |
16.17MB |
| subreddits24/1liga_comments.zst |
0.51kB |
| subreddits24/1liga_submissions.zst |
10.62MB |
| subreddits24/1morewow_comments.zst |
4.67MB |
| subreddits24/1morewow_submissions.zst |
1.23MB |
| subreddits24/1nccestNL_comments.zst |
683.39kB |
| subreddits24/1nccestNL_submissions.zst |
9.49MB |
| subreddits24/1Password_comments.zst |
17.72MB |
| subreddits24/1Password_submissions.zst |
4.23MB |
| subreddits24/1P_LSD_comments.zst |
12.93MB |
| subreddits24/1P_LSD_submissions.zst |
3.32MB |
| subreddits24/1techno_org_comments.zst |
6.99kB |
| subreddits24/1techno_org_submissions.zst |
2.50MB |
| subreddits24/1to1reps_comments.zst |
1.94MB |
| subreddits24/1to1reps_submissions.zst |
13.70MB |
| subreddits24/1_zlkf_comments.zst |
12.66kB |
| subreddits24/1_zlkf_submissions.zst |
15.92MB |
| subreddits24/2ALiberals_comments.zst |
59.28MB |
| subreddits24/2ALiberals_submissions.zst |
10.28MB |
| subreddits24/2american4you_comments.zst |
132.49MB |
| subreddits24/2american4you_submissions.zst |
14.78MB |
| subreddits24/2anatolia4you_comments.zst |
16.58MB |
| subreddits24/2anatolia4you_submissions.zst |
2.75MB |
| subreddits24/2Asia4u_comments.zst |
55.78MB |
| subreddits24/2Asia4u_submissions.zst |
12.68MB |
| subreddits24/2asians4u_irl_comments.zst |
7.77MB |
| subreddits24/2asians4u_irl_submissions.zst |
1.65MB |
| subreddits24/2aspirineveryday_comments.zst |
1.29kB |
| subreddits24/2aspirineveryday_submissions.zst |
1.39MB |
| subreddits24/2b2t_comments.zst |
69.43MB |
|
|
|
Type: Dataset
Tags: reddit
Bibtex:
Tags: reddit
Bibtex:
@article{,
title= {Subreddit comments/submissions 2005-06 to 2024-12},
journal= {},
author= {Watchful1},
year= {},
url= {https://www.reddit.com/r/pushshift/comments/1itme1k/separate_dump_files_for_the_top_40k_subreddits/?},
abstract= {This is the top 40,000 subreddits from reddit's history in separate files. You can use your torrent client to only download the subreddit's you're interested in.
These are from the pushshift dumps from 2005-06 to 2024-12 which can be found here https://academictorrents.com/details/ba051999301b109eab37d16f027b3f49ade2de13
These are zstandard compressed ndjson files. Example python scripts for parsing the data can be found here https://github.com/Watchful1/PushshiftDumps
If you have questions, please reply to this reddit post or DM u/Watchful on reddit or respond to this post https://www.reddit.com/r/pushshift/comments/1akrhg3/separate_dump_files_for_the_top_40k_subreddits/},
keywords= {reddit},
terms= {},
license= {},
superseded= {}
}
