Datasets

Here is a non-exhaustive list of openly accessible datasets released along with some of our publications.

PublicationLink#PostsTimeline
Mean Birds: Detecting Aggression and Bullying on Twitter (ACM WebSci’17) PDFZenodo1.65M tweetsJune - August, 2016
Kek, Cucks, and God Emperor Trump: A Measurement Study of 4chan’s Politically Incorrect Forum and Its Effects on the Web (ICWSM’17) PDFZenodo11.1M 4chan /pol/, /sp/, and /int/ postsJune 30, 2016 - September 12, 2016
The Web Centipede: Understanding How Web Communities Influence Each Other Through the Lens of Mainstream and Alternative News Sources (IMC’17) PDFZenodo487k tweets, 1.8M Reddit posts/comments, 97k 4chan /pol/, /sp/, /int/, and /sci/ postsTwitter: June 30, 2016 - February 28, 2017, Reddit: June 30, 2016 - February 28, 2017, 4chan: June 30, 2016 - February 28, 2017
What is Gab? A Bastion of Free Speech or an Alt-Right Echo Chamber? (CyberSafety’18) PDFZenodo22.1M Gab posts from 336.7K usersAugust 2016 - January 2018
Large Scale Crowdsourcing and Characterization of Twitter Abusive Behavior (ICWSM’18) PDFZenodo, GitHub100K labeled tweet textN/A
On the Origins of Memes by Means of Fringe Web Communities (IMC’18) PDFZenodo158.5M URLs and Phashes for images from Twitter, Reddit, 4chan’s /pol/, and GabJuly 2016 - July 2017
Who Let The Trolls Out? Towards Understanding State-Sponsored Trolls (ACM WebSci’19) PDFZenodo10.1M tweets and 21K subreddit postsFebruary 2012 - August 2018
The Pushshift Telegram Dataset (ICWSM’20) PDFZenodo2.2M Telegram users, 28K Telegram channels, and 317M Telegram messagesSeptember 2015 - November 2019
The Pushshift Reddit Dataset (ICWSM’20) PDFPushshiftReddit subreddits posts and usersFull history
Disturbed YouTube for Kids: Characterizing and Detecting Disturbing Content on YouTube (ICWSM’20) [PDF]Zenodo844.7K YouTube videos’ metadataN/A
Raiders of the Lost Kek: 3.5 Years of Augmented 4chan Posts from the Politically Incorrect Board (ICWSM’20) [PDF]Zenodo134.5M 4chan /pol/ postsJune 29, 2016 - November 1, 2019
A Large Open Dataset from the Parler Social Network (ICWSM’21) [PDF]Zenodo183M Parler postsAugust 1, 2018 - November 1, 2021
The Evolution of the Manosphere Across the Web (ICWSM’21) [PDF]Zenodo6.7M posts from Incel Forums and 22.1M posts from Incel subredditsIncel Forums: June 19-30, 2019. Subreddits: June 2005 - December 2018