Twitter GraphQL API Scraper

Twitter GraphQL API Scraper

URL
Caption
Reverse engineered Twitter’s internal GraphQL API to scrape profile data
notion image
The data scraping used by this project ^ is slowed down by Twitter’s API limits, and I wanted to build out a faster way to generate these beautiful social network graphs. By analyzing the network requests a Twitter webpage makes when loading data, I built out a scraper that collects data from Twitter’s private GraphQL API. My scraper outperformed existing scrapers as it bypassed the public API’s limitations.