150,000+ tweets / day
Twitter / X Scraping
Distributed Twitter/X scraping for AI sentiment analysis and public-conversation monitoring.
A real-time pulse on public conversation.
How it works
Source
Twitter / X
Crawl
Selenium
Queue
RabbitMQ
Store
Elasticsearch
Analyze
Sentiment AI
Problem
Client needed real-time monitoring of public conversations.
Solution
A distributed Twitter crawler with a queue system.
Tech stack
- Python
- Selenium
- RabbitMQ
- Elasticsearch