Client workUp to ~5K videos & ~500K comments / day
YouTube Scraping
Data Engineer
YouTube video and comment intelligence with automatic transcription.
Searchable video insights, transcripts included.
How it works
Source
YouTube API
Crawl
Python
Queue
RabbitMQ
Transcribe
Speech-to-Text
Store
Elasticsearch
Problem
Needed large-scale analysis of videos and comments.
Solution
Video & comment crawling pipeline + automated transcript analysis.
Tech stack
- Python
- Elasticsearch
- RabbitMQ
- YouTube API