Smart Video Analysis
Event-processing microservices for video analysis events over Kafka and PostgreSQL, deployed with Docker, Terraform and GitHub Actions.
- Status
- paused
- When
- 2025
- Stack
- kafkapostgresqldockerterraformgithub actions
- Code
- not public yet
What it does
Takes a stream of events emitted by a video-analysis pipeline, processes them through a small set of Kafka consumers, and stores the results in PostgreSQL for querying.
Why I built it
To practise the full loop I only saw parts of at work: infrastructure as code, a CI/CD pipeline that tests and deploys on every push, dashboards for the running system. Nothing about it is novel; the point was owning every layer.
How it works
Producers publish analysis events to Kafka. Consumer services, one per concern, write to PostgreSQL. Terraform provisions the containers and networking; GitHub Actions runs tests and redeploys. In a local benchmark the consumers kept up with roughly a thousand events per second, which was enough to find the first real bottleneck (batching writes).
Status and what’s next
Paused. The code is not public yet; I want to strip the credentials handling and add the benchmark script before it is.