Distributed SystemsPlanned
Stream Processing Engine
100k events/s stream processor with Kafka, windowing and TimescaleDB
The Backend Systems capstone — a stream processing engine consuming 100k events/second from Kafka, applying tumbling and sliding window aggregations, storing results in TimescaleDB, and exposing the full pipeline through OpenTelemetry instrumentation.
What it demonstrates
- Windowed aggregations
- Exactly-once semantics
- Back-pressure
- OpenTelemetry
Tech stack
GoKafkaTimescaleDBRedisOpenTelemetry