Professional project
Secure data streaming
A team-built streaming platform with a Redis/Valkey buffer for client backpressure and retries.
Bluestaq · Co-built with two other engineers; owned the availability buffer
- Quarkus
- gRPC
- Kafka
- Redis/Valkey
Problem
Streaming clients need a buffer that handles backpressure and temporary failures.
My contribution
- Co-built the streaming platform as part of a three-engineer team.
- Owned its Redis/Valkey availability buffer, including client backpressure and fault-tolerant retries.
How it works
Workflow diagram
Consume records
Receive records through the streaming platform.
Buffer availability
Use the Redis/Valkey buffer to handle client backpressure.
Deliver and retry
Serve streaming clients with fault-tolerant retry behavior.
Engineering decisions
Explicit buffer ownership
My contribution centers on availability buffering. The wider platform was a shared engineering effort.
Result and limits
The team-built platform sustains about 13,000 JSON records per second.
- The throughput describes the team-built platform, not an individual productivity measure.
- Employer source and production data remain private.