CASE STUDY / KAFKA AND CELERY CORE INFRASTRUCTURE
Busigence Technologies · Oct 2022–Feb 2023
Messaging and asynchronous processing infrastructure combining Kafka, Kubernetes, Django, Celery, RabbitMQ, and Redis.
01 / OVERVIEW
Project overview.
Professional work at Busigence Technologies, October 2022–February 2023. I deployed messaging infrastructure, built producer and consumer workloads, and integrated background task processing with a Django application.
02 / ARCHITECTURE
How it works.
Kafka was deployed with Strimzi and Helm on Kubernetes. Producer and consumer workloads handled the event flow. Django integrated with Celery for asynchronous processing, alongside RabbitMQ and Redis. Flower supported monitoring and investigation of task execution failures.
03 / FEATURES
What it does.
- Deployed Kafka using Strimzi and Helm.
- Built producer and consumer workloads.
- Integrated Django and Celery for asynchronous processing.
- Connected RabbitMQ and Redis.
- Used Flower to monitor task execution and troubleshoot failures.
04 / LESSONS & LIMITATIONS
Learning through building.
This is a summary of professional infrastructure work, sourced from my public GitHub profile. Employer source code, deployment configuration, and workload volumes are not public. The technology illustration does not represent an internal topology.