Design, implement, configure, and manage Apache Kafka environments.
•
Support real-time data streaming and event-driven applications.
•
Configure and manage Kafka topics, partitions, replication, consumer groups, producers, and consumers.
•
Monitor Kafka cluster performance, availability, capacity, and overall platform health.
•
Troubleshoot and resolve production issues related to Kafka, messaging, connectivity, and performance.
•
Deploy and manage Kafka-related applications and services on Kubernetes.
•
Collaborate with development, infrastructure, DevOps, and application teams to onboard and support applications using Kafka.
•
Implement high availability, scalability, security, and disaster recovery practices.
•
Automate platform deployment, configuration, monitoring, and operational processes.
•
Participate in architecture discussions and recommend improvements to the real-time streaming platform.
•
Provide technical guidance and support to junior engineers and other technology teams.
Requirements
Key Requirements
•
Minimum 10 years of overall IT experience.
•
At least 2 to 3 years of strong hands-on experience with Apache Kafka.
•
Strong practical experience with Kubernetes.
•
Bachelor’s degree in Computer Science or a similar relevant educational background is required.
•
Experience supporting real-time or event-driven applications in a production environment.
•
Good understanding of Kafka architecture, including brokers, topics and partitions, replication, consumer groups, producers and consumers, high availability, and fault tolerance.
•
Experience with monitoring and troubleshooting distributed systems.
•
Familiarity with Linux and scripting or automation.
•
Experience with CI/CD, Docker, and DevOps practices is advantageous.
•
Knowledge of cloud platforms such as AWS, Azure, or GCP is an advantage.