Senior Kafka Engineer

Job Title: Kafka Engineer

Experience: 5+ yrs

Location: Hyderabad/Bengaluru

Shift Timings : (WFO-24*7 Shift)

Job Summary: We are looking for a skilled Confluent Kafka Support Engineer responsible for providing technical support, troubleshooting, and expert guidance for customers using Apache Kafka and the Confluent Platform. The role involves resolving production issues, optimizing system performance, and ensuring the reliability of distributed streaming platforms.

Roles & Responsibilities

• Customer Support & Issue Resolution
• Provide L2/L3 technical support for Kafka-based systems.
• Troubleshoot cluster, broker, producer, and consumer issues.
• Diagnose and resolve performance bottlenecks, latency issues, and data inconsistencies.
• Handle incidents and ensure SLA adherence.
• Kafka & Confluent Platform Expertise
• Support and maintain:
• Apache Kafka clusters
• Confluent Platform components (Schema Registry, Kafka Connect, ksqlDB, Control Center)
• Assist customers with:
• Topic configurations
• Partitioning strategies
• Replication and fault tolerance
• Debugging & Root Cause Analysis
• Conduct deep-dive investigations into system failures.
• Use logs, metrics, and traces to identify root causes.
• Provide postmortem reports and preventive recommendations.
• Automation & Process Improvement
• Automate operational tasks using Python, Shell scripts, Ansible, and Terraform.
• Develop runbooks, SOPs, and knowledge articles.
• Continuously improve support processes and efficiency.

Required Skills

• 3-5 years of experience working with Apache Kafka and Confluent Kafka.
• Strong knowledge of Kafka internals (brokers, zookeepers, partitions, replication, offsets).
• Experience with Kafka Connect, Schema Registry, REST Proxy, and Kafka security.
• Hands-on experience with AWS (EC2, IAM, CloudWatch, S3, Lambda, VPC, Load balancers).
• Proficiency in scripting and automation using Terraform, Ansible, or similar tools.
• Familiarity with DevOps practices and tools (CI/CD pipelines, monitoring tools like Prometheus/Grafana, Splunk, Datadog, etc).
• Experience with containerization (Docker, Kubernetes) is a plus.

Nice to Have

• Confluent Certified Developer or Administrator.
• AWS Certified
• CICD (AWS CodePipeline, Harness)
• Containers (Docker, Kubernetes)

Educational Qualification

BE/Btech Any Graduate