Senior DevOps Engineer (Apache Kafka & Apache NiFi)

Role Description

We are seeking a Senior DevOps Engineer with strong expertise in Apache Kafka and Apache NiFi to design, deploy, optimize, and support enterprise-scale data streaming and ingestion platforms. The role involves managing highly available data infrastructure, implementing automation and CI/CD practices, supporting cloud-native deployments, and ensuring platform reliability, scalability, security, and performance across AWS or Azure environments.

Key Responsibilities

• Design, deploy, administer, and optimize Apache Kafka clusters for high-throughput and low-latency data streaming workloads.
• Build, manage, and enhance Apache NiFi data flows to support scalable and reliable data ingestion and processing.
• Monitor, troubleshoot, and resolve production issues related to Kafka brokers, consumer lag, replication, cluster performance, and NiFi data flows.
• Implement and support CI/CD pipelines for application and infrastructure deployments.
• Deploy and operate data platform components in AWS or Azure cloud environments.
• Automate operational processes, platform provisioning, deployment, and maintenance activities.
• Ensure high availability, disaster recovery readiness, security, and operational excellence across data platforms.
• Collaborate with engineering and platform teams to improve scalability, reliability, and performance.
• Perform capacity planning, platform upgrades, monitoring, and incident resolution.
• Mentor team members and promote best practices for enterprise data platform operations.

Required Skills

Proficient

• Kafka
• Nifi
• Apigee
• Redis
• AWS or Azure
• CICD

Experience

• 5 to 6 years of overall DevOps or Platform Engineering experience.
• Minimum 3 years of hands-on production experience with Apache Kafka.
• Minimum 3 years of hands-on production experience with Apache NiFi.

Why Join UST

• Work on large-scale digital transformation and data platform initiatives.
• Collaborate with global technology teams delivering innovative enterprise solutions.
• Gain exposure to modern cloud, automation, and platform engineering practices.
• Access continuous learning opportunities, professional growth, and career advancement within a technology-driven organization.

Skills

Kafka/ Nifi/ Apigee/ Redis, AWS/ Azure, CICD