Lead Data Engineer – GCP | Dataflow | Java | BigQuery

Job Title : Lead Data Engineer – GCP | Dataflow | Java | BigQuery

Experience: 7+ Years

Location: Chennai / Bangalore / Coimbatore

Work Mode: Hybrid

Contract: Long Term

We are looking for a highly skilled Lead Data Engineer with strong hands-on expertise in GCP, Apache Beam/Dataflow, Java, and BigQuery. The ideal candidate will be responsible for designing, developing, and optimizing scalable batch and real-time data pipelines for enterprise applications.

Key Responsibilities

• Design and develop scalable ETL/ELT pipelines using GCP services
• Build and maintain batch & real-time data processing pipelines using Dataflow and Apache Beam
• Develop robust backend processing solutions using Java
• Work extensively with BigQuery for data warehousing, analytics, and performance optimization
• Integrate data from APIs, databases, and streaming platforms
• Optimize pipelines for performance, cost, scalability, and reliability
• Collaborate with Architects, Analysts, DevOps teams, and Business stakeholders
• Ensure data quality, governance, monitoring, and security best practices
• Troubleshoot production issues and implement scalable long-term solutions

Must-Have Skills

GCP

Google Dataflow / Apache Beam

Java

BigQuery

Batch & Streaming Data Pipelines

SQL

Data Modeling

CI/CD

Git

Agile Methodologies

Strong Problem-Solving & Debugging Skills