GCP Data Engineer Pyspark/Scala

We are looking for a highly skilled GCP Data Engineer with 5+ years of experience in designing and building scalable data solutions on Google Cloud Platform. The ideal candidate will have strong expertise in BigQuery, Python, and modern data engineering practices, with a focus on performance, reliability, and cost optimization.

Key Responsibilities

Design, develop, and maintain scalable and robust data pipelines on GCPBuild and optimize data warehouses using BigQuery (partitioning, clustering, query tuning)Develop ETL/ELT pipelines using Python and GCP-native toolsIntegrate data from multiple sources including APIs, databases, and streaming platformsEnsure high performance and cost efficiency of data processing systemsCollaborate with data analysts, data scientists, and business stakeholdersImplement data quality checks, governance, and security standardsMonitor, debug, and optimize data workflows and pipelinesSupport batch and real-time data processing requirements

Required Skills

5+ years of hands-on experience in Data EngineeringStrong experience with Google Cloud Platform (GCP)Expertise in BigQuery (data modeling, performance tuning)Strong programming skills in Python (Pandas; PySpark is a plus)Experience with Cloud Composer / Apache AirflowKnowledge of Cloud Storage, Pub/Sub, DataflowAdvanced SQL and strong data warehousing conceptsExperience building scalable ETL/ELT pipelines

Preferred Skills

Experience with Apache Spark / DatabricksFamiliarity with CI/CD pipelines and DevOps practicesKnowledge of data visualization tools like Tableau / LookerExperience with streaming data processingExposure to data lake / lakehouse architectures

Educational Qualification

Bachelors or Masters degree in Computer Science, IT, or related field

Good to Have

GCP Certification (e.g., Professional Data Engineer)Experience working in Agile/Scrum environments

Skills: spark,python,scala,gcp .