Data Engineer (Scala) : Manager / Consultant

We are looking for a Data Engineering Manager/Consultant with deep expertise in PySpark, Scala, and Apache Spark. The role involves defining data architecture, guiding engineering teams, and ensuring scalable, high-performance ETL/ELT solutions.

Responsibilities

• Define data engineering architecture and standards
• Lead design of scalable ETL/ELT pipelines
• Guide teams on Spark optimization and best practices
• Review solutions for performance and scalability
• Ensure data quality, governance, and delivery excellence

Required Skills

PySpark, Scala, Apache Spark, SQL, ETL/ELT, Data Architecture

Good to Have

AWS/Azure, Airflow, Kafka, Data Governance, Parquet