Data Engineer( Data bricks)

Job Description

We are seeking a skilled Data Engineer to design, build, and maintain scalable data solutions on the Azure platform. The ideal candidate will play a key role in developing robust data pipelines, ensuring data quality, and contributing to enterprise-wide analytics initiatives.

Key Responsibilities

Design and develop scalable data pipelines using Spark SQL and PySpark on Azure Databricks

Build and orchestrate ETL workflows using Azure Data Factory (ADF)

Develop and maintain a modern Lakehouse architecture leveraging ADLS and Databricks

Perform data preparation tasks including data cleaning, normalization, deduplication, and data type transformations

Collaborate with DevOps teams to deploy and manage solutions in production environments

Monitor data pipelines, identify issues, and implement corrective actions, including root cause analysis and resolution

Actively contribute as part of the global Analytics team, delivering data-driven insights and solutions

Collaborate with Data Science and Business Intelligence teams to share best practices and drive innovation

Lead data engineering projects and support cross-functional initiatives led by other team members

Apply change management practices, including documentation, communication, and training, to support system upgrades and data migrations

Must-Have Skills

Strong experience with Azure ecosystem (Azure Databricks, Azure Data Factory, ADLS)

Proficiency in PySpark and Spark SQL

Solid understanding of ETL processes and data pipeline development

Advanced SQL skills .