Walk-in || Azure Data Engineer -Contract To hire

Job Description: Azure Data Engineer -F2F

Role: Azure Data Engineer (Azure Databricks, PySpark, Python, SQL)

Experience: 5-8 years (adjust to the requirement)

Location / Work mode: [To be filled]

Employment type: [Full-time / Contract]

Role Summary

We are looking for an Azure Data Engineer to design, build and maintain scalable data pipelines and lakehouse solutions on Azure. You will work with Azure Databricks, PySpark, Python and SQL to ingest, transform and serve data for analytics and reporting, working closely with architects, analysts and business stakeholders.

Key Responsibilities

Design and develop ETL/ELT pipelines using Azure Databricks and PySpark.

Build and maintain data lake and lakehouse layers (bronze/silver/gold) using Delta Lake.

Ingest data from multiple sources (databases, APIs, files, streaming) into Azure Data Lake Storage.

Write efficient, well-tested Python and SQL code for data transformation and validation.

Optimise Spark jobs for performance and cost (partitioning, caching, cluster sizing, handling data skew).

Orchestrate and schedule pipelines using Azure Data Factory, Databricks Workflows or similar tools.

Implement data quality checks, logging, monitoring and error handling.

Apply security and governance practices (access control, secrets management, data masking).

Use Git-based version control and CI/CD for deployments.

Document data flows and collaborate with cross-functional teams in an Agile setup. .