Data engineer (for an insurance tech client)

Immediate Joiner

Job Title: Data Engineer

Location: Noida, Film City Sector 16 A

Experience: 3.5-7 years

Budget: Upto 40 LPA

Role: We are looking for a highly skilled Data Engineer to design, build, and operate scalable enterprise data platforms on Azure. The ideal candidate will have strong expertise in Databricks, Spark/Py Spark, Azure Data Factory, ADLS Gen2, Python, SQL, and modern lakehouse architecture, enabling reliable, high-quality data solutions that power analytics, AI, and business decision-making across the organization.

Key Responsibilities

Data Platform Engineering

Design and develop scalable data pipelines using Azure Data Factory, Databricks, and Spark/Py Spark

Build and maintain enterprise-grade lakehouse solutions using Delta Lake and Medallion Architecture (Bronze, Silver, Gold)

Data Integration & Transformation

Develop ingestion, transformation, validation, and publishing frameworks for structured and semi-structured data

Implement efficient ETL/ELT processes using Python and SQL

Data Modeling & Architecture

Design conceptual, logical, and physical data models for lakehouse, warehouse, and analytics platforms

Translate business requirements into scalable and performant data structures

Data Quality & Governance

Implement data quality checks, validation, reconciliation, and monitoring processes

Support metadata management, lineage, governance, and security best practices

Performance & Optimization

Optimize Spark workloads, partitioning strategies, Delta tables, and pipeline performance

Ensure scalability, reliability, and operational excellence of data platforms

Dev Ops & Operations

Support CI/CD, environment promotion, monitoring, logging, and production operations

Collaborate with engineering and analytics teams to deliver robust data solutions

Required Experience

5–7 years of experience in Data Engineering, Data Warehousing, or Data Platform Engineering IN INSURANCE domain.

Insurance knowledge is must.

Strong hands-on experience with

Azure Cloud

Azure Data Factory (ADF)

ADLS Gen2

Databricks (Unity Catalog)

Apache Spark / Py Spark

Python

SQL

Delta Lake and Lakehouse Architecture

Experience designing enterprise data models and data transformation solutions

Strong understanding of data quality, validation, reconciliation, and operational support

Experience with Git and CI/CD practices

Preferred Experience

Apache Airflow or similar orchestration tools

Kafka and streaming data pipelines

Docker and Kubernetes

Azure Synapse Analytics

Microsoft Fabric

Data lineage, observability, and governance tools

Terraform or Infrastructure-as-Code

Python API development

Why this role stands out

Opportunity to build and scale a modern Azure lakehouse platform

Direct impact on enterprise analytics, AI, and digital transformation initiatives

Exposure to cutting-edge cloud, data engineering, and platform technologies

Work on complex, high-volume data challenges in a fast-growing P&C insurance environment