Deployment Engineer

Job Description

Senior Data Engineer – Azure Databricks & GenAI

\n

\nExperience: 10+ Years | Location: Remote / India | Contract Duration: 6 Months

\nWe are looking for a Senior Data Engineer with strong hands-on experience in Azure Databricks, PySpark, Python, and SQL to build and optimize enterprise-scale data pipelines.

\n

\nKey Skills

\n\n • Azure Databricks, PySpark, Python, SQL

\n • Azure Data Factory (ADF), ADLS Gen2, Synapse, Event Hubs

\n • Delta Lake, Lakehouse/Medallion Architecture, ETL/ELT

\n • Real-time/streaming data pipelines and performance optimization

\n • GenAI/LLM frameworks such as LangChain, LangGraph, AutoGen, or LlamaIndex

\n • Experience with automated RCA, data augmentation, anomaly detection, or intelligent remediation

\n • CI/CD, Azure DevOps, monitoring, and production support

\n\n

\nMust Have: 10+ years of Data Engineering experience with strong Azure Databricks and GenAI/LLM integration experience.