Sr. Databricks Engineer- Contract (India)

Role: Senior Databricks Engineer

Experience: 5+ years

Work Mode: Remote

Employment Type: Contract

Contract Duration: 6 months+ Extendable Key Responsibilities: Design, develop, and maintain scalable data pipelines on the Databricks Lakehouse Platform.

Implement and administer Unity Catalog for enterprise data governance, access control, lineage, and data sharing.

Support hydrocarbon reporting workflows, including ingestion, transformation, validation, and reconciliation of production and operational data.

Develop ETL/ELT pipelines using Spark, Delta Lake, and Delta Live Tables (Lakeflow experience is a plus).

Optimize Databricks workloads for performance, reliability, and cost efficiency.

Collaborate with business stakeholders to translate reporting requirements into scalable technical solutions.

Implement data quality checks, monitoring, and automated validation frameworks.

Work closely with solution architects and data engineers on platform enhancements and production support.

Document technical designs, governance standards, and operational procedures.

Participate in code reviews, CI/CD implementation, and DevOps best practices.

Required

Qualifications

5+ years of data engineering experience with 3+ years of hands-on Databricks experience.

Strong experience implementing and managing Unity Catalog in enterprise environments.

Experience supporting Oil & Gas, Energy, or Hydrocarbon Reporting projects.

Expertise with

o Databricks Lakehouse o Apache Spark (PySpark)

o Delta Lake o SQL o Python

Experience building enterprise ETL/ELT pipelines.

Experience with Azure Databricks (AWS Databricks also considered).

Robust understanding of data governance, security, metadata management, and lineage. .