Home/Job List/Senior Databricks Engineer - Pyspark, SQL, Delta Lake

Senior Databricks Engineer - Pyspark, SQL, Delta Lake

LIVEC STAFFING SERVICES PRIVATE LIMITED

Hyderabad, Telangana, India
Full-Time
Posted 6 days ago

Job Description & Responsibilities

About the Role

In this role, you will be at the forefront of developing and maintaining scalable data pipelines using Databricks. Your expertise in PySpark, SQL, and Delta Lake will drive our data governance and quality initiatives while ensuring optimal performance and reliability in our data solutions.

What You'll Do

  • Develop and maintain efficient data pipelines within Databricks to meet business needs.
  • Collaborate closely with data scientists and analysts to identify and address data requirements.
  • Implement robust data governance frameworks that uphold data integrity and compliance.
  • Use PySpark for effective data processing and transformations, optimizing for performance.
  • Query and manipulate datasets using SQL to deliver insights to stakeholders.
  • Integrate Delta Lake capabilities to facilitate efficient data storage, management, and transaction processing.
  • Work alongside Cloud & DevOps teams to deploy and manage cloud-based data solutions seamlessly.
  • Utilize Airflow for orchestrating complex workflows to ensure timely data delivery.

What We're Looking For

  • Strong expertise in Databricks and its surrounding ecosystem.
  • Proficiency in PySpark and SQL with a focus on practical application in data processing.
  • Experience with Delta Lake functionalities for enhanced data handling.
  • Knowledge of best practices in data governance and quality assurance.
  • Familiarity with cloud platforms and DevOps methodologies.
  • Experience using workflow orchestration tools like Airflow.

Required Skills

SQL

Job Details

Employment TypeFull-Time
Work ModeOn-Site
Experience0 – 0 years
Positions1

Posted by

N/A

Posted on:

11 Nov 2026

About LIVEC STAFFING SERVICES PRIVATE LIMITED

More open roles

Browse all jobs →