Home/Job List/ETL Data Engineer
Technology Next

ETL Data Engineer

Technology Next

India
Full-Time
Posted 12 days ago

Job Description & Responsibilities

Role: ETL Data Engineer – AI/ML & LLM

Experience: 7-8 Years

Location: Hybrid PAN India

Timing -IST

Employment Type : C2C (Contractual)

Job Summary

We are looking for an experienced ETL Data Engineer with strong expertise in Azure Databricks, Python, Apache Spark, and AI/ML/LLM technologies. The candidate should be capable of independently designing, developing, deploying, and optimizing large-scale ETL/ELT data pipelines to support analytics, machine learning, and enterprise data solutions.

Key Responsibilities

Design and develop scalable ETL/ELT pipelines using Azure Databricks, Lakebase, Python, and Apache Spark.

Build and optimize data pipelines for analytics, BI reporting, machine learning, and predictive modelling.

Integrate data from multiple sources, including databases, APIs, FTP, and cloud storage.

Write complex SQL queries and perform performance tuning and optimization.

Ensure data quality, integrity, reliability, and pipeline efficiency.

Work on data architecture, modelling, and cloud-based data engineering solutions.

Implement CI/CD and DevOps automation using Terraform and GitHub Actions.

Collaborate with AI/ML teams and integrate LLM-based solutions.

Mentor junior data engineers and provide technical guidance.

Required Skills

Data Engineering & ETL/ELT: 7+ years of experience.

Python: 5+ years of hands-on experience.

Apache Spark: 2+ years of experience with PySpark/Spark SQL.

Azure Databricks: 2+ years of experience, including Unity Catalog.

AI/ML & LLM: Practical experience working with AI/ML and LLM technologies.

Additional Technical Skills

Azure Functions, Service Bus, Snowflake, and Lakebase.

Advanced SQL and data modelling.

Terraform and DevOps automation.

CI/CD: GitHub Actions, Git, Artifactory, and Sonar.

Delta Lake, Data Lake, and Data Warehousing.

Pay: ₹80,000.00 - ₹100,000.00 per month

Experience

  • LLM: 6 years (Required)

Work Location: Remote

Required Skills

PythonAzureSQLGitCI/CDTerraformMachine Learning

Job Details

Employment TypeFull-Time
Work ModeRemote
Experience7 – 8 years
Positions1

Posted by

N/A

Posted on:

6 Nov 2026

About Technology Next

More open roles

Browse all jobs →