ETL Data Engineer
Technology Next
Job Description & Responsibilities
Role: ETL Data Engineer – AI/ML & LLM
Experience: 7-8 Years
Location: Hybrid PAN India
Timing -IST
Employment Type : C2C (Contractual)
Job Summary
We are looking for an experienced ETL Data Engineer with strong expertise in Azure Databricks, Python, Apache Spark, and AI/ML/LLM technologies. The candidate should be capable of independently designing, developing, deploying, and optimizing large-scale ETL/ELT data pipelines to support analytics, machine learning, and enterprise data solutions.
Key Responsibilities
Design and develop scalable ETL/ELT pipelines using Azure Databricks, Lakebase, Python, and Apache Spark.
Build and optimize data pipelines for analytics, BI reporting, machine learning, and predictive modelling.
Integrate data from multiple sources, including databases, APIs, FTP, and cloud storage.
Write complex SQL queries and perform performance tuning and optimization.
Ensure data quality, integrity, reliability, and pipeline efficiency.
Work on data architecture, modelling, and cloud-based data engineering solutions.
Implement CI/CD and DevOps automation using Terraform and GitHub Actions.
Collaborate with AI/ML teams and integrate LLM-based solutions.
Mentor junior data engineers and provide technical guidance.
Required Skills
Data Engineering & ETL/ELT: 7+ years of experience.
Python: 5+ years of hands-on experience.
Apache Spark: 2+ years of experience with PySpark/Spark SQL.
Azure Databricks: 2+ years of experience, including Unity Catalog.
AI/ML & LLM: Practical experience working with AI/ML and LLM technologies.
Additional Technical Skills
Azure Functions, Service Bus, Snowflake, and Lakebase.
Advanced SQL and data modelling.
Terraform and DevOps automation.
CI/CD: GitHub Actions, Git, Artifactory, and Sonar.
Delta Lake, Data Lake, and Data Warehousing.
Pay: ₹80,000.00 - ₹100,000.00 per month
Experience
- LLM: 6 years (Required)
Work Location: Remote
About Technology Next
Required Skills
Job Details
Posted by
N/A
Posted on:
6 Nov 2026
About Technology Next
More open roles
- Senior Software Engineer (Python/Node.JS , AWS)Autodesk · India
- IT Intern - Software Development, Python & AI/MLAI SAMRAT · India
- Ansible & Python Open-source Developer for GamingHartbridge Evergrove Placements · Farrukhabad, Uttar Pradesh, India
- Senior Full Stack Developer (Python, React.js & Azure, AI)Robert Bosch · India
- Specialist System Engineering (Devops Engineer, CICD, Kubernetes, containers, React, Python, API, Deployment + Development + Automation, GitHub PipelinesAT&T · Bengaluru, Karnataka, India
- Data Scientist (Python, ML, SQL) (Bhilai)Workers Town · Raipur, Chhattisgarh, India