Senior Data Engineer – AWS & Databricks

Senior Data Engineer – AWS & Databricks

Role Details

• Experience: 6–10 Years
• Location: Bengaluru
• Work Mode: Hybrid (2–3 days/week from office mandatory)
• Mandatory Skills: AWS + Databricks
• Budget: 17 LPA
• Joining: Immediate / Early joiners preferred
• Contract Duration: 12 months

Role Overview

We are seeking a highly skilled Senior Data Engineer with strong hands-on experience in AWS and Databricks to design, implement, and optimize scalable data pipelines and analytics solutions. The ideal candidate should have deep expertise in Apache Spark, ETL design, cloud-native data engineering, and modern data governance practices.

You will collaborate closely with data scientists, analysts, and business stakeholders to deliver robust, high-performance data solutions that drive strategic insights.

Key Responsibilities

• Design, develop, and optimize ETL pipelines using Databricks and Apache Spark.
• Build scalable and efficient data models and schemas.
• Collaborate with data scientists to support ML model deployment.
• Ensure data quality, consistency, reliability, and governance.
• Optimize SQL queries and troubleshoot performance bottlenecks.
• Implement data security, access controls, and governance policies.
• Work with Databricks Unity Catalog for centralized governance.
• Develop and maintain technical documentation.
• Participate in code reviews and mentor junior engineers.
• Translate business requirements into scalable technical solutions.
• Support real-time and streaming data processing use cases.

Required Skills & Qualifications

Technical Skills

• 6–10 years of experience in Data Engineering.
• Strong expertise in Databricks Platform and Apache Spark.
• Hands-on experience with AWS cloud services.
• Excellent SQL skills.
• Strong programming skills in Python or Scala.
• Experience building robust ETL processes and data pipelines.
• Experience with Databricks Unity Catalog.
• Understanding of distributed computing and big data architecture.
• Familiarity with Git and version control practices.
• Experience with real-time/streaming data processing.
• Strong understanding of data warehousing and analytics concepts.

Nice to Have

• Databricks certifications.
• Experience with data governance and compliance standards.
• Exposure to Azure or GCP (secondary cloud platforms).
• Experience in fast-paced enterprise environments.

Soft Skills

• Strong analytical and problem-solving ability.
• Excellent communication and stakeholder collaboration skills.
• Ability to manage multiple priorities in a dynamic environment.
• Mentoring and team collaboration mindset.