Senior Data Engineer

Experience Level: 8–10 years

Number of Positions: 1

Location: Trivandrum (Hybrid)

Job Role / Job Description

We are looking for a Senior Data Engineer responsible for designing, implementing, and maintaining data solutions on the Microsoft Azure Data Platform and SQL Server (SSIS, SSAS, UC4 Atomic). The role involves working closely with stakeholders to ensure efficient data processing, storage, and retrieval at scale.

Roles and Responsibilities

• Design, build, and maintain scalable, reliable data pipelines.
• Develop ETL solutions using Azure Data Factory, Databricks, and SSIS.
• Analyze the existing data landscape and suggest rearchitecting or optimization strategies.
• Collaborate with onshore teams to resolve technical challenges and requirements.
• Monitor, troubleshoot, and optimize data systems for performance and reliability.
• Ensure data architecture aligns with business goals and governance policies.
• Integrate and transform data from diverse sources with high data quality.
• Lead data engineering strategy and architecture discussions.
• Enable and manage data migrations across systems.
• Perform thorough testing and validation of data transformations.
• Define data mappings and translate business processes into technical data requirements.
• Manage pipeline maintenance, testing, and performance validation.
• Build large, complex data sets to meet business needs.
• Analyze and identify data gaps; align business and IT on data requirements.
• Collaborate with IT, DevOps, and cross-functional teams for infrastructure alignment.
• Implement best practices for data security, privacy, and continuous improvement.
• Manage complex cases accurately and efficiently in high-volume environments.

Candidate Profile Expectations

• Proficient in designing solutions using Azure Synapse Analytics, ADLS, ADF, Databricks, Power BI, Azure Analysis Services.
• Strong hands-on experience in SSIS, SQL, query optimization, and ETL pipelines.
• Worked in onshore–offshore model, managing complex scenarios.
• Skilled in handling large structured/unstructured data, analytics, and data science.
• Experience with Azure and AWS cloud services, and DevOps/CI/CD tools.
• Comfortable working with ambiguous requirements and delivering clear outcomes.
• Strong communication skills; detail-oriented and self-driven.
• Experience with Terraform, Jenkins, and Infrastructure as Code (IaC).
• Contributed to architecture frameworks and data warehouse design.
• Solid understanding of full data lifecycle: ingestion, transformation, loading, validation, tuning.
• Experience in Python and Databricks is a plus.

Must-Have Skills

• Azure Data Factory
• Azure Databricks
• Azure Synapse
• ADLS
• Lakehouse Architecture
• Python
• SCD Concepts and Implementation
• SQL, PL/SQL
• SSIS
• SSAS
• TFS

Good-to-Have Skills

• UC4
• Power BI
• DevOps CI/CD
• Banking Domain