Data Engineer -Azure

Role Overview

We're looking for a Data Engineer with ~2 years of experience building and maintaining data pipelines on Azure, along with working knowledge of CI/CD practices to support automated, reliable deployments.

Key Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines using Azure Data Factory and/or SQL-based tools
• Work with SQL Server / Azure SQL for ingestion, transformation, and storage across staging/curated/reporting layers
• Optimize pipelines and queries for performance and cost efficiency
• Collaborate with BI/analytics teams to deliver clean, reliable datasets for reporting
• Implement and maintain CI/CD pipelines using Azure DevOps
• Write clean, modular, well-documented code following Git-based version control practices
• Monitor pipeline health, troubleshoot failures, and ensure data quality
• Explore opportunities to apply AI/GenAI tools for pipeline automation, data quality checks, or documentation
• Participate in code reviews and contribute to engineering best practices

Required Skills & Qualifications

• ~2 years of experience as a Data Engineer
• Strong hands-on experience with Azure data services (ADF, Synapse, Azure SQL, or similar)
• Proficiency in SQL and solid understanding of relational database concepts
• Working knowledge of CI/CD concepts and tools — Azure DevOps required; GitHub Actions, Jenkins, or GitLab CI experience a plus
• Hands-on experience developing and maintaining CI/CD pipelines for development environments using Azure DevOps (ADO)
• Experience with Git-based version control and branching workflows
• Ability to write clean, modular, well-documented pipeline code
• Python for scripting
• Proficiency in PySpark and Spark SQL

Good to Have

• Exposure to Databricks (PySpark / Spark SQL), Delta Lake concepts
• Familiarity with AI-assisted development tools (GitHub Copilot, Azure OpenAI, Claude Code or similar)
• Basic exposure to GenAI/LLM-based data workflows
• Basic understanding of data warehousing / dimensional modeling
• Bash/PowerShell scripting/testing
• Familiarity with Power BI or other BI tools
• Azure certifications (DP-700 Fabric Data Engineer Associate, AZ-900, etc.)