Still Struggling with Tech Hiring? Discover Olibr's Solution Now!

Azure Data Engineer -Lead|Chennai&Pune|8Yrs+

  • Aparajita Consultancy Services
  • Multiple
  • 8 - 15 Yrs
  • 5 - 14 Lacs PA

Job Description

  • Total exp : 8+ Years
  • Relevant into Azure SQL : 4+ Years is must
  • Budget : Upto 14 LPA.
  • Notice period : max 15 days
  • Location : Chennai , Pune for Hybrid model.
  • Azure with SQL ( Azure SQL) combination is a must to have. SSIS SSRS with Azure o SQL with Azure is what you need to look at.
  • 8+ years of experience in Azure SQL & Data Warehousing
  • Should have excellent leadership & communication skills
  • Should have strong working experience on Data Lakehouse architecture
  • Should have in depth knowledge on SSIS ETL Tool and good working knowledge on Power BI
  • Should have worked on data sources such as SAP and Salesforce
  • Should have very good knowledge of SSIS (ETL Tool), StreamSets (ETL Tool), Azure Cloud, ADF, Azure Synapse Analytics & Azure Hub Events
  • Should have built solution automations in any of the above ETL tools
  • Should have executed atleast 2 Azure Cloud Data Warehousing projects
  • Should have worked atleast 2 projects using Agile/SAFe methodology
  • Should have demonstrated working knowledge on ITIL V4 concepts such as Incident Management, Problem Management, Change Management & Knowledge Management
  • Should have working experience on any DevOps tools like GitHub, Jenkins, etc & on semi-structured data formats like JSON, Parquet and/or XML files & written complex SQL queries for data analysis and extraction
  • Should have in depth understanding on Data Warehousing, Data Analysis, Data Profiling, Data Quality & Data Mapping
  • Should have cross global location experience and been part of a team with atleast 15+ members in a global delivery model
  • Should have experience in working with product managers, project managers, business users, applications development team members, DBA teams and Data Governance team on a daily basis to analyze requirements, design, development and deployment technical solutions

Job Responsibilities

  • Analyze the different source systems, profile data, understand, document & fix Data Quality issues
  • Gather requirements and business process knowledge in order to transform the data in a way that is geared towards the needs of end users
  • Write complex SQLs to extract & format source data for ETL/data pipeline
  • Create design documents, Source to Target Mapping documents and any supporting documents needed for deployment/migration
  • Design, Develop and Test ETL/Data pipelines
  • Design & build metadata-based frameworks needs for data pipelines
  • Write Unit Test cases, execute Unit Testing and document Unit Test results
  • Deploy ETL/Data pipelines
  • Use DevOps tools to version, push/pull code and deploy across environments
  • Support team during troubleshooting & debugging defects & bug fixes, business requests, environment migrations & other adhoc requests
  • Do production support, enhancements and bug fixes
  • Work with business and technology stakeholders to communicate EDW incidents/problems and manage their expectations
  • Leverage ITIL concepts to circumvent incidents, manage problems and document knowledge
  • Maintain and improve already existing processes
  • Ensure that the data pipelines are stable, secure, maintainable and highly available

Location

Pune, Maharashtra, India

Chennai, Tamil Nadu, India