Job Description & Responsibilities

Analyze the different source systems, profile data, understand, document & fix Data Quality issues
Gather requirements and business process knowledge in order to transform the data in a way that is geared towards the needs of end users
Write complex SQLs to extract & format source data for ETL/data pipeline
Create design documents, Source to Target Mapping documents and any supporting documents needed for deployment/migration
Design, Develop and Test ETL/Data pipelines
Design & build metadata-based frameworks needs for data pipelines
Write Unit Test cases, execute Unit Testing and document Unit Test results
Deploy ETL/Data pipelines
Use DevOps tools to version, push/pull code and deploy across environments
Support team during troubleshooting & debugging defects & bug fixes, business requests, environment migrations & other adhoc requests
Do production support, enhancements and bug fixes
Work with business and technology stakeholders to communicate EDW incidents/problems and manage their expectations
Leverage ITIL concepts to circumvent incidents, manage problems and document knowledge
Maintain and improve already existing processes
Ensure that the data pipelines are stable, secure, maintainable and highly available

Azure Data Engineer -Lead|Chennai&Pune|8Yrs+

Job Description & Responsibilities