Lead QA Data Engineer (Telangana)

Job Summary

• We are seeking a highly skilled Lead QA Data Engineer to head our data quality assurance efforts.
• In this role, you will be responsible for developing and executing comprehensive testing strategies for our data pipelines, data warehouses, and data products.
• You will lead a team of QA engineers focused on data integrity, performance, and reliability.
• Your expertise in data engineering and quality assurance will ensure that our data platforms support critical business decisions with high confidence.

Key Responsibilities

• - Lead and mentor a team of QA engineers in testing data-centric systems, including ETL pipelines, data lakes, and data warehouses.
• - Design, develop, and implement automated test frameworks for data validation, reconciliation, and performance testing.
• - Create comprehensive test plans and test cases that verify data accuracy, completeness, and timeliness across all stages of data processing.
• - Perform data profiling and develop data quality metrics to identify data anomalies and prevent data issues.
• - Collaborate with data engineers, data architects, and business analysts to understand data requirements and ensure test coverage.
• - Troubleshoot and resolve complex data issues in production and non-production environments.
• - Drive improvements in data quality processes, tools, and methodologies.

Required Qualifications

• - Bachelor's degree in Computer Science, Information Systems, or a related field.
• - 7+ years of experience in data QA, data engineering, or a related field, with 2+ years in a leadership capacity.
• - Strong proficiency in SQL and experience with major RDBMS platforms.
• - Experience with data testing and ETL validation tools (e.g., QuerySurge, ICEDQ, Great Expectations).
• - Hands-on experience with big data technologies and platforms like Azure Databricks, AWS EMR, or Google BigQuery.
• - Familiarity with data warehousing concepts, ETL/ELT processes, and data modeling.

Preferred Qualifications

• - Experience with data governance and data security testing.
• - Knowledge of Python or Scala for test automation.
• - Experience with cloud data platforms (AWS, Azure, GCP).

Key Competencies

• - Leadership: Proven ability to lead a technical QA team.
• - Analytical Thinking: Solid problem-solving and analytical skills for complex data issues.
• - Technical Expertise: Deep understanding of data engineering and data quality principles.
• - Collaboration: Effective communication and teamwork skills.