Senior ETL Big Data Test Engineer

Key Skills: Python, SQL, AWS, Azure, GCP, Selenium, Hadoop, Snowflake, Pytest, GIT, Spark, Jenkins, Databricks

Roles and Responsibilities

• Design and execute test strategies for ETL workflows, data ingestion, transformation, reconciliation, and downstream validation.
• Develop Python-based test utilities and SQL validation queries for source-to-target, completeness, accuracy, and consistency checks.
• Validate big data processing and data pipeline behavior across AWS, Microsoft Azure, and Google Cloud Platform environments.
• Investigate data quality issues, isolate root causes, and collaborate with engineering teams on defect resolution.
• Review data models, mapping specifications, pipeline designs, and test evidence to ensure coverage of functional and integration requirements.

Skills Required

• 5-10 years of experience in ETL testing, big data testing, data quality engineering, or cloud data platform testing.
• Strong hands-on experience with Python for data validation, test automation, and test utility development.
• Advanced SQL skills, including complex queries, joins, aggregations, reconciliation, and data comparison.
• Practical experience testing ETL and big data pipelines in AWS, Microsoft Azure, and Google Cloud Platform environments.
• Ability to validate cloud data integrations, pipeline dependencies, processing results, and production-scale datasets.

Good to Have

• Experience with Selenium, Pytest, Apache Spark, Apache Hadoop, Databricks, Snowflake, Jenkins, or Git.

Education: B.Tech or B.E. degree in Computer Science, Information Technology, Engineering, or a related discipline