Still Struggling with Tech Hiring? Discover Olibr's Solution Now!

Data Engineer (Python)|Remote|4+Yrs

  • Matrix HR Technologies
  • Remote
  • 4 - 9 Yrs

Job Description

  • Experience: 4- 8 years.
  • Proficiency in Python and Pandas.
  • Understanding of RDBMS schema, data conversion processes, ETL processes, and data models.
  • Experience with core cloud data platforms like Snowflake and AWS.
  • Proficient in SQL, with the ability to write, debug, and optimize SQL queries.
  • Familiarity with Python packages such as Great Expectations is a plus.
  • Knowledge of Airflow and Kafka is advantageous.
  • Ability to develop and execute automated test frameworks for testing source-to-target mapping, data loading and extraction processes, data preprocessing, transformation, aggregation, various logics, integration from multiple sources, and data collection and distribution platforms.

Job Responsibilities

  • Ability to analyze test results and drive issue resolution.
  • Capable of independently managing at least one data process.
  • Experience in mentoring team members and ensuring project process adherence and delivery discipline.
  • Innovative mindset with the ability to suggest process and technology improvements to enhance productivity.
  • Proficient in discussing requirements with stakeholders to uncover gaps.