Job Description
- We are currently seeking a talented and motivated Data Engineer to join our dynamic team and play a crucial role in shaping the future of our data infrastructure.
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- Proven experience in data engineering with a focus on Python or Java programming languages.
- Solid understanding of Airflow for orchestrating complex data workflows.
- Strong experience with BigQuery SQL for data analysis and reporting.
- Experience in creating and optimizing data pipelines for efficiency and scalability.
- Strong problem-solving skills and attention to detail in ensuring data quality and integrity.
- Ability to work collaboratively in a team environment and communicate effectively with stakeholders.
Job Responsibilities
- Design, develop, and maintain robust data pipelines for efficient and scalable data processing.
- Implement data integration solutions using Python and Java programming languages.
- Utilize Airflow for scheduling and orchestrating data workflows, ensuring reliability and timely execution.
- Collaborate with cross-functional teams to understand data requirements and design optimal solutions.
- Create and manage data pipelines to ingest, transform, and store data from various sources (MySQL, MongoDB, API, Etc) into Google BigQuery.
- Monitor and troubleshoot data pipeline issues, ensuring data accuracy and pipeline performance.
- Develop and optimize Google Looker dashboards for data visualization and reporting.
- Stay abreast of industry best practices and emerging technologies to continuously improve data engineering processes.
Location
Gurgaon, Haryana, India