Still Struggling with Hiring? Discover Olibr's Solution Now!

Azure Data Engineer - Python/PySpark|Gurgaon/Gurugram|3+Yrs

  • HuQuo
  • India, G...
  • 3 - 9 Yrs

Job Closed

Job Description

  • 4 to 8 years of relevant experience in data engineering tools
  • Programming Languages - SQL, Python
  • Technologies - Spark/ Azure Data factory /Azure Data Lake Storage/ Databricks, Delta Lake , Python, SQLServer/Snowflake and experience with other cloud providers - AWS/GCP
  • B.S. Degree in a data-centric field (Mathematics, Economics, Computer Science, Engineering or other science field), Information Systems, Information Processing or engineering
  • Ability to work independently

Job Responsibilities

  • A seasoned data team member with a good grasp of both business and technical aspects
  • Good familiarity with data stack
  • Interact with the other members of the data governance team, business teams to understand requirements and also collaborate with stewards / data custodians / end users etc.
  • Demonstrated experience of building efficient data pipelines using tools or technologies like Spark, Cloud native tools like EMR, Azure data factory, Informatica, Abinitio etc.
  • Understand the need for both batch and stream ingestion of the data from source databases like SQLServer, Oracle, MySQL etc. and build scripts logics for reusable data transformations
  • Specialize in performance tuning of parked jobs, Databricks clusters and ETL processes leveraging advance features to enhance overall system efficiency
  • Conduct code reviews to ensure adherence to best practices, coding standards within Databricks notebooks and scripts
  • Lead Data Engineering Projects to manage and implement data-driven communication systems
  • Proficient in data engineering , data management principles
  • Good combination of technical skills, communication skills, and business acumen

Location

Gurgaon, Haryana, India