Still Struggling with Tech Hiring? Discover Olibr's Solution Now!
Login / RegisterDeveloperClient
Login/Register

Azure Data Engineer - Python/PySpark|Gurgaon/Gurugram|3+Yrs

  • HuQuo
  • India, G...
  • 3 - 9 Yrs

Job Description

  • 4 to 8 years of relevant experience in data engineering tools
  • Programming Languages - SQL, Python
  • Technologies - Spark/ Azure Data factory /Azure Data Lake Storage/ Databricks, Delta Lake , Python, SQLServer/Snowflake and experience with other cloud providers - AWS/GCP
  • B.S. Degree in a data-centric field (Mathematics, Economics, Computer Science, Engineering or other science field), Information Systems, Information Processing or engineering
  • Ability to work independently

Job Responsibilities

  • A seasoned data team member with a good grasp of both business and technical aspects
  • Good familiarity with data stack
  • Interact with the other members of the data governance team, business teams to understand requirements and also collaborate with stewards / data custodians / end users etc.
  • Demonstrated experience of building efficient data pipelines using tools or technologies like Spark, Cloud native tools like EMR, Azure data factory, Informatica, Abinitio etc.
  • Understand the need for both batch and stream ingestion of the data from source databases like SQLServer, Oracle, MySQL etc. and build scripts logics for reusable data transformations
  • Specialize in performance tuning of parked jobs, Databricks clusters and ETL processes leveraging advance features to enhance overall system efficiency
  • Conduct code reviews to ensure adherence to best practices, coding standards within Databricks notebooks and scripts
  • Lead Data Engineering Projects to manage and implement data-driven communication systems
  • Proficient in data engineering , data management principles
  • Good combination of technical skills, communication skills, and business acumen

Location

Gurgaon, Haryana, India

About Company

HuQuo (derived from Human Quotient) is the next stage in the evolution of HR. In an industry thirsty for innovation, HuQuo is a fresh perspective towards people and organizations. At HuQuo,we do not look at human beings as mere resources, but as an ocean of untapped potential. Human Quotient goes beyond IQ and EQ. It’s the holistic representation of all human potential. We strategically manage this Human quotient. We believe that every organization has a human like individuality which can help nurture and flourish those individuals that resonate with it. Our endeavor is to bring such high resonance individuals and organizations together. We will achieve this through extensive use of analytics and deep immersion to understand the core of the organizations and people we work with.