Azure Data Engineer - Python/PySpark|Gurgaon/Gurugram|3+Yrs
HuQuo
India, G...
3 - 9 Yrs
Job Closed
Job Description
4 to 8 years of relevant experience in data engineering tools
Programming Languages - SQL, Python
Technologies - Spark/ Azure Data factory /Azure Data Lake Storage/ Databricks, Delta Lake , Python, SQLServer/Snowflake and experience with other cloud providers - AWS/GCP
B.S. Degree in a data-centric field (Mathematics, Economics, Computer Science, Engineering or other science field), Information Systems, Information Processing or engineering
Ability to work independently
Job Responsibilities
A seasoned data team member with a good grasp of both business and technical aspects
Good familiarity with data stack
Interact with the other members of the data governance team, business teams to understand requirements and also collaborate with stewards / data custodians / end users etc.
Demonstrated experience of building efficient data pipelines using tools or technologies like Spark, Cloud native tools like EMR, Azure data factory, Informatica, Abinitio etc.
Understand the need for both batch and stream ingestion of the data from source databases like SQLServer, Oracle, MySQL etc. and build scripts logics for reusable data transformations
Specialize in performance tuning of parked jobs, Databricks clusters and ETL processes leveraging advance features to enhance overall system efficiency
Conduct code reviews to ensure adherence to best practices, coding standards within Databricks notebooks and scripts
Lead Data Engineering Projects to manage and implement data-driven communication systems
Proficient in data engineering , data management principles
Good combination of technical skills, communication skills, and business acumen
Location
Gurgaon, Haryana, India
About Company
HuQuo (derived from Human Quotient) is the next stage in the evolution of HR. In an industry thirsty for innovation, HuQuo is a fresh perspective towards people and organizations. At HuQuo,we do not look at human beings as mere resources, but as an ocean of untapped potential. Human Quotient goes beyond IQ and EQ. It’s the holistic representation of all human potential. We strategically manage this Human quotient. We believe that every organization has a human like individuality which can help nurture and flourish those individuals that resonate with it. Our endeavor is to bring such high resonance individuals and organizations together. We will achieve this through extensive use of analytics and deep immersion to understand the core of the organizations and people we work with.