Still Struggling with Tech Hiring? Discover Olibr's Solution Now!

Senior Data Analyst/Manager|Gurgaon|5+Yrs

  • HuQuo
  • India, G...
  • 5 - 8 Yrs

Job Description

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • Proficiency in Apache Spark 3.X and SCALA programming.
  • Hands-on experience with Delta lake implementation.
  • Strong knowledge of streaming solutions, especially for IOT, using Spark streaming.
  • Expertise in Kafka for building data pipelines.
  • Proven track record of designing and optimizing Spark applications.
  • Strong problem-solving and debugging skills.
  • Excellent communication and collaboration abilities.

Job Responsibilities

  • Develop, implement, and maintain Spark applications for data processing and analytics.
  • Design and optimize Spark jobs for performance and scalability.
  • Implement Delta lake solutions for efficient data storage and management.
  • Build streaming solutions for Internet of Things (IOT) using Spark streaming.
  • Utilize Kafka expertise to design and manage data pipelines.
  • Collaborate with cross-functional teams to understand and address data processing requirements.
  • Troubleshoot and debug issues in Spark applications and pipelines.
  • Stay up-to-date with industry best practices and emerging technologies in Big Data and Spark ecosystem.

Location

Gurgaon, Haryana, India