Still Struggling with Tech Hiring? Discover Olibr's Solution Now!

Senior Data Engineer - Big Data Tools|Gurgaon|4+Yrs

  • DIATOZ: Digital A to Z Solutions
  • India, G...
  • 4 - 10 Yrs

Job Description

  • We Seek A Highly Skilled Data Engineer With Expertise In Apache Spark, Scala, And Java To Join Our Dynamic Team.
  • The Ideal Candidate Will Have A Strong Background In Data Engineering, A Deep Understanding Of Big Data Technologies, And The Ability To Design And Implement Scalable Data Processing Solutions.
  • Education: Bachelor’s Or Master’s Degree In Computer Science, Information Technology, Or A Related Field.
  • Proven Experience As A Data Engineer Or In A Similar Role.
  • Extensive Experience With Apache Spark And Scala.
  • Strong Programming Skills In Java.
  • Technical Skills:
  • Proficiency In Big Data Technologies And Frameworks.
  • Experience With Data Modeling, ETL Processes, And Data Warehousing Solutions.
  • Familiarity With Cloud Platforms Such As AWS.
  • Knowledge Of SQL And NoSQL Databases.
  • Understanding Of Data Security And Privacy Best Practices.
  • Excellent Problem-Solving Skills And Attention To Detail.
  • Strong Communication And Collaboration Skills.
  • Ability To Work In A Fast-Paced, Dynamic Environment.

Job Responsibilities

  • Data Pipeline Development: Design, Develop, And Maintain Scalable Data Pipelines Using Apache Spark, Scala, And Java.
  • Data Integration: Integrate Data From Various Sources, Ensuring Data Quality, Consistency, And Accessibility.
  • Performance Optimization: Optimize And Tune Data Processing Workflows For Performance And Efficiency.
  • Collaboration: Work Closely With Data Scientists, Analysts, And Other Stakeholders To Understand Data Requirements And Deliver Effective Solutions.
  • Data Architecture: Contribute To The Design And Architecture Of The Data Infrastructure, Ensuring It Supports The Business Needs And Scalability Requirements.
  • Documentation: Document Data Processing Workflows, Architectures, And Best Practices.
  • Monitoring And Troubleshooting: Implement Monitoring Solutions To Ensure Data Pipeline Reliability And Troubleshoot Issues As They Arise.
  • Continuous Improvement: Stay Updated With The Latest Industry Trends And Technologies, And Continuously Seek Ways To Improve The Data Engineering Processes.

Location

Gurgaon, Haryana, India