Senior Data Engineer - Big Data Tools|Gurgaon|4+Yrs
- DIATOZ: Digital A to Z Solutions
- India, G...
- 4 - 10 Yrs
Job Description
- We Seek A Highly Skilled Data Engineer With Expertise In Apache Spark, Scala, And Java To Join Our Dynamic Team.
- The Ideal Candidate Will Have A Strong Background In Data Engineering, A Deep Understanding Of Big Data Technologies, And The Ability To Design And Implement Scalable Data Processing Solutions.
- Education: Bachelor’s Or Master’s Degree In Computer Science, Information Technology, Or A Related Field.
- Proven Experience As A Data Engineer Or In A Similar Role.
- Extensive Experience With Apache Spark And Scala.
- Strong Programming Skills In Java.
- Technical Skills:
- Proficiency In Big Data Technologies And Frameworks.
- Experience With Data Modeling, ETL Processes, And Data Warehousing Solutions.
- Familiarity With Cloud Platforms Such As AWS.
- Knowledge Of SQL And NoSQL Databases.
- Understanding Of Data Security And Privacy Best Practices.
- Excellent Problem-Solving Skills And Attention To Detail.
- Strong Communication And Collaboration Skills.
- Ability To Work In A Fast-Paced, Dynamic Environment.
Job Responsibilities
- Data Pipeline Development: Design, Develop, And Maintain Scalable Data Pipelines Using Apache Spark, Scala, And Java.
- Data Integration: Integrate Data From Various Sources, Ensuring Data Quality, Consistency, And Accessibility.
- Performance Optimization: Optimize And Tune Data Processing Workflows For Performance And Efficiency.
- Collaboration: Work Closely With Data Scientists, Analysts, And Other Stakeholders To Understand Data Requirements And Deliver Effective Solutions.
- Data Architecture: Contribute To The Design And Architecture Of The Data Infrastructure, Ensuring It Supports The Business Needs And Scalability Requirements.
- Documentation: Document Data Processing Workflows, Architectures, And Best Practices.
- Monitoring And Troubleshooting: Implement Monitoring Solutions To Ensure Data Pipeline Reliability And Troubleshoot Issues As They Arise.
- Continuous Improvement: Stay Updated With The Latest Industry Trends And Technologies, And Continuously Seek Ways To Improve The Data Engineering Processes.
Location
Gurgaon, Haryana, India