Job Description & Responsibilities

Data Pipeline Development: Design, Develop, And Maintain Scalable Data Pipelines Using Apache Spark, Scala, And Java.
Data Integration: Integrate Data From Various Sources, Ensuring Data Quality, Consistency, And Accessibility.
Performance Optimization: Optimize And Tune Data Processing Workflows For Performance And Efficiency.
Collaboration: Work Closely With Data Scientists, Analysts, And Other Stakeholders To Understand Data Requirements And Deliver Effective Solutions.
Data Architecture: Contribute To The Design And Architecture Of The Data Infrastructure, Ensuring It Supports The Business Needs And Scalability Requirements.
Documentation: Document Data Processing Workflows, Architectures, And Best Practices.
Monitoring And Troubleshooting: Implement Monitoring Solutions To Ensure Data Pipeline Reliability And Troubleshoot Issues As They Arise.
Continuous Improvement: Stay Updated With The Latest Industry Trends And Technologies, And Continuously Seek Ways To Improve The Data Engineering Processes.

Senior Data Engineer - Big Data Tools|Gurgaon|4+Yrs

Job Description & Responsibilities