Senior Data Engineer - Big Data Tools|Gurgaon|4+Yrs
DIATOZ: Digital A to Z Solutions
India, G...
4 - 10 Yrs
Job Description
We Seek A Highly Skilled Data Engineer With Expertise In Apache Spark, Scala, And Java To Join Our Dynamic Team.
The Ideal Candidate Will Have A Strong Background In Data Engineering, A Deep Understanding Of Big Data Technologies, And The Ability To Design And Implement Scalable Data Processing Solutions.
Education: Bachelor’s Or Master’s Degree In Computer Science, Information Technology, Or A Related Field.
Proven Experience As A Data Engineer Or In A Similar Role.
Extensive Experience With Apache Spark And Scala.
Strong Programming Skills In Java.
Technical Skills:
Proficiency In Big Data Technologies And Frameworks.
Experience With Data Modeling, ETL Processes, And Data Warehousing Solutions.
Familiarity With Cloud Platforms Such As AWS.
Knowledge Of SQL And NoSQL Databases.
Understanding Of Data Security And Privacy Best Practices.
Excellent Problem-Solving Skills And Attention To Detail.
Strong Communication And Collaboration Skills.
Ability To Work In A Fast-Paced, Dynamic Environment.
Job Responsibilities
Data Pipeline Development: Design, Develop, And Maintain Scalable Data Pipelines Using Apache Spark, Scala, And Java.
Data Integration: Integrate Data From Various Sources, Ensuring Data Quality, Consistency, And Accessibility.
Performance Optimization: Optimize And Tune Data Processing Workflows For Performance And Efficiency.
Collaboration: Work Closely With Data Scientists, Analysts, And Other Stakeholders To Understand Data Requirements And Deliver Effective Solutions.
Data Architecture: Contribute To The Design And Architecture Of The Data Infrastructure, Ensuring It Supports The Business Needs And Scalability Requirements.
Documentation: Document Data Processing Workflows, Architectures, And Best Practices.
Monitoring And Troubleshooting: Implement Monitoring Solutions To Ensure Data Pipeline Reliability And Troubleshoot Issues As They Arise.
Continuous Improvement: Stay Updated With The Latest Industry Trends And Technologies, And Continuously Seek Ways To Improve The Data Engineering Processes.
Location
Gurgaon, Haryana, India
About Company
DIATOZ is a fast evolving IT company operating from India, Texas and Singapore. The company has evolved into 3 business verticals namely Digital Solutions & Services, Digital Products and Consulting. Digital Solutions & Services include but are not limited to providing proof of concepts, solutions to complex problems on various domains like IoT, Mobility, eCommerce by adopting industry wide best practices. Digital Products like iRestoran, ezenotes, e2ehiring, Hectocommerce, ezevision that foray in various digital spaces that uses latest cutting edge technologies. Under Consulting, best talents matching the dynamics of IT industry needs are sourced, screened, evaluated to various partner companies to fulfill their human resource needs.
DIATOZ LUMINARY achievements are -
• Startup of the year 2020” by CIO Insider India.
• Indian Achievers’ Award for Promising Company 2020.
• The company in focus 2021 by Innovative Zone India.
• The 30 Most Trusted Brands to Watch 2021 by Prime Insights.