Data Engineer-3

About the Role: FNP is looking for a Data Engineer-3 to design and build scalable data platforms that power analytics, personalization, and business decision-making across the organization. This role requires strong expertise in big data technologies, cloud platforms, and distributed data processing, along with the ability to lead critical data engineering initiatives in a fast-paced e-commerce environment.

As a key member of the Data Engineering team, you will build robust data pipelines, optimize large-scale processing systems, and collaborate with cross-functional teams to enable data-driven products, reporting, and customer insights.

Key Responsibilities

• Data Pipeline Development: Design, build, and maintain scalable, reliable, and high-performance data pipelines for large-scale data ingestion, transformation, and processing.
• Big Data Engineering: Work extensively with Apache Spark and the Hadoop ecosystem to process large volumes of structured and unstructured data efficiently.
• Cloud Data Platforms: Leverage AWS services including EMR, S3, Athena, and DMS, along with Google BigQuery, for scalable data storage, processing, and analytics.
• ETL/ELT Development: Develop, optimize, and maintain ETL/ELT workflows supporting business intelligence, reporting, and real-time data use cases.
• Cross-Functional Collaboration: Partner with Product, Analytics, Marketing, and Engineering teams to understand business requirements and deliver scalable data solutions.
• Data Quality & Governance: Ensure data accuracy, consistency, governance, and compliance across data platforms while implementing best practices for monitoring and validation.
• Performance Optimization: Optimize data models, SQL queries, storage strategies, and processing workflows to improve performance and reduce infrastructure costs.
• Technical Leadership: Mentor junior data engineers, conduct code reviews, promote engineering best practices, and drive continuous improvement within the team.
• Production Support: Troubleshoot production issues, monitor data pipelines, and ensure high availability, reliability, and scalability of data systems.

Qualifications & Experience

• Bachelor s or Master s degree in Computer Science, Engineering, or a related field.
• 4 5 years of hands-on experience in Data Engineering or Big Data development.
• Strong experience building scalable data pipelines and distributed processing systems.
• Experience working in fast-paced technology or e-commerce environments is preferred.

Required Skills

• Strong hands-on experience with Apache Spark and distributed data processing.
• Experience with AWS services including EMR, S3, Athena, and DMS.
• Working knowledge of Google Cloud BigQuery.
• Strong SQL skills and expertise in data modeling.
• Experience with MySQL, MongoDB, and similar databases.
• Solid understanding of the Hadoop ecosystem.
• Experience building scalable data pipelines and data lakes.
• Excellent analytical, debugging, and problem-solving skills.

Preferred Qualifications

• Experience in e-commerce, consumer internet, or high-scale digital platforms.
• Knowledge of workflow orchestration tools such as Apache Airflow.
• Experience with real-time data processing and streaming technologies.
• Understanding of personalization engines, recommendation systems, or customer analytics.
• Exposure to DevOps practices, CI/CD pipelines, and infrastructure automation.

Reporting

Reports To: Engineering Manager Data Platform

Location

Gurgaon

Core Skills

Apache Spark, Hadoop, AWS EMR, Amazon S3, Athena, AWS DMS, Google BigQuery, SQL, ETL/ELT, Data Engineering, Data Pipelines, Data Lakes, MySQL, MongoDB, Data Modeling, Airflow, Big Data, Cloud Computing, Performance Optimization, Data Governance

Disclaimer : This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.