Java and Bigdata Data engineer

Roles and Responsibilities

• Design, develop, test, deploy and maintain large-scale data pipelines using Data Flow, Dataproc, PubSub and Spark on GCP.
• Collaborate with cross-functional teams to gather requirements and design solutions for complex data processing needs.
• Develop high-quality code in Java to integrate systems and services across the organization's technology stack.
• Troubleshoot issues related to data quality, performance, scalability and security in a fast-paced environment.

Job Requirements

• 4-9 years of experience in software development with expertise in BigQuery, SQL, Spring Boot.
• Strong understanding of cloud-based technologies such as Google Cloud Platform (GCP) including Data Flow, Dataproc, PubSub.
• Experience working with big data tools like Spark is required; knowledge of other big data technologies like Hadoop/Hive is an added advantage.