Job Description
- As Manager, Data Engineering, you will be responsible for translating client requirements into
- design, architecting, and implementing GCP Cloud based big data solutions for clients. Your role
- will be focused on delivering high quality solutions by independently driving design discussions
- related to Data Ingestion, Transformation & Consumption, Data Storage and Computation
- Frameworks, Performance Optimizations, Infrastructure, Automation & Cloud Computing, and
- Data Governance & Security. The role requires a hands-on technologist with expertise in Big
- Data solution architecture with strong programming background in Java / Scala / Python.
Job Responsibilities
- Mandatory to have knowledge of Big Data Architecture Patterns and experience in delivery of end to end Big data solutions on GCP Cloud.
- Expert in programming languages like Java/ Scala and good to have Python
- Expert in at least one distributed data processing frameworks: like Spark (Core, Streaming , SQL), Storm or Flink etc.
- Expert in Hadoop eco-system with GCP cloud distribution and worked at least on one or more big data ingestion tools (Sqoop, Flume, NiFI etc), distributed messaging and ingestion frameworks (Kafka,Pulsar, Pub/Sub etc) and good to know traditional tools like Informatica, Talend etc
- Should have worked on any of NoSQL solutions like Mongo DB, Cassandra, HBase etc or Cloud based NoSQL offerings like DynamoDB , Big Table etc.
- Good Exposure in development with CI / CD pipelines. Knowledge of containerization, orchestration and kubernetes engine would be an added advantage.
Location
Bengaluru, Karnataka, India