Home/Job List/Big Data and Cloud Engineers
Confidential Client

Big Data and Cloud Engineers

Confidential Client

Bengaluru, Karnataka, India
Full-Time
Posted 22 days ago

Job Description & Responsibilities

Big Data and Cloud Engineers

We are seeking a Big Data & Cloud Engineer with hands‑on experience in Python, Apache Spark, Databricks, Snowflake, Azure Cloud, ETL/Data Pipelines, and Microservices. The ideal candidate should be capable of understanding business requirements, proposing technical solutions, collaborating with stakeholders, and developing scalable data engineering solutions. Exposure to AI-assisted development, MCP/Agentic AI, and Azure CloudOps is highly desirable.

Key Responsibilities

  • Understand business and technical requirements and translate them into scalable solutions.
  • Design, develop, and optimize ETL/data pipelines using Python, Apache Spark, Databricks, and Snowflake.
  • Build and maintain REST APIs and microservices for data integration.
  • Develop entity/profile matching solutions using ML and graph algorithms.
  • Deploy and manage cloud-native solutions on Microsoft Azure.
  • Support Azure CloudOps activities, including networking, identity, security, monitoring, and observability.
  • Optimize SQL queries and data processing performance.
  • Leverage AI-assisted development tools (Cursor, GitHub Copilot) to improve productivity.
  • Collaborate with cross-functional teams, stakeholders, and architects throughout the development lifecycle.
  • Troubleshoot production issues and continuously improve system performance and reliability.

Requirements

  • 3–5 years of experience in Data Engineering or Cloud Engineering.
  • Strong Python programming skills.
  • MCP / Agentic AI
  • AI-assisted development (Cursor, GitHub Copilot)
  • Apache Spark (PySpark).
  • Databricks.
  • Snowflake.
  • ETL/Data Pipeline development.
  • REST APIs and Microservices.
  • Microsoft Azure.
  • SQL and query optimization.
  • Strong analytical and problem-solving skills.
  • ML or Graph Algorithms for Entity/Profile Matching (preferred).
  • Azure CloudOps (Networking, Identity, Security) (preferred).
  • Monitoring & Observability (preferred).
  • JavaScript/jQuery knowledge (preferred).

Work Arrangements

  • Hybrid work mode (2–3 days/week in office).
  • Location: Bengaluru, Karnataka, IN.
  • Full-time position.

Education and Benefits

  • Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
  • Strong analytical and logical reasoning.
  • Excellent communication and stakeholder management skills.
  • Ability to understand requirements and recommend technical solutions.
  • Self-driven with a willingness to learn new technologies.
  • Strong collaboration and teamwork skills.

Required Skills

JavaScriptPythonAzureSQLMachine Learning

Job Details

Employment TypeFull-Time
Work ModeOn-Site
Experience3 – 5 years
Positions1

Posted by

N/A

Posted on:

27 Oct 2026

About Confidential Client

More open roles

Browse all jobs →