Cloud Data Engineer Noida (India)

About the role: CG Infinity is looking for a highly skilled Cloud Data Engineer to join our agile team.

The ideal candidate will have extensive experience in designing, implementing, and managing cloud-based data solutions.

You will be responsible for developing and maintaining scalable data pipelines, optimizing data storage, and ensuring data security and compliance.

Your role will involve collaborating with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.

Responsibilities: Design, build, and maintain data pipelines using up-to-date cloud platforms.

Develop robust ETL/ELT workflows for structured and unstructured data.

Optimize data storage, query performance, partitioning, and retrieval processes for large-scale datasets.

Ensure data quality through validation checks, reconciliation, profiling, and automated monitoring.

Collaborate with data analysts, business teams, and data scientists to understand functional requirements.

Implement data governance, metadata management, lineage tracking, and compliance standards.

Build integrations with APIs, databases, and third-party platforms.

Perform performance tuning for SQL queries, Spark jobs, and distributed processing workloads.

Develop reusable frameworks, coding standards, and CI/CD pipelines for data engineering solutions.

Collaborate with cross-functional teams to design, develop, and deliver scalable data solutions.

Perform continuous performance tuning, optimization, and capacity planning for data platforms and pipelines.

Integrate LLM / Generative AI solutions with enterprise data sources using secure pipelines.

Evaluate emerging AI data tools and recommend improvements to up-to-date data platforms.

Build and maintain data pipelines for AI/ML use cases, including feature engineering and model-ready datasets.

Support deployment of AI-powered analytics, recommendation systems, and predictive solutions.

Provide training, documentation, and ongoing