Data Engineer / Data Architect

We specialize in delivering high-quality human-curated data and AI-first scaled operations services

Based in San Francisco and Hyderabad, we are a fast-moving team on a mission to build AI for Good, driving innovation and societal impact

Role Overview

We are seeking a Data Engineer / Data Architect who will be responsible for designing, building, and maintaining scalable data infrastructure and systems for a client

Youll play a key role in enabling efficient data flow, storage, transformation, and access across our organization or client ecosystems

Whether youre just beginning or already an expert, we value strong technical skills, curiosity, and the ability to translate complex requirements into reliable data pipelines

Responsibilities

Design and implement scalable, robust, and secure data pipelines

Build ETL/ELT frameworks to collect, clean, and transform structured and unstructured data

Collaborate with data scientists, analysts, and backend engineers to enable seamless data access and model integration

Maintain data integrity, schema design, lineage, and quality monitoring

Optimize performance and ensure reliability of data workflows in production environments

Design and manage data warehousing and lakehouse architecture

Set up and manage infrastructure using IaC (Infrastructure as Code) when applicable

Required Skills

Strong programming skills in Python, SQL, and Shell scripting

Hands-on experience with ETL tools and orchestration frameworks (e g, Airflow, Luigi, dbt)

Proficiency in relational databases (e g , PostgreSQL, MySQL) and NoSQL databases (e g

, MongoDB, Redis)

Experience with big data technologies: Apache Spark, Kafka, Hive, Hadoop, etc

Deep understanding of data modeling, schema design, and data warehousing concepts

Proficient with cloud platforms (AWS/GCP/Azure) and services like Redshift, BigQuery, S3, Dataflow, or Databricks

Knowledge of DevOps and CI/CD tools relevant to data infrastructure

Nice to Have

Experience working in real-time streaming environments

Familiarity with containerization and Kubernetes

Exposure to MLOps and collaboration with ML teams

Experience with security protocols, data governance, and compliance frameworks

Educational Qualifications

Bachelors or Masters in Computer Science, Data Engineering, Information Systems, or a related technical field

Location - Mumbai, Delhi / NCR, Bengaluru , Kolkata, Chennai, Hyderabad, Ahmedabad, Pune, India