Home/Job List/AWS Data Platform Support Engineer
Awign

AWS Data Platform Support Engineer

Awign

India
Contract
Posted 14 days ago

Job Description & Responsibilities

Experience: 6–10 years in AWS data engineering or cloud support

Role summary

Support, monitor and enhance the AWS-based data ingestion platform that loads source data into Snowflake. Own day-to-day stability of Glue/Spark jobs, Lambda and Step Function orchestration, and the network and security components they run on.

Key responsibilities

AWS Glue — build, deploy, troubleshoot and tune Glue ETL jobs, crawlers, Data Catalog and job bookmarks; manage DPU sizing and job retries.

Ingestion framework — support the metadata-driven ingestion framework (full/incremental/CDC loads); onboard new sources and tables; handle schema drift and failed loads.

Apache Spark / PySpark — debug and optimise Spark jobs (partitioning, shuffles, memory, skew) on Glue and EMR.

AWS Lambda — maintain event-driven functions (S3 triggers, API calls, file validation); manage layers, timeouts, concurrency and logging.

AWS Step Functions — maintain pipeline orchestration state machines; handle error/retry/catch paths and re-runs.

Additional responsibilities

Amazon S3 — bucket structure, lifecycle policies, encryption (SSE-KMS), event notifications.

IAM — roles, policies and least-privilege access for Glue, Lambda and cross-account access.

Monitoring and alerting — CloudWatch logs, metrics, alarms and dashboards; SNS/email/Teams alerts for job failures.

AWS DMS / AppFlow / Kinesis — support CDC and streaming ingestion where used.

Snowflake integration — Snowpipe, external stages, storage integrations, COPY INTO troubleshooting.

Infrastructure as Code — CloudFormation or Terraform for pipeline resources.

CI/CD — deploy Glue/Lambda code through GitHub Actions, GitLab CI, Azure DevOps or CodePipeline.

Cost control — track Glue DPU, Lambda and EC2 spend; recommend right-sizing.

Incident and change management — resolve tickets within SLA (ServiceNow/Jira), write RCAs, maintain runbooks.

Data quality — implement validation checks and reconciliation reports.

Required skills

Hands-on AWS Glue, Spark/PySpark, Lambda, Step Functions, S3, IAM, Secrets Manager, EC2, VPC networking.

Python scripting (boto3) and strong SQL.

Working knowledge of Snowflake roles, warehouses, stages and loading.

Production support experience: on-call, SLA-driven ticket handling, RCA.

Preferred skills

Amazon EMR, Athena, Lake Formation, EventBridge, KMS, CloudTrail.

Terraform / CloudFormation; Git branching and CI/CD.

Airflow (MWAA) or similar orchestration.

Data formats: Parquet, Avro, JSON, Iceberg/Delta.

Qualifications

Bachelor's degree in Computer Science, IT or related field.

  • Preferred certifications: AWS Certified Data Engineer – Associate, AWS Solutions Architect – Associate, SnowPro Core.

Required Skills

PythonAWSAzureSQLGitCI/CDTerraformJIRA

Job Details

Employment TypeContract
Work ModeOn-Site
Experience6 – 10 years
Positions1

Posted by

N/A

Posted on:

4 Nov 2026

About Awign

More open roles

Browse all jobs →