AWS Data Platform Support Engineer
Awign
Job Description & Responsibilities
Experience: 6–10 years in AWS data engineering or cloud support
Role summary
Support, monitor and enhance the AWS-based data ingestion platform that loads source data into Snowflake. Own day-to-day stability of Glue/Spark jobs, Lambda and Step Function orchestration, and the network and security components they run on.
Key responsibilities
AWS Glue — build, deploy, troubleshoot and tune Glue ETL jobs, crawlers, Data Catalog and job bookmarks; manage DPU sizing and job retries.
Ingestion framework — support the metadata-driven ingestion framework (full/incremental/CDC loads); onboard new sources and tables; handle schema drift and failed loads.
Apache Spark / PySpark — debug and optimise Spark jobs (partitioning, shuffles, memory, skew) on Glue and EMR.
AWS Lambda — maintain event-driven functions (S3 triggers, API calls, file validation); manage layers, timeouts, concurrency and logging.
AWS Step Functions — maintain pipeline orchestration state machines; handle error/retry/catch paths and re-runs.
Additional responsibilities
Amazon S3 — bucket structure, lifecycle policies, encryption (SSE-KMS), event notifications.
IAM — roles, policies and least-privilege access for Glue, Lambda and cross-account access.
Monitoring and alerting — CloudWatch logs, metrics, alarms and dashboards; SNS/email/Teams alerts for job failures.
AWS DMS / AppFlow / Kinesis — support CDC and streaming ingestion where used.
Snowflake integration — Snowpipe, external stages, storage integrations, COPY INTO troubleshooting.
Infrastructure as Code — CloudFormation or Terraform for pipeline resources.
CI/CD — deploy Glue/Lambda code through GitHub Actions, GitLab CI, Azure DevOps or CodePipeline.
Cost control — track Glue DPU, Lambda and EC2 spend; recommend right-sizing.
Incident and change management — resolve tickets within SLA (ServiceNow/Jira), write RCAs, maintain runbooks.
Data quality — implement validation checks and reconciliation reports.
Required skills
Hands-on AWS Glue, Spark/PySpark, Lambda, Step Functions, S3, IAM, Secrets Manager, EC2, VPC networking.
Python scripting (boto3) and strong SQL.
Working knowledge of Snowflake roles, warehouses, stages and loading.
Production support experience: on-call, SLA-driven ticket handling, RCA.
Preferred skills
Amazon EMR, Athena, Lake Formation, EventBridge, KMS, CloudTrail.
Terraform / CloudFormation; Git branching and CI/CD.
Airflow (MWAA) or similar orchestration.
Data formats: Parquet, Avro, JSON, Iceberg/Delta.
Qualifications
Bachelor's degree in Computer Science, IT or related field.
- Preferred certifications: AWS Certified Data Engineer – Associate, AWS Solutions Architect – Associate, SnowPro Core.
About Awign
Required Skills
Job Details
Posted by
N/A
Posted on:
4 Nov 2026
About Awign
More open roles
- Senior Software Engineer (Python/Node.JS , AWS)Autodesk · India
- IT Intern - Software Development, Python & AI/MLAI SAMRAT · India
- Ansible & Python Open-source Developer for GamingHartbridge Evergrove Placements · Farrukhabad, Uttar Pradesh, India
- Senior Full Stack Developer (Python, React.js & Azure, AI)Robert Bosch · India
- Specialist System Engineering (Devops Engineer, CICD, Kubernetes, containers, React, Python, API, Deployment + Development + Automation, GitHub PipelinesAT&T · Bengaluru, Karnataka, India
- Data Scientist (Python, ML, SQL) (Bhilai)Workers Town · Raipur, Chhattisgarh, India