Engineering Manager – Data Engineer

Job Description

GroundTruth is an advertising platform that transforms real‑world consumer behavior into marketing that drives in‑store visits and measurable business results. We use observed location and purchase data to create targeted advertising campaigns across all screens, measure consumer response, and uncover insights to optimize future marketing efforts.

The Data Engineering Team is responsible for the core data infrastructure that powers our audience platform. As an Engineering Manager on our Audience Engineering team, you will build solutions that add new data capabilities and analytical depth to our platform while managing sophisticated AWS‑native data services.

You will

• Architect scalable pipelines: oversee the design and deployment of large‑scale distributed data processing jobs using PySpark on Amazon EMR clusters and serverless AWS Glue ETL jobs.
• Coach and mentor engineers, supporting growth in technical skills (particularly Python and Spark optimization), data modeling best practices, and career progression.
• Partner with stakeholders and engineering leadership to evaluate, plan, and deliver data‑first projects across advertising systems, analytics services, and reporting features.
• Lead by example: write production‑ready Python and PySpark code, perform code reviews, and optimize Spark configurations to improve performance and reduce costs. Apply Agile methodologies such as Scrum to drive iterative development, foster team collaboration, and ensure continuous delivery of high‑quality data solutions.
• Support engineers through regular 1:1s, feedback, quarterly reviews, recognition, and performance management.

You have

• Bachelor’s degree in Computer Engineering, Data Science, or equivalent practical experience.
• 8+ years of experience in technology, specifically focused on data engineering, data warehousing, or big data architecture.
• 2+ years of experience leading a data engineering team.
• Expertise in Python and PySpark: deep experience writing and tuning distributed processing applications, handling data skew, and optimizing Spark memory management.
• Advanced AWS expertise: proven track record of managing Amazon EMR for heavy‑duty processing.
• Experience with Big Data infrastructure: build the systems required for optimal extraction, transformation, and loading of data from a wide variety of sources using SQL and AWS big data technologies (S3, EMR, Glue, Athena, and Lambda).
• Expert SQL skills for complex transformations, performance tuning, and deep‑dive analytics.
• Experience with orchestration: advanced proficiency with Airflow and Git.
• AI‑Driven engineering: proven track record of leveraging AI across the data engineering process to drive modernization, automate data quality checks, and enhance delivery outcomes.
• Hands‑on familiarity with AI‑native tools such as Cursor, Claude, or GitHub Copilot to scale data development.

How you can impress us

• Performance tuning specialist: ability to debug complex PySpark or Scala jobs and optimize EMR instance fleets/spot instances to balance performance with infrastructure costs.
• Good to have experience with event‑driven architecture and hands‑on experience using AWS SQS for scalable, reliable event processing.
• AWS certification is preferred, demonstrating expertise in designing and building scalable cloud‑based data solutions.
• Organized and collaborative, comfortable in a fast‑moving, data‑intensive environment.
• Detail‑oriented: catches data quality issues early and implements automated course corrections.
• Strong communicator who aligns business needs with technical data constraints through clear trade‑offs.
• Deep problem solver who diagnoses pipeline bottlenecks and partners across teams to drive durable data solutions.

What we offer

• Parental leave – maternity and paternity
• Flexible time off: earned leaves, sick leaves, birthday leave, bereavement leave, and company holidays
• In‑office daily catered breakfast, lunch, snacks, and beverages
• Health coverage for hospitalization, covering nuclear family and parents
• Tele‑medicine for free doctor consultations, discounts on health checkups and medicines
• Wellness/gym reimbursement
• Pet expense reimbursement
• Childcare expense reimbursements
• Employee referral program
• Education reimbursement program
• Skill development program
• Cell phone reimbursement (mobile subsidy program)
• Internet reimbursement and/or postpaid cellphone bill reimbursement
• Employee provident fund scheme with various tax‑saving options and matching up to 12% of basic salary
• Creche reimbursement
• Co‑working space reimbursement
• National pension system employer match
• Meal card for tax benefit
• Special benefits on salary account

Job Classification

Industry: Software Product

Functional Area / Department: Engineering – Software & QA

Role Category: Software Development

Role: Data Engineer

Employment Type: Full time