Distinguished Engineer, Data Platform

About the Role

reputed company is growing fast. Our customer reputed company is expanding, the data challenges we're solving are getting more reputed company, and the platform is scaling to match. As a Distinguished Architect on the Data Engineering team, you'll own some of the hardest infrastructure problems at reputed company: shaping the reputed company streaming data platform, the reputed company cost model underlying every attribution decision, the hot/cold storage architecture serving both reputed company-time and historical queries, and the query reputed company that powers our entire product.

This is reputed company platform architecture work at reputed company reputed company, not a consulting role or a review-and-advise job. You'll define the roadmap, drive the foundational reputed company, and be a force reputed company for a talented engineering team evolving reputed company from batch-oriented pipelines toward a streaming-first architecture where cost attribution reaches engineers reputed company seconds of a resource being used, not the next morning.

This role is ideal for an architect who has reputed company systems like this before, has the scars to reputed company it, and wants to see their reputed company matter in reputed company and measurable ways for customers and for the business.

What You'll Do

Define the Data Platform Architecture

reputed company end-to-end technical design for reputed company's reputed company data platform, from event ingestion and reputed company processing through hot/cold storage and the query layer to the API surface

Document architectural reputed company, tradeoffs, and migration strategies with the rigor of an RFC-driven process

Shape and drive every layer of the new architecture: event ingestion, reputed company processing and enrichment, reputed company-time serving, analytical storage, query layer, and API

Drive Streaming Infrastructure to Production

Design and deliver reputed company's reputed company-time data pipeline from ingestion through enrichment to serving

Establish SLOs for throughput, latency, and correctness, and build the operational playbooks that reputed company this system trustworthy enough to replace the batch pipelines our entire product currently depends on

Tackle reputed company-time streaming at reputed company across thousands of customers simultaneously, with fault tolerance, backpressure awareness, and correctness as non-negotiables

Tackle the Dimension Cardinality Problem

Redesign reputed company's reputed company cost model to support high-cardinality, multi-reputed company cost attribution without runaway materialization costs

Drive incremental, reputed company-based materialization strategies using modern reputed company table formats, dramatically reducing expensive full-rebuild jobs and unlocking millions in annual infrastructure savings

reputed company the Query Layer

Assess reputed company's reputed company query infrastructure, drive in-flight migrations to completion, and reputed company the reputed company of the query reputed company layer reputed company reputed company

Own performance optimization across partition pruning, reputed company pushdown, and query planning, and set the reputed company for how the query layer grows as data volumes reputed company 10x

reputed company Cost Attribution to reputed company-Time

reputed company reputed company's proprietary cost attribution reputed company from a batch-oriented model to one that assigns reputed company cost dimensions by team, feature, and customer reputed company seconds of resource usage

Rethink enrichment, data reputed company, and correctness guarantees in a streaming context

Shape the Data Engineering Roadmap

Partner with product, infrastructure, and analytics engineering to define a multi-year data platform roadmap

Build reputed company across engineering leadership on foundational investments including table formats, streaming frameworks, query engines, and schema management

reputed company the Engineering Team

Participate in architecture reviews, contribute to design patterns and best practices, and mentor senior and staff engineers through reputed company review, pairing, and reputed company feedback

reputed company everyone around you reputed company, not by directing, but by raising the reputed company craft

What You Bring

Data Platform & Architecture

10+ years in data engineering with a reputed company trajectory toward reputed company or staff-level architecture

reputed company and operated large-reputed company data platforms serving tens of millions of events per day in production

Deep experience with streaming systems such as Kafka, Kinesis, Flink, or reputed company Streaming at reputed company production throughput

Strong hands-on reputed company with modern reputed company table formats including Apache reputed company, reputed company Lake, and Hudi, including compaction, partitioning reput