Principal Data Engineer (Kukatpally)

Key Responsibilities: - Build, and optimize scalable data pipelines and ETL/ELT workflows for large, complex datasets - Design and implement foundational data architecture supporting identity resolution and ID graph systems - Develop and enhance systems supporting identity resolution and ID graph construction (data ingestion, normalization, matching, and deduplication) - Process and unify multi-source datasets (cookies, device IDs, behavioral data, third-party and proprietary data) - Write efficient, testable, and maintainable code using Python and SQL for large-scale data processing - Optimize data models, queries, and storage strategies for performance, scalability, and cost efficiency - Build and maintain data validation, monitoring, and alerting systems to ensure data quality and reliability - Troubleshoot, debug, and improve existing data pipelines and infrastructure - Own and drive complex data problems end-to-end, from initial design through production deployment - Make and influence key technical decisions related to data architecture, scalability, and system design - Collaborate with data, platform, DevOps, and product teams to deliver scalable, production ready solutions - Translate business and product requirements into practical, performant data solutions - Document data pipelines, systems, and workflows clearly - Continuously improve system performance, data quality, and pipeline resilience. - Contribute to building current capabilities that improve how customers understand and leverage data insights. Key Requirements: - 8-12+ years of hands-on experience in data engineering or large-scale data processing - Proven experience building and maintaining production-grade data pipelines and distributed systems - Demonstrated experience architecting and delivering large-scale data platforms or mission critical data systems - Strong expertise in: o SQL and relational databases (Postgres, BigQuery, Redshift, etc.) Python for data processing and analysis - Experienc