Data Engineering- Azure Databricks- Manager

Industry/Sector

Not ApplicableSpecialism

Product InnovationManagement Level

ManagerJob Description & Summary

At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth.

In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and data transformation solutions.

Job Title

• Manager – Data Engineering (Azure & Databricks)
• At PwC AC, as a Manager in Data Engineering, you will play a pivotal role in leading the design, architecture, and end-to-end implementation of enterprise-grade cloud data solutions. You will lead cross-functional teams to deliver scalable Azure-based data ecosystems, bridging the gap between business strategy and technical execution. Beyond hands-on technical guidance, you will be responsible for defining architectural roadmaps, ensuring delivery excellence, managing stakeholder expectations, and driving innovation within our cloud data practice.
• This role requires a blend of deep technical expertise in the Azure Databricks stack and strong leadership capabilities to manage complex, multi-stream data migration and engineering programs.

Years of Experience

8–13 years

Position Requirements

Must Have

Technical Leadership

Extensive experience leading teams in the design and delivery of Azure-based data platforms utilizing ADLS, Databricks, Data Factory, and Synapse.

Architectural Expertise

Demonstrated ability to design robust, scalable, and secure data architectures. You should be capable of defining technical standards and best practices for data modeling and data management.

Cloud Proficiency

Advanced understanding of Big Data frameworks; deep hands-on and architectural experience with Spark and Hadoop ecosystems.

Data Lifecycle Ownership

Comprehensive knowledge of the Data Warehousing (DW) lifecycle. Proven experience in leading the creation of high-level and detail-level design documents, and defining strategy for Unit/Integration/UAT plans.

Delivery Management

Strong track record of owning end-to-end delivery of data migration projects, including scope management, risk mitigation, and resource planning.

Technical Proficiency

Mastery of advanced SQL, complex data transformations, and performance tuning. Proficiency in Python and Unix/Shell scripting for automation.

DevOps & CI/CD

Strategic understanding of DevOps implementation (Git, Jenkins, GitLab, Azure DevOps) to automate pipelines and ensure high-quality code delivery.

Stakeholder & Team Management

Excellent communication skills with the ability to advise senior client stakeholders, manage onsite/offshore teams, and mentor junior associates/engineers.

Operational Excellence

Experience in setting up operational frameworks, defining KPIs for data quality, and leading the transition to production (Operations Hand-off).

Good to Have

Certifications

Azure Data Engineer (DP-203) or Databricks Certified Data Engineer Professional.

Advanced Analytics

Knowledge of Big Data ML toolkits (SparkML, H2O) and experience building real-time stream-processing systems.

Serverless Architectures

Practical experience with Azure Functions and event-driven data architectures.

Strategic Consulting

Experience in pre-sales support, RFP responses, or presenting technical roadmaps to C-level or Director-level business stakeholders.

Professional and Educational Background

BE / B.Tech / MCA / M.Sc / M.E / M.Tech / MB The Opportunity

• When you join PwC Acceleration Centers (ACs), you step into a pivotal role focused on actively supporting various Acceleration Center services, from Advisory to Assurance, Tax and Business Services. In our innovative hubs, you’ll engage in challenging projects and provide distinctive services to support client engagements through enhanced quality and innovation. You’ll also participate in dynamic and digitally enabled training that is designed to grow your technical and professional skills.
• As part of the Data Engineering team you lead the design, architecture, and implementation of enterprise-grade cloud data solutions. As a Manager, you motivate and inspire teams to