Home/Job List/Databricks Solution Architect
CRIF India

Databricks Solution Architect

CRIF India

Pune, Maharashtra, India
Full-Time
Posted 13 days ago

Job Description & Responsibilities

Own the end-to-end architecture of the Databricks Lakehouse platform on AWS — the landing zone, governance model, integration with the operational data layer, and the standards every engineering stream builds against. You will be the design authority and the point of technical escalation for the platform.

Key Responsibilities

  • Define and evolve the target Lakehouse architecture: medallion layers, catalog structure, storage strategy, compute topology.
  • Own the Databricks landing zone on AWS — workspaces, account structure, networking (PrivateLink, NCC, VPC design), encryption and key management.
  • Design the Unity Catalog governance model: metastore layout, external locations, storage credentials, access control, lineage and audit.
  • Architect integration between the operational store (DynamoDB) and the analytical Lakehouse, including streaming, replay and consistency semantics.
  • Set standards for data modelling, table formats (Delta/Iceberg), naming, CI/CD, environment promotion and code quality.
  • Own platform cost architecture — DBU consumption modelling, commitment planning, compute policies, chargeback and optimisation.
  • Define security and compliance posture for a multi-country BFSI footprint: data residency, PII handling, retention, regulatory audit readiness.
  • Lead architecture reviews, produce decision records and defend design choices to senior stakeholders and global review boards.
  • Mentor engineering, ML and BI streams; unblock complex technical problems.

Must-Have Skills

  • Deep Databricks architecture expertise — Unity Catalog, Delta Lake, workspace and account administration, serverless and classic compute.
  • Strong AWS architecture: VPC and hybrid networking, PrivateLink, IAM and cross-account trust, S3, Glue, Lake Formation, KMS.
  • Large-scale distributed data architecture and Spark internals.
  • Proven experience designing platforms handling high-volume, low-latency and multi-tenant workloads.
  • Data governance, security and regulatory compliance in a financial-services context.

Good to Have

  • Databricks Certified Data Engineer Professional and/or Databricks Platform Architect accreditation.
  • AWS Solutions Architect Professional.
  • Multi-cloud experience — Azure Databricks, cross-cloud commitment models.
  • Terraform / infrastructure-as-code for Databricks and AWS.

Additional Info

  • Comfortable working in a regulated, audit-heavy environment with strict change control.
  • Collaborative working style across engineering, product, risk and country teams.
  • Willingness to work with distributed/global stakeholders across time zones.

Required Skills

AWSAzureCI/CDTerraformMachine Learning

Job Details

Employment TypeFull-Time
Work ModeOn-Site
Experience0 – 0 years
Positions1

Posted by

N/A

Posted on:

5 Nov 2026

About CRIF India

More open roles

Browse all jobs →