Databricks Solution Architect
CRIF India
Pune, Maharashtra, India
Full-Time
Posted 13 days ago
Pune, Maharashtra, India
Full-Time
Posted 13 days ago
Job Description & Responsibilities
Own the end-to-end architecture of the Databricks Lakehouse platform on AWS — the landing zone, governance model, integration with the operational data layer, and the standards every engineering stream builds against. You will be the design authority and the point of technical escalation for the platform.
Key Responsibilities
- Define and evolve the target Lakehouse architecture: medallion layers, catalog structure, storage strategy, compute topology.
- Own the Databricks landing zone on AWS — workspaces, account structure, networking (PrivateLink, NCC, VPC design), encryption and key management.
- Design the Unity Catalog governance model: metastore layout, external locations, storage credentials, access control, lineage and audit.
- Architect integration between the operational store (DynamoDB) and the analytical Lakehouse, including streaming, replay and consistency semantics.
- Set standards for data modelling, table formats (Delta/Iceberg), naming, CI/CD, environment promotion and code quality.
- Own platform cost architecture — DBU consumption modelling, commitment planning, compute policies, chargeback and optimisation.
- Define security and compliance posture for a multi-country BFSI footprint: data residency, PII handling, retention, regulatory audit readiness.
- Lead architecture reviews, produce decision records and defend design choices to senior stakeholders and global review boards.
- Mentor engineering, ML and BI streams; unblock complex technical problems.
Must-Have Skills
- Deep Databricks architecture expertise — Unity Catalog, Delta Lake, workspace and account administration, serverless and classic compute.
- Strong AWS architecture: VPC and hybrid networking, PrivateLink, IAM and cross-account trust, S3, Glue, Lake Formation, KMS.
- Large-scale distributed data architecture and Spark internals.
- Proven experience designing platforms handling high-volume, low-latency and multi-tenant workloads.
- Data governance, security and regulatory compliance in a financial-services context.
Good to Have
- Databricks Certified Data Engineer Professional and/or Databricks Platform Architect accreditation.
- AWS Solutions Architect Professional.
- Multi-cloud experience — Azure Databricks, cross-cloud commitment models.
- Terraform / infrastructure-as-code for Databricks and AWS.
Additional Info
- Comfortable working in a regulated, audit-heavy environment with strict change control.
- Collaborative working style across engineering, product, risk and country teams.
- Willingness to work with distributed/global stakeholders across time zones.
About CRIF India
Required Skills
AWSAzureCI/CDTerraformMachine Learning
Job Details
Employment TypeFull-Time
Work ModeOn-Site
Experience0 – 0 years
Positions1
Posted by
N/A
Posted on:
5 Nov 2026
About CRIF India
More open roles
- Senior Software Engineer (Python/Node.JS , AWS)Autodesk · India
- Enterprise Cloud Software Engineer (Cloud Development, Azure/AWS, Ai Engineering)Wolters Kluwer · Pimpri-Chinchwad, Maharashtra, India
- Enterprise Cloud Software Engineer (Cloud Operations, AI Engineering, Azure/AWS)Wolters Kluwer · Chennai, Tamil Nadu, India
- Cloud Engineer – AWS & Server ManagementCloudLIMS · Indore, Madhya Pradesh, India
- DevOps Engineer - AWS, Terraform, Cloud FormationCONVERSE PLACEMENT SERVICES INDIA PRIVATE LIMITED · Hyderabad, Telangana, India
- Full Stack Developer (Angular, Java, Spring Boot, AWS, AI Tools))Baker Hughes · Pune, Maharashtra, India