Databricks Platform Manager / Engineer

Job Title: Databricks Platform Engineer

Experience: 5 to 12 Years

Location: Remote

Design, deploy, and manage Databricks workspaces across Dev, Test, UAT, and Production.

Administer and optimize Databricks clusters, cluster policies, instance pools, and job clusters.

Manage platform upgrades, Databricks Runtime (DBR) versions, and environment standardization.

Implement enterprise security using AWS IAM, SSO, service principals, PATs, and secret scopes.

Administer Unity Catalog, RBAC, governance, and compliance controls.

Enable CI/CD using Git, Databricks Repos, Terraform, and DevOps tools.

Monitor platform health, troubleshoot production issues, and perform root cause analysis.

Drive cloud cost optimization and compute efficiency.

Configure audit logging and ensure compliance with enterprise security standards.

Required Skills

✅ Databricks Workspace Administration

✅ Unity Catalog & RBAC

✅ Cluster Management & Cluster Policies

✅ Instance Pools & Job Clusters

✅ Databricks Runtime Management

✅ AWS (IAM, S3, CloudWatch, KMS, VPC, EC2, Security Groups)

✅ Git, CI/CD, Terraform (Infrastructure as Code)

✅ Databricks Repos

✅ Platform Monitoring & Production Support

✅ Cost Optimization & Incident Management