Job Description
Role: Azure Databricks Admin
\n
Location: Hartford, CT, Houston, TX, Indianapolis, IN, Pittsburgh, PA, Raleigh, NC, Richardson, TX
\n
Type- Fulltime
\n
\n
Required Skill and Experience
\n
• Architecture and administration experience with Microsoft Azure Databricks
\n
• Experience with platform automation, DevOps, and CI/CD pipelines
\n
• Knowledge of cloud security, networking, and identity management
\n
• Establish platform monitoring, observability, and automated alerting frameworks for Azure Databricks platform components
\n
• Platform automation through Infrastructure-as-Code using Terraform, DevOps, and CI/CD pipelines.
\n
• Implement capacity planning, disaster recovery, and high availability strategies.
\n
• Expertise in managing Unity Catalog, and data access control mechanisms.
\n
• Experience of managing Databricks cluster policies, instance pools, autoscaling, auto-termination, and compute governance
\n
• Support platform upgrades, runtime migrations, and feature enablement.
\n
• Administer Azure Databricks workspaces across Development, QA, Production & DR environments.
\n
• Integrate Azure Databricks with Microsoft Entra ID (Azure AD).
\n
• Manage RBAC, SCIM provisioning, user lifecycle management, and group synchronization.
\n
• Implement and maintain Unity Catalog permissions and governance policies.
\n
• Configure Key Vault-backed secret scopes and credential management.
\n
• Support secure networking using:
\n
• Private Endpoints
\n
• VNET Injection
\n
• NSGs
\n
• Firewall Rules
\n
• Managed Identities
\n
• Implement enterprise governance standards using Unity Catalog.
\n
• Maintain audit logging and compliance reporting.
\n
• Troubleshoot platform, cluster, notebook, and job execution issues.
\n
• Establish operational runbooks, incident management procedures, and SLA monitoring.
\n
• Implement cluster policies to control costs and prevent resource overprovisioning.
\n