Job Description
Job Summary
We are looking for an Azure Databricks Administrator with hands-on experience in managing Databricks environments and working with Azure data services. The role involves setup, monitoring, and supporting data platforms while working closely with business teams.
Key Responsibilities
- Manage and maintain Azure Databricks workspaces, notebooks, and jobs
- Create workspaces and provide user access
- Configure and manage clusters (all-purpose, job, high concurrency)
- Monitor cluster performance and optimize costs
- Ensure data security and access control
- Integrate Databricks with:
- Azure Data Lake (ADLS)
- Azure Data Factory (ADF)
- Azure Synapse
- Set up CI/CD pipelines using Azure DevOps
- Support basic Terraform-based deployments
- Monitor workloads and troubleshoot issues
Required Ski...