Azure Databricks DevOps Engineer
B
Boardroom Appointments
📍 Centurion, Gauteng, South-Africa
Job Description
About the job Azure Databricks DevOps Engineer
- Databricks Management : Deploy, configure, and maintain Azure Databricks environments, ensuring scalability, security, and efficiency.
- Infrastructure Automation : Implement and manage IaC using Terraform, ARM templates, or Bicep to automate cloud resource provisioning.
- CI/CD Pipelines : Develop and manage CI/CD pipelines using tools like Azure DevOps, GitHub Actions, Jenkins to automate data pipeline deployments.
- Monitoring & Logging : Set up and maintain monitoring solutions using Azure Monitor, Log Analytics, and Application Insights for proactive issue resolution.
- Security & Compliance : Implement best practices for security, governance, and compliance, including RBAC, encryption, and network security policies.
- Data Integration & Optimization : Work with Data Engineers to optimize ETL pipelines, ensuring high performance and...