Databricks Data Platform Engineer/Architect

Project description

We are seeking an expert with deep proficiency as a DataBricks Platform Engineer, possessing experience in data engineering. This individual should have a comprehensive understanding of both data platforms and software engineering, enabling them to integrate the platform effectively within an IT ecosystem.

Responsibilities

• Manage and optimize Databricks data platform.
• Ensure high availability, security, and performance of data systems.
• Provide valuable insights about data platform usage.
• Optimize computing and storage for large-scale data processing.
• Design and maintain system libraries (Python) used in ETL pipelines and platform governance.
• Optimize ETL Processes - Enhance and tune existing ETL processes for better performance, scalability, and reliability.

SKILLS

Must have

• Minimum 10 Years of experience in IT/Data.
• Minimum 3 y...