Job Description
We're seeking an experienced Senior Data Engineer for a 6-month contract engagement with a leading public sector organization. This role requires deep expertise in Microsoft Azure, Data Engineering, Azure Data Factory (ADF), Databricks, Python, and SQL. You'll play a key role in designing and modernizing data pipelines and lakehouse structures within a collaborative Agile environment.
Key Responsibilities:Collaborate with product teams to analyze system requirements and design cloud-based data solutionsDesign and build data lakes and lakehouse structures using Azure-native toolsMigrate legacy pipelines from Synapse Analytics and ADF to modernized Databricks solutions using Delta LakeDevelop automated and scalable data pipelinesWork closely with IT teams to resolve issues and enhance analytics product usageContribute to the development of reusable frameworks and data engineering standards...