Lead Data Engineer (Cloud)
C
Cyber Security training courses
📍 Preston, England, United-Kingdom
Job Description
Job Title: Lead Data Engineer (Cloud)
Location: Preston - We offer a range of hybrid and flexible working arrangements - please speak to your recruiter about the options for this particular role
Salary: £55,000 depending on skills and experience
What you’ll be doing:
- Building and operating ingestion pipelines into the lakehouse
- Developing Spark transformation jobs and reusable pipeline patterns
- Orchestrating workflows in Airflow (raw > bronze > silver > gold)
- Implementing manifest-driven transformation using JSON configuration stored in MongoDB or CosmosDB
- Maintaining Delta Lake tables and trouble shoot pipeline reliability/performance
Your skills and experiences:
- Deep understanding of modern data engineering principles , data lifecycle, and enterprise-scale architecture.
- Strong knowledge of data governance, metadata management , and quality frameworks, with...