Job Description
As an Associate Data Engineer you will be enabling the business by providing data, reporting and analytics solutions, through developing and supporting Data Ingestion and transformation in the InsuranceData Platform (IDP), Azure Databricks.
What will you be doing?
Identifying Data Sources: Identifying, researching, and understanding new data sources for the Insurance Data Platform (IDP).
Connecting and Monitoring: Connecting to new data sources, and monitoring and maintaining data flows.
Documenting Processes: Documenting all processes and data objects as part of the ingestion process.
Creating Transformations: Creating and productionising data transformations while maintaining and monitoring transformation processes.
Providing Guidance: Offering guidance and advice in the provision of data for analytics and collaborating on building robust and sustainable models.