Job Description
Overview
Position Description
We are seeking an experienced Data Engineer with 7+ years of professional expertise in designing, developing, and optimizing large-scale data pipelines and data processing systems. The ideal candidate is highly skilled in Python, PySpark, ETL development, and modern cloud data engineering tools, particularly Databricks and Azure Data Factory (ADF). Experience in data ingestion, transformation, and extraction workflows is essential. Knowledge of Wealth Management domain data is a strong plus.
Responsibilities
- Design, build, and maintain scalable and robust data pipelines to support data ingestion, transformation, and analytics needs.
- Develop ETL/ELT processes using Python, PySpark, Databricks, and cloud-native tools.
- Build and optimize data ingestion frameworks from multiple structured and unstructured data sources.
- Implement and maintain data processing workflows in Azure Data Factory. <...