Job Description
Embark on a rewarding journey as a Senior Data Engineer in Toronto, ON. With a focus on migrating complex data pipelines to AWS, leverage your Python and PySpark skills while working a hybrid schedule.
This 6-month contract role in the Investments Industry demands a highly autonomous Data Engineer with 8-10+ years of experience. You will be involved in transforming existing Databricks pipelines and optimizing them for AWS. Collaborate with stakeholders and ensure production readiness as you design scalable data solutions.
Key Responsibilities:
• Migrate Databricks Spark pipelines to AWS EMR
• Optimize data pipelines for performance and scalability
• Structure and store data using Parquet and Iceberg
• Improve legacy data pipelines over time
• Ensure production monitoring and orchestration readiness
Requirements:
• 8-10+ years of Data Engineering experience
• Strong expertise in Python and PySpark
• Deep knowledge of Apache Spark in distributed systems
This 6-month contract role in the Investments Industry demands a highly autonomous Data Engineer with 8-10+ years of experience. You will be involved in transforming existing Databricks pipelines and optimizing them for AWS. Collaborate with stakeholders and ensure production readiness as you design scalable data solutions.
Key Responsibilities:
• Migrate Databricks Spark pipelines to AWS EMR
• Optimize data pipelines for performance and scalability
• Structure and store data using Parquet and Iceberg
• Improve legacy data pipelines over time
• Ensure production monitoring and orchestration readiness
Requirements:
• 8-10+ years of Data Engineering experience
• Strong expertise in Python and PySpark
• Deep knowledge of Apache Spark in distributed systems