Job Description
We are seeking a highly skilled Senior Data Engineer with extensive experience in designing, building, and optimizing high-volume data pipelines. The ideal candidate will have strong expertise in Python, Databricks on Azure Cloud services, DevOps, and CI/CD tools, along with a solid understanding of AI/ML techniques and big data processing frameworks like Apache Spark and PySpark.
Responsibilities
Adhere to coding and Numerator technology standards
Build suitable automation test suites within Azure DevOps
Maintain and update automation test suites as required