Job Description
10+ years of experience in Data Discovery & Analysis, Data Quality and Data Integration
7+ years of experience in designing and building Realtime, near realtime and batch data processing Pipelines
Worked on the data migration / data warehousing projects on cloud mainly Azure
Should be able to debug and understand existing ETL and write new ETL’s pipelines
Hands-on experience with data ingestion and data transformations using Azure Data Factory, Data Bricks, Synapse and other Azure services
Good understanding of data governance framework and tools
Experience in building architecture frameworks, debugging the data pipelines for performance issues and providing the solution for the same
Experience in building metadata driven pipelines
Good understanding and hands on experience on some of the Azure components related to data (DataBricks, Data Lake, Purview, Synapse)
Understanding of the Power BI to create visualizations
...