Job Description
Job Description
:• Work as Data architect/Senior data engineer to design and develop cost effective and reliable data solutions on any cloud platform like Azure or AWS.
• Should be able to understand client requirements and convert them into technical solution leveraging cloud capabilities and modern technologies.
• Should be able to contribute into company’s internal innovation projects by conducting proof of concepts and developing frameworks using state of the art technologies.
• Should have prior experience in developing data pipelines using Pyspark, SQL and Python
• Should have good understanding of Snowflake and Azure cloud services like Synapse, Azure Databricks, Azure Data Factory, ADLS etc.
• Should have prior understanding of applying ETL and ELT concepts and principals especially when migrating data from any legacy system to modern cloud platform.
• Any experience in real time data processing using PySpark, Python and Kafka i...