Job Description
Sr. DATA Engineer
Develop robust and efficient data processing applications using Scala. Work extensively with Hadoop and Spark frameworks to handle large-scale data sets. Seeking a specialist with 3 to 5 years of experience in Scala to design and develop big, scalable data solutions within the Hadoop and Spark ecosystem. Utilize SparkSQL for querying and transforming data to meet business requirements. Collaborate with cross-functional teams to design and implement scalable data pipelines. Optimize existing data workflows and improve system performance. Ensure code quality by following best practices and conducting thorough testing. Stay updated with emerging technologies in big data and Scala development.
Roles and Responsibilities
- Design, develop and maintain scalable big data solutions leveraging Scala and Spark.
- Implement complex data processing logic and algorithms to support analytics and reporting needs.
- Troubleshoot a...