Senior Spark & Python Developer
M
Mavens Guild
📍 McLean, Virginia, United States
Job Description
What we would like to see:
In a senior developer role, you will design and build data flow and data integration processes to enhance loss prevention technologies for a leading financing firm. Drawing from your vast hands-on experience in Python (PySpark), Spark, REST, Java, and Scala, you will develop, test, and deploy end-to-end solutions using full-stack development tools within AWS (EMR, S3) cloud based infrastructure.
A typical day as a Senior Spark Programmer:
- Develop fault tolerant, streaming as well as batch data integration processes using Spark/PySpark, Java and performance enhanced SQL
- Develop and lead development efforts of application programming interfaces to enable integration of fraud detection systems with a host of new reporting and data mining tools
- Design and develop automation of data flow tasks and end-to-end process te...