Software/ Data Engineer
I
Infinity Consulting Solutions
📍 Boca Raton, Florida, United States
Job Description
We have partnered with our client in their search for a Software Engineer to support and develop our Databricks-based data platform during the development phase. This role focuses on building, improving, and validating reliability patterns early, rather than production firefighting. The ideal candidate is hands-on with Databricks, PySpark, Python, and has working knowledge of Azure cloud services. This role partners closely with Data Engineering teams to ensure solutions are scalable, efficient, and production-ready.
Responsibilities
* Develop and support Databricks notebooks, jobs, and workflows
* Write and optimize PySpark and Python code for data processing
* Assist in designing scalable and reliable data pipelines
* Apply Spark best practices (partitioning, caching, joins, file sizing)
* Work with Delta Lake tables and data models
* Perform data validation and quality checks during development
* Support cluster configurati...