Job Description
Description
ONSITE
Seeking a Data Engineer to build and optimize scalable data pipelines and platforms supporting enterprise analytics, reporting, and AI initiatives.
Responsibilities
+ Build ETL/ELT pipelines (batch & streaming)
+ Design scalable data architectures (Lakehouse, warehouse)
+ Ensure data quality, governance, and security
+ Optimize performance, cost, and reliability
+ Partner with analytics, BI, and engineering teams
Requirements
Skills
Data Platforms
+ Apache Spark (DataFrames, SQL, RDDs, streaming, tuning, Catalyst/Tungsten)
+ Delta Lake (ACID, MERGE, OPTIMIZE, Z-ORDER, CDC, time travel)
+ Databricks SQL (queries, views, UDFs)
+ Delta Live Tables (DLT), Jobs, Workflows
Architecture & Ingestion
+ Lakehouse (Medallion, partitioning, clustering, data contracts)
+ Auto Loader / Lakeflow (batch & streaming ingestion, CDC)
ONSITE
Seeking a Data Engineer to build and optimize scalable data pipelines and platforms supporting enterprise analytics, reporting, and AI initiatives.
Responsibilities
+ Build ETL/ELT pipelines (batch & streaming)
+ Design scalable data architectures (Lakehouse, warehouse)
+ Ensure data quality, governance, and security
+ Optimize performance, cost, and reliability
+ Partner with analytics, BI, and engineering teams
Requirements
Skills
Data Platforms
+ Apache Spark (DataFrames, SQL, RDDs, streaming, tuning, Catalyst/Tungsten)
+ Delta Lake (ACID, MERGE, OPTIMIZE, Z-ORDER, CDC, time travel)
+ Databricks SQL (queries, views, UDFs)
+ Delta Live Tables (DLT), Jobs, Workflows
Architecture & Ingestion
+ Lakehouse (Medallion, partitioning, clustering, data contracts)
+ Auto Loader / Lakeflow (batch & streaming ingestion, CDC)