Job Description
KPI Partners is looking for a highly skilled Lead Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in managing and optimizing data pipelines, with strong expertise in Databricks, Airflow, AWS, and Pyspark. Job Title: Lead Data Engineer ((Databricks, Airflow, AWS, Pyspark)
Location: Hybrid – Hyderabad/Bangalore/Pune
Experience: 8+ years
Employment Type: Full-time
Key Responsibilities:
Lead the design, development, and maintenance of scalable data pipelines that power data analytics and reporting solutions.
Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and provide solutions that meet business needs.
Implement best practices for data engineering, including data quality, data governance, and performance optimization.
Utilize Databricks for data processing and transformation tasks, ensuring high efficiency and reliability.
Design and manage orchestration workf...
Location: Hybrid – Hyderabad/Bangalore/Pune
Experience: 8+ years
Employment Type: Full-time
Key Responsibilities:
Lead the design, development, and maintenance of scalable data pipelines that power data analytics and reporting solutions.
Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and provide solutions that meet business needs.
Implement best practices for data engineering, including data quality, data governance, and performance optimization.
Utilize Databricks for data processing and transformation tasks, ensuring high efficiency and reliability.
Design and manage orchestration workf...