Data Engineer/ ML Ops Engineer

Key Responsibilities

• Design and develop scalable data pipelines across Hadoop (Hive, Impala, Spark, Kafka, Iceberg) and Teradata environments.
• Build ingestion and transformation frameworks using Java, Spark, Python and shell s.
• Develop full stack applications and internal tools using Python, Shell ing, and modern web frameworks (e.g., Flask, React).
• Create APIs and microservices to expose data and ML models securely to downstream systems and user interfaces.
• Collaborate with data scientists to operationalize ML models using Cloudera Machine Learning (CML)
• Build and deploy GenAI/LLM-powered applications for intelligent data interaction, summarization, and automation.
• Implement enterprise-grade security controls including RBAC, LDAP, Kerberos, Apache Ranger, and row-level access.
• Tune and optimize data applications for performance across Hadoop and Teradata, ensuring efficient resource utilization...