Job Description
Join to apply for the Cloud Data Engineer role at Epergne Solutions .
Job Location: Singapore
Experience: 6-8 Years
Responsibilities
- Design and architect data storage solutions such as databases, data lakes, and data warehouses using AWS (S3, RDS, Redshift, DynamoDB) and Databricks Delta Lake.
- Build, manage, and optimize data pipelines for ingestion, processing, and transformation using AWS Glue, AWS Lambda, Databricks, and Informatica IDMC.
- Integrate data from various internal and external sources into AWS and Databricks environments while ensuring data quality and consistency.
- Develop ETL processes using Databricks (Spark) and Informatica IDMC for cleansing, transforming, and enriching data.
- Monitor and optimize data processing performance and queries to meet scalability and efficiency requirements.
- Implement security b...