Job Description
ESSENTIAL SKILLS:
- Strong experience with Python (Python 3.x) and PySpark for developing data processing jobs.
- At least 3 years’ experience with AWS services commonly used by data engineers, such as Athena, Glue, Lambda, S3 and ECS.
- Hands-on experience with NoSQL databases such as DynamoDB and relational databases (Oracle/PostgreSQL) including strong Oracle SQL skills.
- Experience with Oracle Cloud Infrastructure (OCI) services and tooling for databases, storage, and data processing.
- Expertise in data formats and schema design, including Parquet, AVRO, JSON, XML and CSV, and technical data modelling (“not drag and drop”).
- ETL and data pipeline development experience, including building pipelines with AWS Glue or similar platforms.
- Experience with containerization and orchestration technologies such as Docker (Kubernetes/OpenShift advantageous).
- Proficiency with script...