Job Description
About:
The Data Engineer extracts, combines, transforms, loads, manipulates and cleanses data all whilst effectively handling interfaces to large amounts of data and creates/integrates data structures suitable for analysis.
The Data Engineer must understand data architecture and data management. Develop and deploys algorithms in performance-efficient code in analytical and data platforms. Liaise with enterprise architects, data governors, and subject matter experts to fill any gaps in the requirements or design.
Core Responsibilities:
• Works and experiments with state-of-the-art data storage and processing technologies.
• Builds large-scale batch and real-time data pipelines with data processing frameworks in cloud platforms or on-premise
• Leverages best practices in continuous integration and delivery
• Pre-process, clean and structures data to facilitate data exploration and advanced a...