Data Engineer - Data Structuring
I
IO TECH SOLUTIONS LIMITED
📍 Hong Kong, Hong Kong Island, Hong Kong
Job Description
Role Overview
We are seeking a Senior Data / Streaming Engineer with 5–7 years of experience to design, build, and operate scalable real-time and batch data processing platforms. The role focuses on stream processing, cloud-native data pipelines, and analytics systems running on AWS.
You will work closely with data, platform, and product teams to deliver reliable, high-performance data solutions supporting real-time analytics, monitoring, and downstream consumption.
Key Responsibilities
- Design, develop, and maintain real-time stream processing applications using Apache Flink / PyFlink and Spark, including state management and event-time processing with watermarks.
- Build and optimize Python-based data pipelines using libraries such as Pandas, Polars, boto3, and PyArrow