[Job - 29253] Senior Data Developer (AWS), Brazil
C
CI&T
📍 Remote, Remote, Brazil
Job Description
Responsibilities
- Data Pipeline Development : Develop jobs in AWS Glue/Spark or Python (Pandas/Lambdas) for transforming raw data into curated datasets.
- Data Storage Structuring : Structure data in Amazon S3 (Data Lake) and integrate it with Vector Databases or Redshift to support advanced analytics.
- Data Processing : Handle both structured and unstructured data, ensuring it is processed into optimized formats (e.g., Parquet) for efficient querying and analysis.
- Orchestration Configuration : Configure workflows using AWS Step Functions or Managed Workflows for Apache Airflow (MWAA) to automate data processing tasks.
- Collaboration with Cross‑functional Teams : Work closely with data scientists, engineers, and business stakeholders to understand data needs and deliver high‑quality solutions.
- Performance Monitoring : Monitor and analyze data pipeline performance, ensuring relia...