Job Description
Key Responsibilities
- Design, build, and operate robust ingestion pipelines for batch and near-real-time data using AWS-native services
- Implement CDC-based ingestion patterns for databases, SaaS platforms, and external partners
- Standardize ingestion frameworks for files, APIs, event streams, and cross-account data sharing
- Define and maintain raw and staging data models that preserve source fidelity and lineage
- Partner with source system owners to define ingestion SLAs, contracts, schemas, and change management strategies
- Ensure ingestion pipelines meet data quality, observability, and reliability standards
- Implement metadata capture, schema evolution handling, and data validation at ingestion time
- Automate infrastructure using AWS CDK and integrate CI/CD pipelines via CodeCommit and CodePipeline
- Optimize ingestion workflows for scalability, cost efficiency, and fault tolerance
- Support Agile delivery and collaborate closely with offshore ...
- Design, build, and operate robust ingestion pipelines for batch and near-real-time data using AWS-native services
- Implement CDC-based ingestion patterns for databases, SaaS platforms, and external partners
- Standardize ingestion frameworks for files, APIs, event streams, and cross-account data sharing
- Define and maintain raw and staging data models that preserve source fidelity and lineage
- Partner with source system owners to define ingestion SLAs, contracts, schemas, and change management strategies
- Ensure ingestion pipelines meet data quality, observability, and reliability standards
- Implement metadata capture, schema evolution handling, and data validation at ingestion time
- Automate infrastructure using AWS CDK and integrate CI/CD pipelines via CodeCommit and CodePipeline
- Optimize ingestion workflows for scalability, cost efficiency, and fault tolerance
- Support Agile delivery and collaborate closely with offshore ...