Job Description
We are looking for a Senior GCP Data Engineer
Mission
Design, implement, and optimize end-to-end data solutions on Google Cloud Platform that drive our analytics and decision-making capabilities.
Key Responsibilities
- CI/CD Pipeline Optimization: Architect and refine continuous integration/continuous deployment pipelines using Cloud Build for automated, secure, and efficient releases.
- ETL Pipeline Development: Build and tune ETL pipelines in BigQuery, ensuring high-performance ingestion from SDDS and robust transformation logic.
- Batch Ingestion Management: Enhance scheduled queries, delta loads, and performance-tuned batch processes in BigQuery.
- Troubleshooting & Incident Response: Establish advanced monitoring, logging, and alerting strategies to quickly diagnose and resolve failed refresh jobs.
- Event-Driven Processing: Design scalable,...