Astronomer/Airflow Architect

Overview

EVP- Business Development and Strategy at 360 Technology LLC

Responsibilities

• Help guide a small group of technologists in their Apache Airflow journeys, including identifying new use cases and onboarding new domain teams.
• Review, optimize, and tune data ingestion and extraction pipelines orchestrated by Airflow.
• Development of frameworks to manage and engineer a large number of pipelines for the entire domain.
• Build architecture, data flow, and operational diagrams and documents, with detailed physical and logical layers.
• Provide reference implementations of various activities, including composing data pipelines in Airflow, implementing new Airflow features, or integrating Airflow with 3rd party solutions.
• Keep up with the latest Astro and Airflow features, in order to better advise the technologies on impactful improvements they can make.
• Collaborate to build reusable assets, automation...