I write and maintain the software that manages data planes for Astro, a managed Apache Airflow product. This involves everything from control plane API layer, to Temporal service workers interacting with Cloud APIs, to the manifests that run on the Kubernetes based data planes. This software maintains all infrastructure and manifests for ~400 Kubernetes clusters across 3 cloud providers supporting ~2400 Airflow deployments. I work in about 60% Go, 20% YAML manifests, and 20% various other IaC languages.
- Kubernetes
- Go
- Apache Airflow
- Terraform
- Cloudformation
- Temporal
- Prometheus
- AWS
- GCP
- Azure