Airflow

Installing Apache Airflow on Windows (Subsystem for Linux)

I am working my way through Data Pipelines with Apache Airflow, Second Edition: Orchestration for data and AI and there is a point early in the book where it is explained how to run airflow locally in a python environment. This turns out not to work on a windows machine as some dependencies for Airflow are not available. Instead what you can do is run Ubuntu on the Windows Subsystem for Linux (WSL). I’ll provide…

Continue reading