While I have been using a simpler version in the past, it is only recently that I wrapped my head around how to simplify the creation–and really the maintenance–of upstream & downstream task dependencies in a DAG. The way I had been doing it involved writing these massive tuples with the task names over & […]
Tag: Tests
3 Easy Airflow Tests
I haven’t exactly found a wealth of information on how to test with Airflow. Here are 3 tests though that I’ve used with every single DAG that I’ve written. The first one does nothing more than verify that there are no syntax errors within the DAG file, the second one confirms the existence of and […]