- I miss the airflow ui to monitor the workflow execution, clear failed tasks, its pre built notifications, emails and so on.
- Passing state between step functions is a bit tricky tbh. I found airflow’s way a little more straightforward.
- Step functions seem to scale better, especially when you aim to use it for dynamic workflows. The recent update of step functions where you can literally use any aws service api (compared to a couple weeks ago where you were restricted to around 10 and then you only had lambdas) minimises its weaknesses imo.
Ya, the new Step Function service integration feature is awesome, really seals the deal for Step Function being the orchestration tool if you are in AWS.
- I miss the airflow ui to monitor the workflow execution, clear failed tasks, its pre built notifications, emails and so on.
- Passing state between step functions is a bit tricky tbh. I found airflow’s way a little more straightforward.
- Step functions seem to scale better, especially when you aim to use it for dynamic workflows. The recent update of step functions where you can literally use any aws service api (compared to a couple weeks ago where you were restricted to around 10 and then you only had lambdas) minimises its weaknesses imo.