Open source·Ready to start
This is an issue that is reserved for the Airflow Summit "Contributors" Workshop. This is denoted with the label contributors-workshop. Out of respect for the organizers and participants of this workshop, please do not implement a PR that addresses this issue. > > If this issue is still open following Airflow Summit,…
apache/airflow
Open source·Ready to start
3.0.3 After upgrading Airflow from version 3.0.2 to 3.0.3 sensitive data in extra fields and extra fields JSON is visible in edit connection page. Sensitive data should be masked with Enter Edit Connection window in Airflow UI. Ubuntu 24.04 Other Docker-based deployment Airflow deployed with Docker Swarm. Settings in…
apache/airflow
Open source·Ready to start
Enable breeze to utilize podman for container management. Given the open source nature, lack of licensing issues, OCI-compliant images, and improved security and performance, enable podman as a container management option for breeze tooling.
apache/airflow
Open source·Ready to start
Currently, when using executor_config with KubernetesExecutor, the config_file path must be hardcoded. If we try to pass it dynamically using a Jinja template ("{{ params.config_path }}"), it results in an error. Example of a working static configuration: However, if we attempt to pass it dynamically, it fails: This w…
apache/airflow
Open source·Ready to start
3.0.0 I am making a bunch of edits to a dag, and I want to re-run a backfill for a specified date range. When I do, Airflow performs the backfill with the version of the dag that originally ran, and there's seemingly no way in the UI to specify that I want to re-run using the latest dag version. The latest version sho…
apache/airflow
Open source·Ready to start
https://github.com/chartdb/chartdb is very popular project and generate nice ERD schemas (~though not sure if we can use it due to AGPL-3.0 license ?~) We should update our generation script to use it Note: This library is to be used only for development. We are not distributing it to users thus we are OK with having…
apache/airflow
Open source·Ready to start
Other Airflow 2 version (please specify below) 2.10.2 We have this message in the Airflow's web-interface no matter what. This DAG can exist or not - the error still shows. We have found many different topics across the Internet for various Airflow versions. Some of them from 2018. So users constantly witness these da…
apache/airflow
Open source·Ready to start
related: #49938 Several users have pointed out that the Event-Driven Scheduling feature introduced in Airflow 3 currently supports only Amazon SQS. So I add Kafka common message queue provider in #49938, but there are still quite a few common providers that should be useful for airflow users to implement Event-Driven…
apache/airflow
Open source·Ready to start
github I want to connect to a remote kernel in JupyterHub. Issue #34840 seems to provide access with transport set to "transport". I would like to make access throught https and token. 2.9 ubuntu 20.04 Official Apache Airflow Helm Chart - create a papermill connection - try to connect with https host and aditional tok…
apache/airflow
Open source·Ready to start
Originally posted by ntnhaatj August 20, 2023 Hi, as my issue was raised here which also included depth-first execution model context, I would like to open an issue to have more discussion on this matter. motivated from the depth-first execution model implemented in mapped TaskGroup: At present, the upstream / downstr…
apache/airflow
Open source·Ready to start
2.9.1 When using the airflow dags backfill command to execute a backfill for any DAG, I noticed that the dag_id and executor_class columns in the job table are empty(null). Results in entries in the job table like this: However, in versions before 2.6.0, the entries in the job table included the dag_id and executor_cl…
apache/airflow