Apache Spark
Large-scale data engine for distributed computing, SQL execution, and performance optimization.
Hey there, friend using a screen reader. I've carefully labeled every button and image on this site. Hope you have a smooth experience. If anything is inconvenient, my email is in the footer — just let me know and I'll fix it. — Store Owner
Loading…
Searchable · Filterable · Traceable
Every item keeps its source, verification time, and eligibility notes. Filter by direction, difficulty, format, and deadline to find something you can act on now.
1 filters active
Page 2 of 2 · 47 items
Large-scale data engine for distributed computing, SQL execution, and performance optimization.
Student role at Databricks in Aarhus, Denmark. Check the official listing for responsibilities and eligibility.
Originally posted by ntnhaatj August 20, 2023 Hi, as my issue was raised here which also included depth-first execution model context, I would like to open an issue to have more discussion on this matter. motivated from the depth-first execution model implemented in mapped TaskGroup: At present, the upstream / downstr…
Student role at Databricks in Berlin, Germany. Check the official listing for responsibilities and eligibility.
Currently, when using executor_config with KubernetesExecutor, the config_file path must be hardcoded. If we try to pass it dynamically using a Jinja template ("{{ params.config_path }}"), it results in an error. Example of a working static configuration: However, if we attempt to pass it dynamically, it fails: This w…
Student role at Databricks in Berlin, Germany. Check the official listing for responsibilities and eligibility.
3.0.0 I am making a bunch of edits to a dag, and I want to re-run a backfill for a specified date range. When I do, Airflow performs the backfill with the version of the dag that originally ran, and there's seemingly no way in the UI to specify that I want to re-run using the latest dag version. The latest version sho…
Student role at Databricks in Amsterdam, Netherlands. Check the official listing for responsibilities and eligibility.
https://github.com/chartdb/chartdb is very popular project and generate nice ERD schemas (~though not sure if we can use it due to AGPL-3.0 license ?~) We should update our generation script to use it Note: This library is to be used only for development. We are not distributing it to users thus we are OK with having…
Student role at Databricks in Amsterdam, Netherlands. Check the official listing for responsibilities and eligibility.
Other Airflow 2 version (please specify below) 2.10.2 We have this message in the Airflow's web-interface no matter what. This DAG can exist or not - the error still shows. We have found many different topics across the Internet for various Airflow versions. Some of them from 2018. So users constantly witness these da…
Student role at Databricks in London, United Kingdom. Check the official listing for responsibilities and eligibility.
related: #49938 Several users have pointed out that the Event-Driven Scheduling feature introduced in Airflow 3 currently supports only Amazon SQS. So I add Kafka common message queue provider in #49938, but there are still quite a few common providers that should be useful for airflow users to implement Event-Driven…
Student role at Databricks in Amsterdam, Netherlands. Check the official listing for responsibilities and eligibility.
2.9.1 When using the airflow dags backfill command to execute a backfill for any DAG, I noticed that the dag_id and executor_class columns in the job table are empty(null). Results in entries in the job table like this: However, in versions before 2.6.0, the entries in the job table included the dag_id and executor_cl…
Student role at Databricks in San Francisco, California. Check the official listing for responsibilities and eligibility.
This is an issue that is reserved for the Airflow Summit "Contributors" Workshop. This is denoted with the label contributors-workshop. Out of respect for the organizers and participants of this workshop, please do not implement a PR that addresses this issue. > > If this issue is still open following Airflow Summit,…
Student role at Databricks in Bellevue, Washington; Mountain View, California; San Francisco, California. Check the official listing for responsibilities and eligibility.
github I want to connect to a remote kernel in JupyterHub. Issue #34840 seems to provide access with transport set to "transport". I would like to make access throught https and token. 2.9 ubuntu 20.04 Official Apache Airflow Helm Chart - create a papermill connection - try to connect with https host and aditional tok…
Student role at Databricks in Berlin, Germany. Check the official listing for responsibilities and eligibility.
Student role at Databricks in Belgrade, Serbia. Check the official listing for responsibilities and eligibility.
Student role at Databricks in Bellevue, Washington; Mountain View, California; San Francisco, California. Check the official listing for responsibilities and eligibility.
Student role at Databricks in Bellevue, Washington; Mountain View, California; San Francisco, California. Check the official listing for responsibilities and eligibility.