apache/airflow

Add SRV DNS record support to http connections about 9 hours ago

kind:feature good first issue provider:http

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

[AIP-94] airflowctl tasks: add state command about 16 hours ago

area:CLI kind:feature good first issue kind:meta area:airflow-ctl

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

DateTimeSensorAsync crashes Dag parsing with templated target_time + start_from_trigger=True 1 day ago

kind:bug good first issue provider:standard

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Separate JWT Secret Env from Standard Airflow Environment Variables 2 days ago

kind:feature good first issue area:helm-chart

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Move template-field validation/transformation out of operator __init__ (exemption-list burn-down) 2 days ago

area:providers good first issue kind:meta area:core-operators

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Use Kubernetes-recommended labels for airflow helm chart 3 days ago

kind:feature good first issue area:helm-chart

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Missing docs for logging 3 days ago

area:logging good first issue kind:documentation contributors-workshop

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

ReDoS in SparkSubmitHook._mask_cmd() via user-controlled application_args (apache-airflow-providers-apache-spark) 3 days ago

kind:bug area:providers good first issue provider:apache-spark

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Allow jinja templating connection ids for all third party operators 4 days ago

kind:feature good first issue

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Update Security model documentation to explain our approach for sensitive data exposure over API 5 days ago

good first issue kind:documentation

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Add Support for Filtering DAGs by Timetable Type 6 days ago

kind:feature area:API good first issue area:UI

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

DatabricksRunNowOperator always pass parameters to Databricks Job 6 days ago

kind:bug area:providers good first issue provider:databricks

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Update SQLAlchemy documentation links from 1.4 (en/14) to 2.0 (en/20) 6 days ago

good first issue kind:documentation

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Support Native Kubernetes sidecars in our Chart 7 days ago

good first issue area:helm-chart kind:meta

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Sensitive data from extra fields is visible in Edit Connection window 9 days ago

kind:feature good first issue area:core area:UI

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Hide "Run with latest bundle version" checkbox for non-versioned bundles when clearing 9 days ago

kind:bug good first issue area:UI affected_version:3.2

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Optional support for static Extra Links without XCom dependency 11 days ago

kind:feature good first issue area:core needs-triage

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

DAG-level `on_failure_callback` never fires 11 days ago

kind:bug good first issue area:core needs-triage affected_version:3.1

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Feature request: Add deferrable support for invoking/waiting on Google Cloud Functions / Cloud Run functions 12 days ago

provider:google area:providers kind:feature good first issue

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

dagProcessor in helm chart doesn't have a labels section 13 days ago

kind:feature good first issue area:helm-chart

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Five "otel_*" options appear twice in the "Configuration Reference" 13 days ago

kind:bug good first issue kind:documentation needs-triage

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

SQLExecuteQueryOperator not timing out within expected timeframe 15 days ago

kind:bug area:providers good first issue provider:common-sql needs-triage

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Databricks: add SQL endpoint operators 15 days ago

area:providers kind:feature good first issue provider:databricks

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Databricks: sensor for jobs 15 days ago

area:providers kind:feature good first issue provider:databricks

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

control state of individual taskflow in mapped task-group 17 days ago

kind:feature good first issue area:dynamic-task-mapping area:TaskGroup

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Improve default task failure email template for readability and operational clarity 17 days ago

area:providers kind:feature good first issue provider:smtp

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

AIP - 68 AI Rules for templated react projects 17 days ago

kind:feature good first issue type:improvement

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Define translation agent skill guidelines for Arabic (ar) locale 18 days ago

good first issue area:translations translation:ar

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

AIP-82: Add common messaging system providers 19 days ago

provider:google provider:microsoft-azure provider:amazon kind:feature good first issue kind:meta provider:redis AIP-82

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Google Stackdriver Logging not working as expected 20 days ago

kind:bug provider:google area:providers area:logging good first issue

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Hash Virtual Environment Cache Based on Actual Package Versions in `PythonVirtualEnvOperator` 20 days ago

kind:feature good first issue area:core provider:standard

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

SSHRemoteJobOperator: inconsistent "remote_base_dir" validation 21 days ago

kind:bug area:providers good first issue provider:ssh

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Add dag run deadlines to API and UI 21 days ago

kind:feature area:API good first issue area:UI area:deadline-alerts

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Add missing test modules in our unit test suite 22 days ago

good first issue kind:meta

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Calling a BigQuery Stored Procedure aggregates all inputs & outputs at the Airflow Task level 25 days ago

provider:google area:providers kind:feature good first issue provider:openlineage

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Airflow 3.0.x : Bring back from Airflow 2.x "Status of all previous DAG runs" column in DAGS main page 25 days ago

kind:feature good first issue area:UI

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Secrets with slashed IDs return AirflowNotFoundException 26 days ago

kind:bug area:API good first issue area:core affected_version:3.1

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Creating a backfill via Airflow API results in internal server error if SQLite is used 27 days ago

kind:bug area:API good first issue area:core area:backfill

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Enable kubernetes_pod_operator to reattach_on_restart when the worker dies about 1 month ago

area:providers kind:feature good first issue provider:cncf-kubernetes

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

XCom unable to parse tuple response from DatabricksSQLOperator on SQL query execution about 1 month ago

kind:bug area:providers good first issue provider:databricks

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Migrate exasol provider to pyexasol 2.x and remove the <2 cap about 1 month ago

area:providers good first issue provider:exasol

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Dataset DEL/POST API should also check the access_control at DAG level if defined about 1 month ago

kind:bug area:API good first issue priority:low

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Deferrable BeamRunPythonPipelineOperator (DataflowRunner) fails with "400 Request must contain a job and project id" when launcher stdout has no job-id line about 1 month ago

kind:bug provider:google area:providers good first issue provider:apache-beam

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Airflow UI shows Internal Server Error when the user is deleted from airflow about 1 month ago

kind:bug area:providers good first issue provider:fab

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

ExternalTaskSensorTrigger ignores poke_interval and polls every 2 seconds with excessive logging while using deferrable=True about 1 month ago

kind:feature good first issue area:async-operators

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Kubernetes Pod Operator fails with 404 errors when pods are preempted by daemonsets about 1 month ago

kind:bug area:providers good first issue provider:cncf-kubernetes

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Support HPA and topologySpreadConstraints for apiServer about 1 month ago

kind:bug kind:feature good first issue area:helm-chart Stale Bug Report

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Add deferrable mode to SFTPOperator about 1 month ago

area:providers kind:feature good first issue provider:sftp

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

airflow/utils/email.py def send_mime_email doesn't take all values from connection about 1 month ago

kind:bug good first issue area:core

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Add `airflow db clean-all-expired-sessions` ? command about 1 month ago

good first issue kind:meta

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Provide configuration option to configure path of OTEL metrics exporter about 1 month ago

kind:feature good first issue telemetry

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

[Helm Chart] Support multiple DagProcessors about 1 month ago

kind:feature good first issue area:helm-chart

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

EksPodOperator deferrable=true pause, restart and then wait until completion about 1 month ago

kind:bug provider:amazon area:providers good first issue pending-response

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Parity with Airflow2 run_conf displayed in dag run list about 1 month ago

kind:feature good first issue area:UI

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

"Suggest a change on this page" button bug/change request about 1 month ago

kind:bug pinned good first issue kind:documentation needs-triage

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

[Filters] Add filters to DAG View - Backfills Tab about 1 month ago

kind:feature good first issue kind:meta area:UI

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Grid pop-up of start/queue time is inconsistent about 1 month ago

kind:bug good first issue area:UI

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Allow search and filter by tags in dag run table about 1 month ago

area:webserver kind:feature good first issue area:UI

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Airflow Databricks Operator Task Group Launch Task Not Properly Waiting for Upstream Tasks about 1 month ago

kind:bug area:providers good first issue provider:databricks

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

BranchingOperator fails when using custom backend xcom deserialization with NoCredentialsError about 1 month ago

kind:bug area:providers good first issue provider:standard

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

`GET /auth/roles/list/` → **500** getnerate TypeError in Airflow 3.2.2 about 1 month ago

area:providers good first issue area:auth provider:fab affected_version:3.2

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

XCom.get_value() via SDK fails in extra link plugin with SUPERVISOR_COMMS ImportError about 1 month ago

kind:bug good first issue area:core

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Add a time range selector for the Gantt view about 1 month ago

good first issue type:new-feature area:UI

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Can't select the desired dag version for a backfill dag run about 2 months ago

kind:bug good first issue area:core area:backfill

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Connection port field does not validate that the value is a valid port number about 2 months ago

kind:bug good first issue area:core

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Remove export functionality from UI / Public API about 2 months ago

kind:feature area:API good first issue area:UI

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

`Dag Runs` and `Task Instance` list view have inconsistent padding about 2 months ago

kind:bug good first issue area:UI

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Simplify translation files by using nesting about 2 months ago

kind:feature good first issue area:UI

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Ability to annotate DAG's source (repo, tag, commit, etc) about 2 months ago

kind:feature good first issue area:task-sdk

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Trigger DAG modal: two-column layout for params (label left, control right) about 2 months ago

kind:feature good first issue area:UI

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

DAG Import Errors message is dangling in web-interface about 2 months ago

kind:bug area:MetaDB good first issue area:core

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Add e2e testing for "dag.test()` about 2 months ago

good first issue kind:meta area:core

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Dynamic DAG parameter options based on external configuration (dropdown / radio support) about 2 months ago

kind:feature good first issue area:UI

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Add REST API metrics (latency, QPS, errors) about 2 months ago

kind:feature area:API good first issue

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Re-add feature to use `use_airflow_context` in venv operators about 2 months ago

kind:feature good first issue kind:meta provider:standard

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Asset Event Details Page about 2 months ago

kind:feature good first issue area:UI area:data-aware-scheduling

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

[Filters] Add filters to Asset View about 2 months ago

kind:feature area:API good first issue area:UI

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Enable Streaming from SFTP to GCS in `SFTPToGCSOperator` about 2 months ago

provider:google area:providers kind:feature good first issue provider:sftp

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

LlamaIndexEmbeddingOperator returns vector=None for every chunk about 2 months ago

kind:bug area:providers good first issue provider:common-ai

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

KubernetesPodOperator dry_run failure about 2 months ago

kind:bug area:providers good first issue provider:cncf-kubernetes needs-triage

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

StartFromTrigger doesn't work with templated fields about 2 months ago

kind:bug good first issue area:core affected_version:3.0

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Typo in EdgeExecutor architecture diagram about 2 months ago

good first issue kind:documentation type:doc-only

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Mapped tasks not started hard to reach from mapped task view about 2 months ago

kind:bug good first issue area:UI area:dynamic-task-mapping

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

XCom view in grid has too many columns about 2 months ago

kind:bug good first issue area:UI

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Include debug information in more dagbag warnings about 2 months ago

kind:feature good first issue

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Add your Company to Airflow Users list about 2 months ago

good first issue kind:documentation

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Allow passing config_path as a parameter to KubernetesExecutor about 2 months ago

kind:feature good first issue provider:cncf-kubernetes

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Add support for Snowflake Workload Identity Federation about 2 months ago

area:providers kind:feature good first issue provider:snowflake

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Show dag run note in UI about 2 months ago

kind:feature good first issue area:UI

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Add support for extra JDBC parameters for Hive Client Wrapper in apache-hive provider about 2 months ago

kind:feature good first issue provider:apache-hive

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

HttpOperator: deferrable=True may send duplicate requests on Triggerer restart 2 months ago

kind:bug area:providers good first issue provider:http

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

OpenLineage provider emits warning about use of fork() on Python 3.12 2 months ago

kind:bug area:providers good first issue provider:openlineage

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Dag version: Graph view is not updated correctly when user switches versions from the drop-down 2 months ago

kind:bug Can't Reproduce stale good first issue pending-response area:UI affected_version:3.0

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Kerberos : switch MIT to Heimdal 2 months ago

kind:feature good first issue area:core

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Dashboard summary page shows wrong percentages when a state count exceeds the API cap (1000) 2 months ago

kind:bug area:API good first issue area:UI affected_version:3.2

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Pool slot chart is misleading when deferred tasks don't consume slots 2 months ago

kind:bug good first issue area:core area:UI

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Track SparkSubmitHook Yarn Cluster application with Yarn CLI 2 months ago

area:providers kind:feature good first issue provider:apache-spark

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

UI: Unpin @chakra-ui/react (currently capped at ~3.34.0) 2 months ago

good first issue area:UI

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Metric dag.dag_id.task_id.queued_duration missing 2 months ago

kind:bug good first issue area:metrics area:core priority:upgrade_to_airflow3 affected_version:3.1

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Tasks that are running when a DAG run reaches its timeout should optionally support `on_killed` 2 months ago

area:Scheduler kind:feature good first issue

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Open Issues Need Help