Skip to content

Remove dag processor from the scheduler - #45729

Merged
jedcunningham merged 5 commits into
apache:mainfrom
astronomer:remove_dag_processor_from_scheduler
Jan 20, 2025
Merged

Remove dag processor from the scheduler#45729
jedcunningham merged 5 commits into
apache:mainfrom
astronomer:remove_dag_processor_from_scheduler

Conversation

@jedcunningham

Copy link
Copy Markdown
Member

We will only support a standalone DAG processor. Doing so removes complexity from the scheduler, and offers better isolation between these two different workloads.

We will only support a standalone DAG processor. Doing so removes
complexity from the scheduler, and offers better isolation between these
two different workloads.
@jedcunningham jedcunningham added the full tests needed We need to run full set of tests for this PR to merge label Jan 17, 2025
@boring-cyborg boring-cyborg Bot added area:API Airflow's REST/HTTP API area:CLI area:Scheduler including HA (high availability) scheduler area:UI Related to UI/UX. For Frontend Developers. area:webserver Webserver related Issues kind:documentation labels Jan 17, 2025
@jedcunningham jedcunningham added legacy ui Whether legacy UI change should be allowed in PR legacy api Whether legacy API changes should be allowed in PR labels Jan 17, 2025
@jedcunningham jedcunningham reopened this Jan 17, 2025
@kaxil

kaxil commented Jan 17, 2025

Copy link
Copy Markdown
Member

Nice, look at all that deleted code 👨‍💻!!!

@kaxil

kaxil commented Jan 17, 2025

Copy link
Copy Markdown
Member

#protm

@potiuk

potiuk commented Jan 17, 2025

Copy link
Copy Markdown
Member

We'll have many good candidates this month

@jscheffl jscheffl left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cool.

This will be a hard choice for PR of the month in Jan 2025...

@jscheffl

Copy link
Copy Markdown
Contributor

Can you please add a newsfragment before merging because from deployment point of view it is a breaking change.

@jedcunningham
jedcunningham merged commit b081f66 into apache:main Jan 20, 2025
@jedcunningham
jedcunningham deleted the remove_dag_processor_from_scheduler branch January 20, 2025 17:52
dauinh pushed a commit to dauinh/airflow that referenced this pull request Jan 24, 2025
We will only support a standalone DAG processor. Doing so removes
complexity from the scheduler, and offers better isolation between these
two different workloads.
got686-yandex pushed a commit to got686-yandex/airflow that referenced this pull request Jan 30, 2025
We will only support a standalone DAG processor. Doing so removes
complexity from the scheduler, and offers better isolation between these
two different workloads.
niklasr22 pushed a commit to niklasr22/airflow that referenced this pull request Feb 8, 2025
We will only support a standalone DAG processor. Doing so removes
complexity from the scheduler, and offers better isolation between these
two different workloads.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:API Airflow's REST/HTTP API area:CLI area:Scheduler including HA (high availability) scheduler area:UI Related to UI/UX. For Frontend Developers. area:webserver Webserver related Issues full tests needed We need to run full set of tests for this PR to merge kind:documentation legacy api Whether legacy API changes should be allowed in PR legacy ui Whether legacy UI change should be allowed in PR

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants