Scenario like this would happen once in a while so I assume that your motivation will be to schedule maintenance while doing an upgrade.

In our case, we baked an Airflow image which contains plugins so the maintenance can happen more frequently but still we wouldn't do the upgrade while the Airflow is in use.