fix(CLI): ensure no downtime on `push` possible

[maxktz]

I'm currently not completely sure that push would not cause downtime while using it in a CI pipeline. We gotta make sure it does not

[linear]

PAY-186