Artifact diffing error

Action is failing on some projects (for example [Code PushUp portal](https://github.com/code-pushup/portal/actions/runs/11451096875/job/31859737343?pr=508)) with artifact diffing.
```
PR detected, preparing to compare base branch main to head add-git-tags
Downloading artifact '2016373127' from 'code-pushup/portal'
Error: HttpError: Artifact has expired
Error: Artifact has expired
```