[Quantization] enable multi-backend `bitsandbytes`

[sayakpaul]

Similar to huggingface/transformers#31098

[siddhant230]

Hey I went through the PRs, seemingly its straightforward, but, I might be completely mistaken here (given I have very less knowledge of diffusers backend), I could pick this up. It would be helpful if someone tags along as well.

My understanding

1. change in src/diffusers/quantizers/bitsandbytes/utils.py -> addition of multi-backend-validation
2. Usage of validation in bnb_quantizer.py

(edit)
3. Also adding the relevant tests

Doubt:
As in bits&bytes PR here : 31098 : src/transformers/utils/init.py do we also need to account for others backends like mps, mlu, etc?

Thanks.

[sayakpaul]

Thanks for your interest! For this PR, we would assume you have sufficient familiarity with diffusers. The steps you outlined seem fine to me, though.

do we also need to account for others backends like mps, mlu, etc?

We don't.

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

[vladmandic]

ping to remove stale...

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

[vladmandic]

ping to remove stale