# How BitsAndBytesConfig use bnb\_4bit\_compute\_dtype=torch.bfloat16 on gpu don't support torch.bfloat16

**URL:** <https://discuss.huggingface.co/t/how-bitsandbytesconfig-use-bnb-4bit-compute-dtype-torch-bfloat16-on-gpu-dont-support-torch-bfloat16/59341>\
**Category:** Beginners\
**Created:** [October 20, 2023, 11:05pm UTC](https://discuss.huggingface.co/t/how-bitsandbytesconfig-use-bnb-4bit-compute-dtype-torch-bfloat16-on-gpu-dont-support-torch-bfloat16/59341 "2023-10-20T23:05:08Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![mohamedemam](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/mohamedemam/32/29942_2.png) [@mohamedemam](https://discuss.huggingface.co/u/mohamedemam)\
**Post date:** [October 20, 2023, 11:05pm UTC](https://discuss.huggingface.co/t/how-bitsandbytesconfig-use-bnb-4bit-compute-dtype-torch-bfloat16-on-gpu-dont-support-torch-bfloat16/59341/1 "2023-10-20T23:05:08Z")

</div>

is it convert to float16 when find doesn’t support bfloat16