# Llama2 torch\_dtype

**URL:** <https://discuss.huggingface.co/t/llama2-torch-dtype/62840>\
**Category:** Models\
**Created:** [November 20, 2023, 11:20am UTC](https://discuss.huggingface.co/t/llama2-torch-dtype/62840 "2023-11-20T11:20:03Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![Yingshu](https://avatars.discourse-cdn.com/v4/letter/y/9de053/32.png) [@Yingshu](https://discuss.huggingface.co/u/Yingshu)\
**Post date:** [November 20, 2023, 11:20am UTC](https://discuss.huggingface.co/t/llama2-torch-dtype/62840/1 "2023-11-20T11:20:03Z")

</div>

In the introduction about llama, it says that llama2 was trained on bfloat16. The model weight uploaded to Hugging Face is on float16. I’m wondering why the current work based on llama2 loads it on float16 other than bfloat16.