# Random utf-8 errors from dataset

**URL:** <https://discuss.huggingface.co/t/random-utf-8-errors-from-dataset/22134>\
**Category:** Intermediate\
**Created:** [August 26, 2022, 7:09am UTC](https://discuss.huggingface.co/t/random-utf-8-errors-from-dataset/22134 "2022-08-26T07:09:21Z")\
**Posts on this page:** 1\
**Showing post:** 10

<div class="post-metadata">

**Author:** ![sibiakash](https://avatars.discourse-cdn.com/v4/letter/s/87869e/32.png) [@sibiakash](https://discuss.huggingface.co/u/sibiakash)\
**Post date:** [December 8, 2023, 5:30am UTC](https://discuss.huggingface.co/t/random-utf-8-errors-from-dataset/22134/10 "2023-12-08T05:30:56Z")

</div>

found a fix from here… [UTF-16 for datasets? - #2 by mariosasko](https://discuss.huggingface.co/t/utf-16-for-datasets/43828/2)  
used encoding = ‘UTF-8’ in my load\_dataset and it worked.

---

_[View the full topic](https://discuss.huggingface.co/t/random-utf-8-errors-from-dataset/22134)._