# Question about data in datasets

**URL:** <https://discuss.huggingface.co/t/question-about-data-in-datasets/92460>\
**Category:** 🤗Datasets\
**Created:** [June 16, 2024, 7:15pm UTC](https://discuss.huggingface.co/t/question-about-data-in-datasets/92460 "2024-06-16T19:15:57Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![TikoTako](https://avatars.discourse-cdn.com/v4/letter/t/cab0a1/32.png) [@TikoTako](https://discuss.huggingface.co/u/TikoTako)\
**Post date:** [June 16, 2024, 7:15pm UTC](https://discuss.huggingface.co/t/question-about-data-in-datasets/92460/1 "2024-06-16T19:15:57Z")

</div>

Hello,  
I’ve checked 18 gb of corporas (scraped from news, blogs, forums, random sites), all of them contain things like:  
links, ads, the html tags for chars (\> … ), mysql connection errors, etc…

Also some gbs of plain text from ebooks, all of them contain things like:  
index, author and publisher stuff, page numbers, empty lines, weird/wrong formatting, etc…

Is normal to use these as pre-training datasets?

It is just the fine-tune data that have to be precise?