# Does the model learn from the eval\_dataset when fine-tuning?

**URL:** <https://discuss.huggingface.co/t/does-the-model-learn-from-the-eval-dataset-when-fine-tuning/17522>\
**Category:** Beginners\
**Created:** [May 4, 2022, 2:32pm UTC](https://discuss.huggingface.co/t/does-the-model-learn-from-the-eval-dataset-when-fine-tuning/17522 "2022-05-04T14:32:20Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![evkade](https://avatars.discourse-cdn.com/v4/letter/e/b38774/32.png) [@evkade](https://discuss.huggingface.co/u/evkade)\
**Post date:** [May 4, 2022, 2:32pm UTC](https://discuss.huggingface.co/t/does-the-model-learn-from-the-eval-dataset-when-fine-tuning/17522/1 "2022-05-04T14:32:20Z")

</div>

Hi,  
I have been fine-tuning the BART (BartForConditionalGeneration) model for summarization in a specific case, and I was wondering if the model also gets trained on the eval\_dataset, or only on the train\_dataset. In other words, if I test the model afterwards, can I still use the eval\_dataset for testing and measuring how well the model performs, or has it ‘seen’ it in its training already?

---

<div class="post-metadata">

**Author:** ![sgugger](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/sgugger/32/2291_2.png) [@sgugger](https://discuss.huggingface.co/u/sgugger)\
**Post date:** [May 4, 2022, 2:53pm UTC](https://discuss.huggingface.co/t/does-the-model-learn-from-the-eval-dataset-when-fine-tuning/17522/2 "2022-05-04T14:53:05Z")

</div>

Only the `train_dataset` is used for training, so unless you have some overlap between the `train_dataset` and the `eval_dataset` you passed to the `Trainer`, the answer is no.

---

<div class="post-metadata">

**Author:** ![evkade](https://avatars.discourse-cdn.com/v4/letter/e/b38774/32.png) [@evkade](https://discuss.huggingface.co/u/evkade)\
**Post date:** [May 4, 2022, 3:43pm UTC](https://discuss.huggingface.co/t/does-the-model-learn-from-the-eval-dataset-when-fine-tuning/17522/3 "2022-05-04T15:43:03Z")

</div>

Great, thank you so much for your answer!
