# Fine-tuning process - dataset update training

**URL:** <https://discuss.huggingface.co/t/fine-tuning-process-dataset-update-training/76329>\
**Category:** Beginners\
**Created:** [March 7, 2024, 6:22am UTC](https://discuss.huggingface.co/t/fine-tuning-process-dataset-update-training/76329 "2024-03-07T06:22:27Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![yeonanii](https://avatars.discourse-cdn.com/v4/letter/y/85e7bf/32.png) [@yeonanii](https://discuss.huggingface.co/u/yeonanii)\
**Post date:** [March 7, 2024, 6:22am UTC](https://discuss.huggingface.co/t/fine-tuning-process-dataset-update-training/76329/1 "2024-03-07T06:22:28Z")

</div>

I have a question about Fine-tuning.  
Can I train model only update dataset in Fine-tuning process not include pre-training(before data)?

---

<div class="post-metadata">

**Author:** ![Saugatkafley](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/saugatkafley/32/26738_2.png) [@Saugatkafley](https://discuss.huggingface.co/u/Saugatkafley)\
**Post date:** [March 7, 2024, 6:55am UTC](https://discuss.huggingface.co/t/fine-tuning-process-dataset-update-training/76329/2 "2024-03-07T06:55:20Z")

</div>

As fine-tuning a model we are transfering the generalized knowledge acquired during pre-training process to a specified, narrow (downstream) tasks to improve performance on the task.

But we have to also be careful about the pre-training corpus. Did it had enough information in the corpus that we really needed(usefulness)? The selection of appropriate models is also crucial,

- model size
- model vocabulary
- model performance.