# Fine tunning a Pre-trained Model

**URL:** <https://discuss.huggingface.co/t/fine-tunning-a-pre-trained-model/86645>\
**Category:** Models\
**Created:** [May 14, 2024, 10:27am UTC](https://discuss.huggingface.co/t/fine-tunning-a-pre-trained-model/86645 "2024-05-14T10:27:08Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![rishuhuhu](https://avatars.discourse-cdn.com/v4/letter/r/3ab097/32.png) [@rishuhuhu](https://discuss.huggingface.co/u/rishuhuhu)\
**Post date:** [May 14, 2024, 10:27am UTC](https://discuss.huggingface.co/t/fine-tunning-a-pre-trained-model/86645/1 "2024-05-14T10:27:08Z")

</div>

I want to fine tune distilBERT for news classification, But instead of using

```auto
model_checkpoint = "distilbert-base-uncased"

```

I want to use “dima806/news-category-classifier-distilbert” model for fine tunning, as it is already been trained on news data. How can I do that?

 ![Screenshot 2024-05-13 232416](https://us1.discourse-cdn.com/hellohellohello/original/3X/0/f/0f5e596717bdb707420f1c8c992a19258c55fca9.png)  
I am getting the above error !!