# How to load model after running Trainer.save\_model?

**URL:** <https://discuss.huggingface.co/t/how-to-load-model-after-running-trainer-save-model/41935>\
**Category:** Beginners\
**Created:** [June 3, 2023, 3:45am UTC](https://discuss.huggingface.co/t/how-to-load-model-after-running-trainer-save-model/41935 "2023-06-03T03:45:49Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![gameveloster](https://avatars.discourse-cdn.com/v4/letter/g/f19dbf/32.png) [@gameveloster](https://discuss.huggingface.co/u/gameveloster)\
**Post date:** [June 3, 2023, 3:45am UTC](https://discuss.huggingface.co/t/how-to-load-model-after-running-trainer-save-model/41935/1 "2023-06-03T03:45:49Z")

</div>

Hi, I am having problems trying to load a model after training it.

First, I trained and saved the model using

```auto
trainer = transformers.Trainer(
    model=model,
    train_dataset=data["train"],
    args=transformers.TrainingArguments(
        per_device_train_batch_size=1,
        gradient_accumulation_steps=8,
        warmup_steps=2,
        max_steps=20,
        learning_rate=2e-4,
        fp16=True,
        logging_steps=1,
        output_dir="outputs",
        optim="paged_adamw_8bit",
    ),
    data_collator=transformers.DataCollatorForLanguageModeling(tokenizer, mlm=False),
)
trainer.train()
trainer.save_model("outputs/finetuned")

```

This produced a directory containing the files

- `pytorch_model.bin`
- `training_args.bin`

Now when I try to load the model using

```auto
model = AutoModelForCausalLM.from_pretrained(
    "outputs/finetuned",
    quantization_config=quant_config,
    device_map={"": 0},
    local_files_only=True,
)

```

I am getting the error

```auto
OSError: outputs/finetuned does not appear to have a file named config.json. Checkout 'https://huggingface.co/outputs/finetuned/None' for available files.

```

How do I get `Trainer` to save the model with this `config.json` file?

Thanks!

---

<div class="post-metadata">

**Author:** ![abd007](https://avatars.discourse-cdn.com/v4/letter/a/c57346/32.png) [@abd007](https://discuss.huggingface.co/u/abd007)\
**Post date:** [July 27, 2023, 5:50am UTC](https://discuss.huggingface.co/t/how-to-load-model-after-running-trainer-save-model/41935/2 "2023-07-27T05:50:38Z")

</div>

Hey facing the same issue . Does it got resolved ?

---

<div class="post-metadata">

**Author:** ![sunkistCAT](https://avatars.discourse-cdn.com/v4/letter/s/7ab992/32.png) [@sunkistCAT](https://discuss.huggingface.co/u/sunkistCAT)\
**Post date:** [November 28, 2023, 11:56am UTC](https://discuss.huggingface.co/t/how-to-load-model-after-running-trainer-save-model/41935/3 "2023-11-28T11:56:09Z")

</div>

facing the same issue as well

---

<div class="post-metadata">

**Author:** ![panigrah](https://avatars.discourse-cdn.com/v4/letter/p/bb73d2/32.png) [@panigrah](https://discuss.huggingface.co/u/panigrah)\
**Post date:** [November 28, 2023, 2:41pm UTC](https://discuss.huggingface.co/t/how-to-load-model-after-running-trainer-save-model/41935/4 "2023-11-28T14:41:15Z")

</div>

What is the model are you using?

Try using ` model.save_pretrained(path/to/folder)`, does that work?