# How to Train a Generative Pre-training Transformer

**URL:** <https://discuss.huggingface.co/t/how-to-train-a-generative-pre-training-transformer/88600>\
**Category:** Beginners\
**Created:** [May 26, 2024, 4:14pm UTC](https://discuss.huggingface.co/t/how-to-train-a-generative-pre-training-transformer/88600 "2024-05-26T16:14:16Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![Geron74784](https://avatars.discourse-cdn.com/v4/letter/g/5f8ce5/32.png) [@Geron74784](https://discuss.huggingface.co/u/Geron74784)\
**Post date:** [May 26, 2024, 4:14pm UTC](https://discuss.huggingface.co/t/how-to-train-a-generative-pre-training-transformer/88600/1 "2024-05-26T16:14:16Z")

</div>

Hello everyone,

I’m looking to train a **Generative Pre-training Transformer** and i wanted to ask if can anyone help me, because i want to create a small model that can be trained using text files and can provide some answers. I don’t expect it to be an expert in all topics, but it would be sufficient if it can answer a few questions on a specific topic. Can anyone help me with this?

Thank you!