# PAD with Collator

**URL:** <https://discuss.huggingface.co/t/pad-with-collator/6377>\
**Category:** 🤗Datasets\
**Created:** [May 25, 2021, 8:54pm UTC](https://discuss.huggingface.co/t/pad-with-collator/6377 "2021-05-25T20:54:14Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![Felipehonorato](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/felipehonorato/32/48418_2.png) [@Felipehonorato](https://discuss.huggingface.co/u/Felipehonorato)\
**Post date:** [May 25, 2021, 8:54pm UTC](https://discuss.huggingface.co/t/pad-with-collator/6377/1 "2021-05-25T20:54:14Z")

</div>

Hey guys. I’m trying to fine-tune a GPT2 model using the DataCollatorForLanguageModelling, but I’m getting a message like:

 ![image](https://us1.discourse-cdn.com/hellohellohello/original/2X/b/bed01ab1b72b9996c79a85b6aa25339aa6c3de23.png)  
I’m not asking to pad it anywhere, does anyone has a clue about what should be going wrong?

---

<div class="post-metadata">

**Author:** ![lhoestq](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/lhoestq/32/52888_2.png) [@lhoestq](https://discuss.huggingface.co/u/lhoestq)\
**Post date:** [June 4, 2021, 9:36am UTC](https://discuss.huggingface.co/t/pad-with-collator/6377/2 "2021-06-04T09:36:44Z")

</div>

Hi ! I think some users have already experienced this issue and found a fix in this thread:  
[https://github.com/huggingface/transformers/issues/3859](https://github.com/huggingface/transformers/issues/3859)

I hope that helps 🙂