# What should be shifted for decoder input for Bart

**URL:** <https://discuss.huggingface.co/t/what-should-be-shifted-for-decoder-input-for-bart/8175>\
**Category:** Beginners\
**Created:** [July 8, 2021, 10:31am UTC](https://discuss.huggingface.co/t/what-should-be-shifted-for-decoder-input-for-bart/8175 "2021-07-08T10:31:03Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![zuujhyt](https://avatars.discourse-cdn.com/v4/letter/z/f17d59/32.png) [@zuujhyt](https://discuss.huggingface.co/u/zuujhyt)\
**Post date:** [July 8, 2021, 10:31am UTC](https://discuss.huggingface.co/t/what-should-be-shifted-for-decoder-input-for-bart/8175/1 "2021-07-08T10:31:03Z")

</div>

Hi,  
[In HF’s doc](https://huggingface.co/transformers/model_doc/bart.html), regarding `decoder_input_ids `it says `... create this tensor by shifting the `input_ids` to the right....`.  
Shouldn’t it be shifting the `labels`? because the input is noisy?  
Thank you.

---

<div class="post-metadata">

**Author:** ![sgugger](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/sgugger/32/2291_2.png) [@sgugger](https://discuss.huggingface.co/u/sgugger)\
**Post date:** [July 8, 2021, 11:28am UTC](https://discuss.huggingface.co/t/what-should-be-shifted-for-decoder-input-for-bart/8175/2 "2021-07-08T11:28:49Z")

</div>

I think this is copy pasted from the causal language modeling doc (for which your labels are your inputs shifted to the right).