# How to access tokens embedding layer in BERT?

**URL:** <https://discuss.huggingface.co/t/how-to-access-tokens-embedding-layer-in-bert/5474>\
**Category:** 🤗Transformers\
**Created:** [April 13, 2021, 9:53pm UTC](https://discuss.huggingface.co/t/how-to-access-tokens-embedding-layer-in-bert/5474 "2021-04-13T21:53:27Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![AlexeyK](https://avatars.discourse-cdn.com/v4/letter/a/9de053/32.png) [@AlexeyK](https://discuss.huggingface.co/u/AlexeyK)\
**Post date:** [April 13, 2021, 9:53pm UTC](https://discuss.huggingface.co/t/how-to-access-tokens-embedding-layer-in-bert/5474/1 "2021-04-13T21:53:27Z")

</div>

Embeddings in BERT are comprised of three components: token/word embeddings + segment embeddings + positional embedding.

**How do I access word embedding layer and set some of its parameters, e.g. ‘embeddings\_regularizer=’?**