# German NLP Repository

**URL:** <https://discuss.huggingface.co/t/german-nlp-repository/4093>\
**Category:** Languages at Hugging Face\
**Created:** [March 2, 2021, 8:48pm UTC](https://discuss.huggingface.co/t/german-nlp-repository/4093 "2021-03-02T20:48:54Z")\
**Posts on this page:** 12\
**Page:** 1

<div class="post-metadata">

**Author:** ![Sahajtomar](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/sahajtomar/32/906_2.png) [@Sahajtomar](https://discuss.huggingface.co/u/Sahajtomar)\
**Post date:** [March 2, 2021, 8:48pm UTC](https://discuss.huggingface.co/t/german-nlp-repository/4093/1 "2021-03-02T20:48:54Z")

</div>

I am a MSc student in University of Siegen and have keen desire and interest in training NLP models specific to german language. It would be really great to meet people wanting to contribute models or datasets in german language. As of now I have trained and shared 3 models for german langauge such as Question answering models and NER model for legal domain in german.  
Feel free to experiment and share your reviews .

> **[Sahajtomar (Sahaj Tomar)](https://huggingface.co/Sahajtomar)**
>
> We’re on a journey to advance and democratize artificial intelligence through open source and open science.

More models to come 🤗🤗

---

<div class="post-metadata">

**Author:** ![dikster99](https://avatars.discourse-cdn.com/v4/letter/d/7bcc69/32.png) [@dikster99](https://discuss.huggingface.co/u/dikster99)\
**Post date:** [March 3, 2021, 5:41pm UTC](https://discuss.huggingface.co/t/german-nlp-repository/4093/2 "2021-03-03T17:41:28Z")

</div>

Hi @Sahajtomar,

I am interested in German/English models that are useful for sentiment analysis and text classification in general (topic detection). I Have labeled datasets for both tasks.

Can you recommend any available model in the repository?

I am facing a blocker issue on a MultiLabel Text Classificatin task (described in a different issue item) would you happen to know how this could be implemented with the current version of Transformers (there seem to be some breaking change around version 3 which make it difficult to review a working sample ☹ )…

Thanx Dirk

---

<div class="post-metadata">

**Author:** ![Sahajtomar](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/sahajtomar/32/906_2.png) [@Sahajtomar](https://discuss.huggingface.co/u/Sahajtomar)\
**Post date:** [March 3, 2021, 6:33pm UTC](https://discuss.huggingface.co/t/german-nlp-repository/4093/3 "2021-03-03T18:33:20Z")

</div>

Hey,  
Sure … there are two options  
1). there are multilingual models like Universal sentence encoder or Sentence bert / roberta models which you can use to get embeddings and train simple ML model over it.  
2) There are also zero shot classification models trained on XNLI datasets… which you can use directly. Kindly see this model

> **[joeddav/xlm-roberta-large-xnli · Hugging Face](https://huggingface.co/joeddav/xlm-roberta-large-xnli)**
>
> We’re on a journey to advance and democratize artificial intelligence through open source and open science.

Also I am training a model on NLI task specifically in german language… as soon as I am done I will upload the model. Enjoy 🤗

---

<div class="post-metadata">

**Author:** ![dikster99](https://avatars.discourse-cdn.com/v4/letter/d/7bcc69/32.png) [@dikster99](https://discuss.huggingface.co/u/dikster99)\
**Post date:** [March 15, 2021, 9:20am UTC](https://discuss.huggingface.co/t/german-nlp-repository/4093/4 "2021-03-15T09:20:42Z")

</div>

Hi,

I am actually looking for a TensorFlow model that supports German and English. I am looking at  
bert-base-multilingual-uncased-sentiment

right now but this seems to have problems when I load it as TFBertForsequenceClassification or TFAutoModelForsequenceClassification (?) - I get an exception:

`cannot reshape array of size 3840 into shape (768,20)`

when I execute:  
tf\_model = TFAutoModelForSequenceClassification.from\_pretrained(mydrivePath  
, label2id=label2index  
, id2label=index2label  
, from\_pt=True)

(where label2id and id2label are just dictionaries that mab categories to id and back).

Anyways if you happen to know a good Tensorflow model that can be used for Text Classification in English and German I would appreciate the hint 🙂

Thanx Dirk

---

<div class="post-metadata">

**Author:** ![patrickvonplaten](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/patrickvonplaten/32/2171_2.png) [@patrickvonplaten](https://discuss.huggingface.co/u/patrickvonplaten)\
**Post date:** [March 17, 2021, 6:19pm UTC](https://discuss.huggingface.co/t/german-nlp-repository/4093/5 "2021-03-17T18:19:14Z")

</div>

Hey, I’m Patrick, a German Research Engineer at Hugging Face. I will be joining the “Wav2Vec2 Fine-tuning week” starting on Monday next week - see: [[Open-to-the-community] XLSR-Wav2Vec2 Fine-Tuning Week for Low-Resource Languages - #14 by ayameRushia](https://discuss.huggingface.co/t/open-to-the-community-xlsr-wav2vec2-fine-tuning-week-for-low-resource-languages/4467/14) .

If you want to participate and have any questions regarding fine-tuning a German speech recognition model, feel free to ping me here 🤗

---

<div class="post-metadata">

**Author:** ![Sahajtomar](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/sahajtomar/32/906_2.png) [@Sahajtomar](https://discuss.huggingface.co/u/Sahajtomar)\
**Post date:** [March 17, 2021, 9:06pm UTC](https://discuss.huggingface.co/t/german-nlp-repository/4093/6 "2021-03-17T21:06:30Z")

</div>

hey @patrickvonplaten , I am facing issues with colab disk space. uncompressed data is 22gb for herman language. What are other options to train on large datasets?

---

<div class="post-metadata">

**Author:** ![patrickvonplaten](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/patrickvonplaten/32/2171_2.png) [@patrickvonplaten](https://discuss.huggingface.co/u/patrickvonplaten)\
**Post date:** [March 18, 2021, 6:52am UTC](https://discuss.huggingface.co/t/german-nlp-repository/4093/7 "2021-03-18T06:52:56Z")

</div>

Hey Sahajtomar,

One option would be to use a colab pro, but we are currently trying to organize more GPU & RAM compute for you guys

---

<div class="post-metadata">

**Author:** ![sasaadi](https://avatars.discourse-cdn.com/v4/letter/s/73ab20/32.png) [@sasaadi](https://discuss.huggingface.co/u/sasaadi)\
**Post date:** [October 12, 2021, 11:17am UTC](https://discuss.huggingface.co/t/german-nlp-repository/4093/8 "2021-10-12T11:17:46Z")

</div>

Hi @Sahajtomar,

Thanks for sharing your trained German models. I would like to know if it would be possible to add a license file with details to your [German zero-shot](https://huggingface.co/Sahajtomar/German_Zeroshot) model?

Thanks.

---

<div class="post-metadata">

**Author:** ![Sahajtomar](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/sahajtomar/32/906_2.png) [@Sahajtomar](https://discuss.huggingface.co/u/Sahajtomar)\
**Post date:** [October 12, 2021, 11:30am UTC](https://discuss.huggingface.co/t/german-nlp-repository/4093/9 "2021-10-12T11:30:55Z")

</div>

Hi,  
Could you let me know what is license file

---

<div class="post-metadata">

**Author:** ![sasaadi](https://avatars.discourse-cdn.com/v4/letter/s/73ab20/32.png) [@sasaadi](https://discuss.huggingface.co/u/sasaadi)\
**Post date:** [October 15, 2021, 11:54am UTC](https://discuss.huggingface.co/t/german-nlp-repository/4093/10 "2021-10-15T11:54:44Z")

</div>

By license file I mean a file that describes the terms and conditions under which the published model can be used. For example, the [BERT](https://github.com/google-research/bert) model is published under the following license: [bert/LICENSE at master · google-research/bert · GitHub](https://github.com/google-research/bert/blob/master/LICENSE)

Thanks.

---

<div class="post-metadata">

**Author:** ![albrecht](https://avatars.discourse-cdn.com/v4/letter/a/e0b2c6/32.png) [@albrecht](https://discuss.huggingface.co/u/albrecht)\
**Post date:** [November 19, 2021, 7:21pm UTC](https://discuss.huggingface.co/t/german-nlp-repository/4093/11 "2021-11-19T19:21:39Z")

</div>

Hey @Sahajtomar ! Great job, amazing results, thanks for sharing your work with the community! I was wondering if we could use your model and would really appreciate if you could mention the license under which the model can be used.  
Thanks!

---

<div class="post-metadata">

**Author:** ![chandrantwins](https://avatars.discourse-cdn.com/v4/letter/c/e99b99/32.png) [@chandrantwins](https://discuss.huggingface.co/u/chandrantwins)\
**Post date:** [November 21, 2023, 11:40am UTC](https://discuss.huggingface.co/t/german-nlp-repository/4093/12 "2023-11-21T11:40:46Z")

</div>

Hi @Sahajtomar ,

Do you know any model which support both english and german language for table question answering?

My requirement is , if any body ask

How many customers are there?  
Wie viele kunden sind da?

I have to check customers table, to identify how many records in database…

I am quite new too NLP and ML too

Thanks  
Chandran
