Instructions to use ai4bharat/IndicBERTv2-MLM-only with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use ai4bharat/IndicBERTv2-MLM-only with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="ai4bharat/IndicBERTv2-MLM-only")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("ai4bharat/IndicBERTv2-MLM-only") model = AutoModelForMaskedLM.from_pretrained("ai4bharat/IndicBERTv2-MLM-only", device_map="auto") - Inference
- Notebooks
- Google Colab
- Kaggle
Download special_tokens_map.json from ai4bharat/IndicBERTv2-MLM-only: direct link, hf CLI and curl.
- Browser
- Download file 125 Bytes
-
https://huggingface.co/ai4bharat/IndicBERTv2-MLM-only/resolve/main/special_tokens_map.json
- Command line
-
hf download hf://ai4bharat/IndicBERTv2-MLM-only/special_tokens_map.json
-
curl -L -o special_tokens_map.json https://huggingface.co/ai4bharat/IndicBERTv2-MLM-only/resolve/main/special_tokens_map.json
125 Bytes
| { | |
| "cls_token": "[CLS]", | |
| "mask_token": "[MASK]", | |
| "pad_token": "[PAD]", | |
| "sep_token": "[SEP]", | |
| "unk_token": "[UNK]" | |
| } | |