Upload llama_and_8k_v3_seed_888/flexitok--llama-3.2-1b-tokenizer_overlap.json with huggingface_hub

Upload llama_and_8k_v3_seed_888/participating_tokenizers.json with huggingface_hub

Upload llama_and_8k_v3_seed_888/flexitok--llama-3.2-1b-tokenizer.yaml with huggingface_hub

Upload llama_and_8k_v3_seed_888/flexitok--llama-3.2-1b-tokenizer_info.json with huggingface_hub

Upload llama_and_8k_v3_seed_888/flexitok--llama-3.2-1b-tokenizer_vocab.json with huggingface_hub

Upload llama_and_8k_v3_seed_888/flexitok--llama-3.2-1b-tokenizer_super_mapping.json with huggingface_hub

Upload llama_and_8k_v3_seed_111/flexitok--llama-3.2-1b-tokenizer_overlap.json with huggingface_hub

Upload llama_and_8k_v3_seed_111/participating_tokenizers.json with huggingface_hub

Upload llama_and_8k_v3_seed_111/flexitok--llama-3.2-1b-tokenizer.yaml with huggingface_hub

Upload llama_and_8k_v3_seed_111/flexitok--llama-3.2-1b-tokenizer_info.json with huggingface_hub

Upload llama_and_8k_v3_seed_111/flexitok--llama-3.2-1b-tokenizer_vocab.json with huggingface_hub

Upload llama_and_8k_v3_seed_111/flexitok--llama-3.2-1b-tokenizer_super_mapping.json with huggingface_hub

Upload llama_and_16k/flexitok--llama-3.2-1b-tokenizer_overlap.json with huggingface_hub

Upload llama_and_16k/participating_tokenizers.json with huggingface_hub

Upload llama_and_16k/flexitok--llama-3.2-1b-tokenizer.yaml with huggingface_hub

Upload llama_and_16k/flexitok--llama-3.2-1b-tokenizer_info.json with huggingface_hub

Upload llama_and_16k/flexitok--llama-3.2-1b-tokenizer_vocab.json with huggingface_hub

Upload llama_and_16k/flexitok--llama-3.2-1b-tokenizer_super_mapping.json with huggingface_hub

Create tokenizer_config.json

Create tokenizer.json

initial commit