Text Generation
LiteRT-LM
LiteRT
English
litertlm
on-device
edge
asr
automatic-speech-recognition
text-normalization
inverse-text-normalization
punctuation
truecasing
speech-to-text
dictation
post-processing
qwen3
Instructions to use mlboydaisuke/S1-mini-LiteRT with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- LiteRT-LM
How to use mlboydaisuke/S1-mini-LiteRT with LiteRT-LM:
# LiteRT-LM runs on various platforms (Android, iOS, Windows, Linux, macOS, IoT, Web/WASM) # and supports many APIs (C++, Python, Kotlin, Swift, JavaScript, Flutter). # For platform-specific integration guides, please refer to the official developer website: # https://ai.google.dev/edge/litert-lm # To try LiteRT-LM, the easiest way is to use our CLI tool. # 1. Install the LiteRT-LM CLI tool: pip install -U litert-lm # 2. Download and run this model locally: # See: https://ai.google.dev/edge/litert-lm/cli # A single .litertlm file in the repo is picked automatically; otherwise the CLI asks which one to run # (or pass its name right after the repo id). litert-lm run \ --from-huggingface-repo=mlboydaisuke/S1-mini-LiteRT \ --prompt="Write me a poem"
- LiteRT
How to use mlboydaisuke/S1-mini-LiteRT with LiteRT:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Say that the CLI's Init counts engine creation twice (LiteRT-LM #4057)
Browse filesThe CLI's printed Init includes both Init Total and the phases inside it. One sentence, no number changed.
README.md
CHANGED
|
@@ -84,6 +84,8 @@ Two honest caveats, both measured rather than assumed:
|
|
| 84 |
| GPU (Metal) | 3673 tok/s | 144.6 tok/s | 0.077 s | 2.8 s |
|
| 85 |
| CPU | 427 tok/s | 33.3 tok/s | 0.63 s | 6.4 s |
|
| 86 |
|
|
|
|
|
|
|
| 87 |
Pixel 8a (Tensor G3), `litert_lm_advanced_main` from the v0.16.0 kit, 205-token prompt, `--benchmark`:
|
| 88 |
|
| 89 |
| Backend | Prefill (205) | Decode | TTFT |
|
|
|
|
| 84 |
| GPU (Metal) | 3673 tok/s | 144.6 tok/s | 0.077 s | 2.8 s |
|
| 85 |
| CPU | 427 tok/s | 33.3 tok/s | 0.63 s | 6.4 s |
|
| 86 |
|
| 87 |
+
Init is the `Init time` the CLI prints; that value includes both `Init Total` and the phases inside it, so it counts engine creation twice ([LiteRT-LM #4057](https://github.com/google-ai-edge/LiteRT-LM/issues/4057)).
|
| 88 |
+
|
| 89 |
Pixel 8a (Tensor G3), `litert_lm_advanced_main` from the v0.16.0 kit, 205-token prompt, `--benchmark`:
|
| 90 |
|
| 91 |
| Backend | Prefill (205) | Decode | TTFT |
|