mlboydaisuke commited on
Commit
a3d78f6
·
verified ·
1 Parent(s): 3956b28

Say that the CLI's Init counts engine creation twice (LiteRT-LM #4057)

Browse files

The CLI's printed Init includes both Init Total and the phases inside it. One sentence, no number changed.

Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -84,6 +84,8 @@ Two honest caveats, both measured rather than assumed:
84
  | GPU (Metal) | 3673 tok/s | 144.6 tok/s | 0.077 s | 2.8 s |
85
  | CPU | 427 tok/s | 33.3 tok/s | 0.63 s | 6.4 s |
86
 
 
 
87
  Pixel 8a (Tensor G3), `litert_lm_advanced_main` from the v0.16.0 kit, 205-token prompt, `--benchmark`:
88
 
89
  | Backend | Prefill (205) | Decode | TTFT |
 
84
  | GPU (Metal) | 3673 tok/s | 144.6 tok/s | 0.077 s | 2.8 s |
85
  | CPU | 427 tok/s | 33.3 tok/s | 0.63 s | 6.4 s |
86
 
87
+ Init is the `Init time` the CLI prints; that value includes both `Init Total` and the phases inside it, so it counts engine creation twice ([LiteRT-LM #4057](https://github.com/google-ai-edge/LiteRT-LM/issues/4057)).
88
+
89
  Pixel 8a (Tensor G3), `litert_lm_advanced_main` from the v0.16.0 kit, 205-token prompt, `--benchmark`:
90
 
91
  | Backend | Prefill (205) | Decode | TTFT |