# Stopping criteria

**URL:** <https://discuss.huggingface.co/t/stopping-criteria/61777>\
**Category:** Inference Endpoints on the Hub\
**Created:** [November 10, 2023, 8:51am UTC](https://discuss.huggingface.co/t/stopping-criteria/61777 "2023-11-10T08:51:11Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![chsafouane](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/chsafouane/32/26450_2.png) [@chsafouane](https://discuss.huggingface.co/u/chsafouane)\
**Post date:** [November 10, 2023, 8:51am UTC](https://discuss.huggingface.co/t/stopping-criteria/61777/1 "2023-11-10T08:51:11Z")

</div>

I have a model that I’m using through an inference endpoint. When using it locally, I implemented a stopping criteria.

Is there a way to embed the stopping criteria in the model deployed through the inference endpoint ?

Thanks

---

<div class="post-metadata">

**Author:** ![nksk](https://avatars.discourse-cdn.com/v4/letter/n/258eb7/32.png) [@nksk](https://discuss.huggingface.co/u/nksk)\
**Post date:** [March 11, 2024, 9:37pm UTC](https://discuss.huggingface.co/t/stopping-criteria/61777/2 "2024-03-11T21:37:24Z")

</div>

Did you ever get to figure this out? I have a similar situation and would love to know how you handled this.

---

<div class="post-metadata">

**Author:** ![nksk](https://avatars.discourse-cdn.com/v4/letter/n/258eb7/32.png) [@nksk](https://discuss.huggingface.co/u/nksk)\
**Post date:** [March 12, 2024, 4:28am UTC](https://discuss.huggingface.co/t/stopping-criteria/61777/3 "2024-03-12T04:28:53Z")

</div>

In case it’s of help for others, the answer is here: [Deploy LLMs with Hugging Face Inference Endpoints](https://huggingface.co/blog/inference-endpoints-llm)

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/hellohellohello/original/2X/d/de4155eb4aa4108ecb32a1389d7cc37ae69f88b7.png) [@system](https://discuss.huggingface.co/u/system)\
**Post date:** [June 3, 2024, 1:29pm UTC](https://discuss.huggingface.co/t/stopping-criteria/61777/4 "2024-06-03T13:29:44Z")

</div>

Closed on June 3, 2024, 1:29pm UTC

This topic was automatically closed 12 hours after the last reply. New replies are no longer allowed.
