Hugging Face's logo

Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
Back to feed
LH-Tech-AI 
posted an update 1 day ago
Post
1218
Hey community and sponsors!

We are announcing the Supra3 family with four core SLM models:
- Supra3 Flash Lite: 25M parameters, ~60B pretraining tokens
- Supra3 Flash: 50M parameters, ~100B pretraining tokens
- Supra3 Pro: 75M parameters, ~150B pretraining tokens
- Supra3 Ultra: 100M parameters, ~200B pretraining tokens

For Supra3 Pro and Ultra, we search for sponsors who give us free access to compute like RTX 5090 32GB or so.

We estimate the total cost of the pro and ultra models at around $600.

For Supra3 Flash Lite and Flash, we do not need sponsors.

If anyone would apply for helping us, we would be really thankful and this person would get early access to new modele, insider information, credit and more!

Contact: here or on discord: lh_tech_ai
Banaxi-Tech

already Supra3?

·
AxionLab-official

already Supra3?

Not yet, we're just announcing a plan, that would take ~1-2 months
Yusufchy

The parameter ladder makes the sponsor ask concrete; a shared eval suite across Flash Lite, Flash, Pro, and Ultra would make the capability-to-compute trade-off easier to judge than parameter counts alone. Which tasks will anchor the first public comparison?

·
Datdanboi25

All Model comparisons will be available on the open slm leaderboard:

https://huggingface.co/spaces/AxiomicLabs/Open_SLM_Leaderboard

We have results for supra 2, 1.5 and the original so feel free to check it out!
Banaxi-Tech

Cant you train Pro and Ultra locally? id say Ultra would take about 14 days on your 2 5060 Tis
In this post