# My first ai model **URL:** \ **Category:** Beginners\ **Created:** [October 20, 2026, 3:32am UTC](https://discuss.huggingface.co/t/my-first-ai-model/190810 "2026-10-20T03:32:59Z")\ **Posts on this page:** 4\ **Page:** 1
**Author:** ![gcviguyg](https://avatars.discourse-cdn.com/v4/letter/g/a8b319/32.png) [@gcviguyg](https://discuss.huggingface.co/u/gcviguyg)\ **Post date:** [October 20, 2026, 3:32am UTC](https://discuss.huggingface.co/t/my-first-ai-model/190810/1 "2026-10-20T03:32:59Z")
Hey, i am learning ai model training so i want you to suggest me usecase for which i should create my first ai model. Requirements 1. I have a100 with 80gb ram so something that fit in it easily ---
**Author:** ![mithulaartigala](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/mithulaartigala/32/64487_2.png) [@mithulaartigala](https://discuss.huggingface.co/u/mithulaartigala)\ **Post date:** [October 20, 2026, 4:20pm UTC](https://discuss.huggingface.co/t/my-first-ai-model/190810/2 "2026-10-20T16:20:33Z")
hey man, thats really cool you are getting into ML. but look, we have several types of models (like: CNNs, RNNs, transformers) if you are a student like me, I reccomend getting started with transformers. also one more thing. if you ask help from a chatbot, they will say you can train big models like 30B+ models, but please stick to 230M-4B LoRA training for FT, and under 250M for PT. also there are two main types of attention: bi directional and casual. I recommend finetuning a 350M LFM model with r32 a64 LoRA (not QLoRA. you have enough compute). then you should ry more models like qwen3.5-800M and maybe the new gemma4 models as well! then once you are comfortable with things like loss masking, you should do a small PT run with around 50B tokens. try training a 120M model (it has just enough parameters to not dissapoint you if u didnt plan ur data quite right, so its just neough. maybe bumping it to 150M will make a considerable change as well. although some papers i read said that 141M is efficient, so go from somewhere around 120-150M) for the PT architecture, use an LLM for the math and code. try to learn the high level things like how you calculate loss for PT, context length and position encoding. for the architecture, use something like qwen3-600M and scale it down (smollm2’s 135M model’s arch works as well!) since you have an A100, you can train this really quickly so you can comfortably learn things yourself. something with this field is that no matter how good you are with the math or science, if you havnt don anything practical, knowing just math and science wont help you. then you should slowly write your own code and math. I also like this books (I am in HS yr10, but if u are above HS yr8 ish) you should read this book (the ebook is free, but the physical on is a bit expensive). wait, i actually have two books if u like reading. - this is one is pretty good: [Understanding Deep Learning](https://udlbook.github.io/udlbook/) (I am still reading both these books, but they teach a lot) - [https://mml-book.github.io/](https://mml-book.github.io/) if you know some math skim this a bit: (book – second link) but I reccomend you to read both these together! and for the love of god, please dont get advice from LLMs (I learnt it the hard way) 😭 BTW, you have a lot of compute, but dont waste it on big models, try to work on smaller models and then once you know what you are doing, scale up to bigger models. here is the list of models I like FT: - qwen3.5-800m and 2b - gemma4 2b (the projectors kinda mess things up, so avoid this for now) - LFM2.5 models (tbh for reason these models take very little VRAM. I am using unsloth zoo. the only problem is the license, but you are using them to learn, so… dont really care about the license) - gemma3-270M also here is a fun challeng before doing PT, try doing CPT (continuid pre training) on smolLM2 135M (to expand its context length) you got the VRAM for it so dont worry about it. Then do a chat FT to chat with it. and also you can try doing a reasoning FT as well, but try doing the normal user/assistant one, then you can later redo the FT on the CPTed model for the reasoning dataset (which has `` [thought process] `` XML tags, and the model can think like a human) eitherways, I will give you some advice: be sensible on how you are using your compute! ---
**Author:** ![gcviguyg](https://avatars.discourse-cdn.com/v4/letter/g/a8b319/32.png) [@gcviguyg](https://discuss.huggingface.co/u/gcviguyg)\ **Post date:** [October 21, 2026, 5:29am UTC](https://discuss.huggingface.co/t/my-first-ai-model/190810/3 "2026-10-21T05:29:52Z")
Thanks, I’ll keep that in mind. I’ll work with 150m models first to understand all the basics and advance concepts only then I’ll move to bigger models. Help appreciated 👍 ---
**Author:** ![Reaver1000](https://avatars.discourse-cdn.com/v4/letter/r/9d8465/32.png) [@Reaver1000](https://discuss.huggingface.co/u/Reaver1000)\ **Post date:** [October 23, 2026, 10:09am UTC](https://discuss.huggingface.co/t/my-first-ai-model/190810/4 "2026-10-23T10:09:30Z")
What helped me most when I fine-tuned my first model: write down how you made the labels. People ask about the training config, but the labels are where the project lives or dies. A short paragraph explaining how you verified them makes your work actually reusable. Second thing. Keep some data locked away for evaluation, and if your data has any time or group structure, hold out whole sessions instead of taking a random shuffle. Random splits leak adjacent frames and timestamps, so your eval will overstate the model. If any of the data belongs to someone else, publish the weights plus a description of the data and keep the raw material to yourself. Model cards with honest limitations get more respect than perfect sounding numbers. What kind of model is it? If you say what it does, people here will give you useful specific feedback.