StackLLaMa
🦙
213
LLaMA trained on Stack Exchange with RLHF, then DPO. https://huggingface.co/blog/stackllama and https://huggingface.co/blog/dpo-trl
Note Demo
Note Data
Note SFT adapter
Note Reward model adapter
Note RL (PPO) adapter
Note Llama 2 trained with DPO, served by the demo