FSPO: Few-Shot Preference Optimization of Synthetic Preference Data in LLMs Elicits Effective Personalization to Real Users Paper โข 2502.19312 โข Published Feb 26, 2025 โข 7 โข 2