WMT26Anon/hymt2-7b-sft-cpo

Hy-MT2-7B — SFT + CPO LoRA adapter

Contrastive Preference Optimization (CPO) on top of the SFT LoRA adapter for tencent/Hy-MT2-7B. The main fine-tuned configuration reported in the paper. Anonymous submission to the WMT26 research track.

Training

• SFT stage: 2 epochs, learning rate 1e-4, glossary in prompt (same adapter as WMT26Anon/hymt2-7b-sft)
• CPO stage: 1 epoch, learning rate 5e-6, β = 0.1, over 10,000 (source, chosen, rejected) triplets. Rejected candidates are generated by the base model in zero-shot, no-glossary mode, targeting its own failure modes.
• LoRA rank 64, α = 128, dropout 0.05
• Target modules: q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj

Usage

from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer

base = AutoModelForCausalLM.from_pretrained('tencent/Hy-MT2-7B',
                                            trust_remote_code=True)
model = PeftModel.from_pretrained(base, 'WMT26Anon/hymt2-7b-sft-cpo')
tok = AutoTokenizer.from_pretrained('tencent/Hy-MT2-7B',
                                    trust_remote_code=True)

Code

Inference pipeline, KB, test sets, and evaluation scripts: https://anonymous.4open.science/r/RAG_System_for_Specialized_Terms-18BB/