https://aclanthology.org/2024.emnlp-main.626/

2024/ACL/

https://huggingface.co/docs/trl/main/en/orpo_trainer

https://github.com/xfactlab/orpo

https://gsai.kaist.ac.kr/wp-content/uploads/2024/10/KAIST-ORPO.pdf

• BackGround
• ORPO (Odds Ratio Preference Optimization)
• Experimental Results
• Conclustion