
An implementation of Direct Preference Optimization (DPO) for language model alignment using PyTorch. without Hugging Face TRL.

An implementation of Direct Preference Optimization (DPO) for language model alignment using PyTorch. without Hugging Face TRL.