LLM

Implementing Transformers from Scratch

A from-scratch implementation of Transformer from the paper, "Attention Is All You Need".

Implementing DPO from Scratch

A from-scratch implementation project focused on Direct Preference Optimization algorithm using PyTorch