Aquileo | lblaoke/opt-125m-hh-rlhf-dpo-trl-v5 · Hugging Face
Hugging Face's logo

lblaoke
/
opt-125m-hh-rlhf-dpo-trl-v5

Safetensors
opt
Model card Files
xet
 Community

learning_rate: 5e-5

num_epochs: 1

total_batch_size: 16

Downloads last month
11
Safetensors
Model size
0.1B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for lblaoke/opt-125m-hh-rlhf-dpo-trl-v5

Base model

facebook/opt-125m
Finetuned
lblaoke/opt-125m-hh-rlhf-chosen-sft-trl-v5
Finetuned
(2)
this model

Dataset used to train lblaoke/opt-125m-hh-rlhf-dpo-trl-v5

Collection including lblaoke/opt-125m-hh-rlhf-dpo-trl-v5