[Feature] Pipeline Parallelization of Different Stages in RLHF#877

Open

llkn-2 wants to merge 19 commits intoInternLM:mainfrom llkn-2:rlhf-pipe

Commits on Jun 25, 2024

add rlhf
zhaohui
committed
add/fix pretrain_loss

ShuaibinLi
authored and
zhaohui
committed
dataloader, resolve comments

ShuaibinLi
authored and
zhaohui
committed
rename,remove

ShuaibinLi
authored and
zhaohui
committed
save tokenizer

ShuaibinLi
authored and
zhaohui
committed
rm/move models

ShuaibinLi
authored and
zhaohui
committed
fix: zero3 for bigger models

kiddie92
authored and
zhaohui
committed
precommit check

kiddie92
authored and
zhaohui
committed
resume

ShuaibinLi
authored and
zhaohui
committed
fix resume/pretrain_data

ShuaibinLi
authored and
zhaohui
committed
fix tokenizer bug

ShuaibinLi
authored and
zhaohui
committed
async learn

qzweng
authored and
qzweng
committed
add and rename ppo configs

qzweng
authored and
qzweng
committed

Commits on Jun 26, 2024

Commits on Jun 27, 2024

Commits on Jul 31, 2024