Support Tensor Parallel and Sequence Parallel in sdxl - #1

Open

KimmiShi wants to merge 10 commits into

mainfrom

Commits on Aug 28, 2023

tried tensor parallel
KimmiShi
committed
8782b63

Commits on Aug 29, 2023

xattn sequence parallel
KimmiShi
committed
60b5a6b
down block, upblock sequence parallel
KimmiShi
committed
1e68b82
Delete train_sdxl.py
KimmiShi
authored
6067e6b
Delete train_sdxl_new.py
KimmiShi
authored
de1dbaa

Commits on Aug 30, 2023

remove comments
KimmiShi
committed
a52a876

Commits on Aug 31, 2023

refact sequence parallel code
KimmiShi
committed
e13fcf8
Merge branch 'tp' of https://github.com/KimmiShi/diffusers-tp into tp
KimmiShi
committed
d3016b9

Commits on Sep 18, 2023

Create train_unet.py
KimmiShi
authored
2f68778
Update train_unet.py
KimmiShi
authored
884d513