How to run a single prompt with several pictures on multiple GPUs?

[13918763630]

I want to generate 10 images per prompt But seems out of memory and only use 1 GPU on my server.

image = pipe(
prompt=prompt_list[0],
guidance_scale=5.0,
pag_scale=2.0,
num_inference_steps=20,
num_images_per_prompt=10,
generator=torch.Generator(device="cuda").manual_seed(42),
)[0]

[FurkanGozukara]

you have to loop

that is what i added into my app

like for loop

num_images_per_prompt is actually batch size but i don't know why academic authors keep naming it as num_images_per_prompt

[13918763630]

you have to loop

that is what i added into my app

like for loop

num_images_per_prompt is actually batch size but i don't know why academic authors keep naming it as num_images_per_prompt

Okay！Thank you so much!