-
Notifications
You must be signed in to change notification settings - Fork 6.1k
Open
Labels
bugSomething isn't workingSomething isn't workingstaleIssues that haven't received updatesIssues that haven't received updates
Description
Describe the bug
When logging validation images on tensorboard, one tile is always created, even if there are several validation projects and images. I suggest making changes to the code:
for tracker in accelerator.trackers:
if tracker.name == "tensorboard":
i=0
for log in image_logs:
images = log["images"]
validation_prompt = log["validation_prompt"]
validation_image = log["validation_image"]
formatted_images = [np.asarray(validation_image)]
for image in images:
formatted_images.append(np.asarray(image))
formatted_images = np.stack(formatted_images)
tag = f"{validation_prompt}_{i}"
tracker.writer.add_images(tag, formatted_images, step, dataformats="NHWC")
i=i+1
tracker.writer.flush()
elif tracker.name == "wandb":
Reproduction
Start Train_controlnet_sdxl.py with params:
accelerate
launch
train_controlnet_sdxl_orig.py
--pretrained_model_name_or_path="model/stable-diffusion-xl-base-1.0"
--pretrained_vae_model_name_or_path="model/sdxl-vae-fp16-fix"
--output_dir="output"
--train_data_dir="fillsmall2"
--cache_dir="cachedir"
--mixed_precision="fp16"
--resolution=512
--learning_rate=1e-5
--max_train_steps=10000
--train_batch_size=1
--gradient_accumulation_steps=1
--max_grad_norm=1.0
--seed=42
--checkpointing_steps=1000
--enable_xformers_memory_efficient_attention
--use_8bit_adam
--report_to="tensorboard"
--lr_scheduler="constant_with_warmup"
--lr_warmup_steps=100
--logging_dir="logs"
--validation_image
"validation_images/1.png"
"validation_images/2.png"
"validation_images/3.png"
--validation_prompt
"red circle with blue background"
"green circle with brown background"
"blue circle with white background"
--validation_steps=10
--num_validation_images=2
Open http://localhost:6006/ (Tensorboard)
Logs
System Info
Diffusers version: 0.34.0.dev0
Torch version: 2.7.0+cu126
XFormers version: 0.0.30
Python version: 3.10.11
Windows 10
Who can help?
No response
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't workingstaleIssues that haven't received updatesIssues that haven't received updates