Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Let's make UNet2DConditionModel take in not only class labels, but also continuous labels #10257

Open
Foundsheep opened this issue Dec 17, 2024 · 0 comments

Comments

@Foundsheep
Copy link
Contributor

The current UNet2DConditoinModel can take in class labels as described here.

However, in my case and also some other people are using it with continuous labels and in that case there needs to be nn.Linear-like layer in addition to nn.Embedding in about this place

As I mentioned, there seems to be some needs for it, and even if the paper does not address the issue in the way I described, this paper (Continuous Conditional Diffusion Models) is one of the trials to use continuous labels in diffusion models.

To be clearer, I'm trying to generate images based on conditions that are regression-like values, such as heights and widths

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant