[Help] SDXL x ComfyUI Template Generation (lemmy.world)

submitted 6 months ago* (last edited 6 months ago) by stevedidWHAT@lemmy.world to c/ai_art@lemmy.world

2 comments fedilink hide all child comments

Good afternoon yall,

I'm having trouble generating fliers, greeting card interiors, and the like. The model reeeally wants to generate the text but I reaaally need it not to so that I can layer it in, in post. Any tips, workflows, prompts, etc you all would recommend?

Thanks in advance!

Edit: I'm working with: SDXL Base + Refiner, DPMM2++ Ancestral comfyui I'm using the same prompt for L and G for both positive and negative and am obviously using text and words in my negative prompt (using a weight of 1.3)

top 2 comments

sorted by: hot top controversial new old

[-] tal 2 points 6 months ago* (last edited 6 months ago)

Put the token "text" in the negative prompt? Maybe "writing", "signature", "watermark", "label", etc.

EDIT: A maybe less-shotgun thing to try: use an image-editing program to cut out just the portion with the text. Install the Clip Interrogator extension in Stable Diffusion. Take the cut-out label, and insert it into img2img in Stable Diffusion. Then use Clip Interrogator. That should give you a list of tokens that will generate something like the image that you're seeing. That'll probably give you a better idea than my guesses as to what tokens are associated with the text there. Maybe it's "sign" or something like that.

[-] stevedidWHAT@lemmy.world 1 points 6 months ago

Yeah it’s likely to do with it being a “flier” the results are so good, it’s just the text generated is so bad. Hate to waste so much of it but it’s pretty non -workable. I’ll try out that clip interrogator. I think overall enrichment or smarter prompting will likely get me there. Thanks for commenting!

this post was submitted on 21 Dec 2023

5 points (100.0% liked)

AI Art & Image Generation

1916 readers

1 users here now

A place to share images and art generated by artificial intelligence and similar tools.

Rules:

All posts must be relevant to image generation with artificial intelligence.
Please include the name of the AI or tool used to generate your image at beginning of your post to promote searchability. Example: "[Midjourney] Picture of a lake."
It's not required, but we encourage you to include the prompt used to generate the image in the description of your post.
To avoid spam, please try to limit yourself to five posts a day. Feel free to add as many images to your posts as you'd like.
Please keep NSFW content to a minimum. Risque content is allowed, but pornographic AI art is not. There are plenty of other places to share that. Posts not flagged as NSFW will result in a temporary ban.
Do not self promote your AI tools you created without mod permission. Also any other post about AI tools that seem sketchy will be removed and the user banned at the moderators discretion. Please report a post if you think it should fall in line with breaking this rule.
Please be nice to your fellow users and make sure to follow Lemmy World's rules of conduct: https://mastodon.world/about

Recommended Communities:

Check out !imageai@sh.itjust.works for more AI Images.
Check out !dnd_ai@lemmy.world for discussion about AI tools you can use in your Dungeons & Dragons games.

founded 1 year ago

MODERATORS

Hyrulian@lemmy.world