Decent system prompt using the new tag template system. #141
LoFiApostasy
started this conversation in
General
Replies: 1 comment
-
Thanks for sharing your workflow. It's very helpful.
I'm glad you like it. Here's my Ko-fi link: https://ko-fi.com/jhc13
Unfortunately, 6-bit is not supported in Hugging Face Transformers, which is the library used to run the models. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
First of all, @jhc13 please drop your buy me a coffee link, i love the new update.
This seems to work really well using the xtuner llava llama3.
1st pass generate your WD tags.
2.d pass settings:
Model: xtuner llava llama3
Start caption with: Image Medium:
Prompt:
Insert before first tag
Load in 4bit: True (it would be nice to have this editable, 6bit is really good quality)
Discourage from caption:
Minimum tokens: 100
Maximum tokens: 150 (or) 225 (or) 300
Number of beams: 6 (with 4bit: true and 24g of ram, adjust to your available vram)
Temperature: .9 (adjust per your own experimentation)
The rest is defaults.
Hope this helps others, this is meant as a starting point and to demonstrate how you can get two experts in a single shot. Adjust the experts to your own needs, i found that without tagging the art styles the text to image model lost style flexibility.
Cheers!
Exit: Updated banned caption list
Beta Was this translation helpful? Give feedback.
All reactions