This is an automated archive made by the Lemmit Bot.
The original was posted on /r/stablediffusion by /u/Enturbulated on 2024-08-19 11:10:06+00:00.
Forge just updated [1] and added a bunch of GGUF quant types! And, gee, the list of types there looks just about exactly like the list of quants available from city96[2]. Gee, What a coincidence!
So what the hell, here goes!
[Images got eaten on post? Eh, link here: ]
Prompt: (photograph of) a perky pug in a cluttered kitchen, the floor strewn with the remains of cereal boxes, standing next to a sign reading "I found food!"
CFG 1, Distilled CFG 3, 896 x 1152, Euler / Simple, 20 steps
Running Forge, from commit e5f213c "upload some GGUF supports"
RTX 2060 6GB, using CPU for RNG
Four images per quant, seeds 4111973613 through 4111973616
flux1-dev-Q2_K 6m16s total
flux1-dev-Q3_K_S 7m15s total
flux1-dev-Q4_0 6m40s total
flux1-dev-Q4_1 6m51s total
flux1-dev-Q4_K_S 6m50s total
flux1-dev-Q5_0 8m36s total
flux1-dev-Q5_1 8m34s total
flux1-dev-Q5_K_S run errored - sha256sum matches with huggingface's info - skip for now!
flux1-dev-Q6_K 7m52s total
flux1-dev-Q8_0 7m10s total
Mostly straightforward increase in detail as quant size goes up, or increase in variance in images as quant type goes down in size. Also as expected, time increase with file size increase, though Q3 and Q5 take more time (because more steps) to process. As always, expect some variation with different hardware though the trends tend to hold.
Worth a mention that model behavior may be influenced in other ways. Playing with dev and schnell Q8 and Q4 a little bit before this, Q8 may more readily change image styles if it sees keywords (or combinations of keywords) that suggest a style. Shouldn't be surprised at other aesthetic quirks that surface between the different quants. Not explored this enough to say much else about that yet though.
Oh, if you're wondering about choice of subject material? Yes, I'm a bit annoyed at a lovely puppy that did nothing wrong but take advantage of opportunity people should not have given it ... repeatedly! :-)
[1]
[2]