this post was submitted on 19 May 2024
109 points (100.0% liked)

Free and Open Source Software

17966 readers
4 users here now

If it's free and open source and it's also software, it can be discussed here. Subcommunity of Technology.

This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 2 years ago
MODERATORS
Gaywallet@beehaw.org
alyaza@beehaw.org
109
FOSS AI painting with Krita (swg-empire.de)
submitted 6 months ago by bjoern_tantau@swg-empire.de to c/foss@beehaw.org
13 comments fedilink hide all child comments
 

It's so awesome that I can let my kid paint with Krita and let her enhance the picture with AI live. She wanted to have an AI picture editor on her phone but I didn't like the privacy policy. But Krita AI Diffusion came to the rescue.

After testing it out myself I showed her Krita, the most important tools and how to use layers and before I could say anything she was off to paint a nice landscape. When she was finished I actually got to enable the AI plugin and show her the ropes around that. And after enabling live painting she went ham and added a phoenix and a giant hand.

Hardest thing about it was that she had to describe what she wanted in English. But she's already learning that in school so it shouldn't give her too much trouble in the long run.

Anyways, FOSS rules!

top 13 comments
sorted by: hot top controversial new old
[–] GravelPieceOfSword@lemmy.ca 8 points 6 months ago* (last edited 6 months ago) (1 children)

This is the caveat for me for now.

To run locally a powerful graphics card with at least 6 GB VRAM is recommended. Otherwise generating images will take very long!

I've got decent RAM on an I9, but my graphics card, which is what matters here, isn't up to par.

[–] bjoern_tantau@swg-empire.de 3 points 6 months ago

Yeah. Took me several days to set it up with the AMD card on my gaming rig. I also tried to run it on a Steam Deck but I gave that up. As it says, using the CPU is possible but painfully slow.

[–] Martineski@lemmy.dbzer0.com 7 points 6 months ago (1 children)

I'm loving the use case! Big assumption but I wonder if this technology will actually help children be interested in art?

[–] bjoern_tantau@swg-empire.de 7 points 6 months ago

When I look at what she does before even hitting the AI button I think her artistic interests are not in trouble. But she always liked drawing and painting anyways.

[–] haris@mander.xyz 2 points 6 months ago

Looks amazing!! Does anyone know if there is something similar for GIMP?

[–] WalnutLum@lemmy.ml 2 points 6 months ago (1 children)

I didn't realize you could run something like this on your phone

[–] bjoern_tantau@swg-empire.de 17 points 6 months ago (3 children)

Nah, that's running on a laptop with the actual AI stuff being rendered on my gaming PC. I think that's basically what all the AI tools on phones do as well. It's just some company's gaming PC.

[–] TehPers@beehaw.org 3 points 6 months ago

Not quite a "gaming PC" since, at least if they're using something like Nvidia's Hopper GPUs (or relying on another service that does), they're not designed for gaming (and in the price range of $10k-$100kish), buuut if you ignore the finer details then fundamentally it's basically like that. They'd send the image to their "very expensive gaming PC server" where the inferencing would be done.

[–] ColdCreasent@lemmy.ca 2 points 6 months ago

There is one app that runs the model on an iPhone. It’s called “draw things: ai generation“. But you aren’t wrong about AI image generation usually needing a gaming pc or at least a video card with a lot of video ram to hold the model in while it works.

[–] WalnutLum@lemmy.ml 2 points 6 months ago

Ahhhh that makes a lot more sense, thanks!

[–] webuge@lemmy.dbzer0.com 1 points 6 months ago (1 children)

I tried it myself and it is very interesting but I was a little confused with what options to use. Can you give some examples? For example wich model and strength did you used? How do you used the layers for the controlnet? Thank you

[–] bjoern_tantau@swg-empire.de 2 points 6 months ago (1 children)

I watched some tutorials on YouTube.

For this image she used live mode of Comics & Anime at about 30% strength. Increasing or decreasing the strength as needed. She painted filled out shapes, like filled out triangles for the mountains, green and blue for the field and sky and the general shape of a bird in orange for the phoenix.

Just painting the outlines generally doesn't work as well as using filled out shapes. And it's important that you describe. what's in the picture.

We didn't use the layers at all. If you can find some documentation on those that would be appreciated, I don't get them either.

I recorded her work. I'll ask her if I may upload it.

[–] webuge@lemmy.dbzer0.com 1 points 6 months ago

This helped a lot thank you.