Technology

59575 readers

3078 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related content.
Be excellent to each another!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, to ask if your bot can be added please contact us.
Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago

MODERATORS

313

Meta says you can’t turn off its new AI tool on Facebook, Instagram (globalnews.ca)

submitted 7 months ago by return2ozma@lemmy.world to c/technology@lemmy.world

43 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] Larry@lemmy.world 3 points 7 months ago (1 children)

I tried llamas when they were initially released, and it seems like training took garbage amounts of GPU. Did that change?

[–] Womble@lemmy.world 2 points 7 months ago

Look into quantised models (like gguf format) these significantly reduce the amout of memory needed and speed up computation time at the expense of some quality. If you have 16GB of rm or more you can run decent models locally without any gpu, though your speed will be more like 1 word a second than chatgpt speeds