301
submitted 12 hours ago by Beep@feddit.online to c/technology@lemmy.world
you are viewing a single comment's thread
view the rest of the comments
[-] magnue@lemmy.world 10 points 11 hours ago

You think scammers in Africa/India are capable of running a local open weight model equivalent to the performance of a cloud frontier model?

[-] Seralth@piefed.seralth.com 3 points 4 hours ago

You don't need something that power to do damage. And fuck the frontier model of 6 months ago and now are basically two entirely different things. In another six months?

Claude fable had a bunch of concerns on release and you don't think what evers out in the next year isnt going to beat it?

Getting a bunch of beat up Mac minis together and running something isn't that hard for a mid tier operation. They don't have to be fast. They just have to turn on.

[-] NoLemurs@lemmy.world 13 points 11 hours ago

The ones in Russia definitely are. They don't have to be local models - you run them in the cloud like anyone else.

The idea that the frontier labs have LLMs with special capabilities that make them dramatically better than the top open-weight models is largely marketing.

The reality is that most systems are poorly secured, and LLMs make exploiting vulnerabilities fast, cheap, and easy. What would have taken a trained security researcher weeks before can be done by a much less skilled attacker with an LLM in a few hours.

[-] 4am@lemmy.zip 15 points 10 hours ago

This is correct. We can thrash all we want about slop and hallucinations, but from a defensive posture position, the models only need to be right some of the time and they still constitute a threat.

Knowing it sucks and pretending it doesn’t exist are two different things.

[-] NoLemurs@lemmy.world 6 points 9 hours ago

the models only need to be right some of the time and they still constitute a threat.

Right!?!

And with how cheap and fast they are to run, they don't have to be right that often as long as a separate run can verify/validate claims. In a lot of ways what the LLMs do should probably be thought of as just a very sophisticated sort of brute force approach. You're effectively just searching the space of combinations of known vulnerabilities. It doesn't require particular cleverness, just an encyclopedic knowledge, a reasonable way to prune the search space, and the ability to put in the compute time.

this post was submitted on 15 Oct 2026
301 points (98.4% liked)

Technology

88796 readers
4860 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS