252
you are viewing a single comment's thread
view the rest of the comments
[-] jumping_redditor@sh.itjust.works 8 points 22 hours ago

because LLMs don't need the existing data on bioweapons in their training to be able to design them, just enough information on biology.

[-] DreamlandLividity@lemmy.world 3 points 22 hours ago* (last edited 22 hours ago)
[-] Cocodapuf@lemmy.world 6 points 14 hours ago

Doubt all you want. Was the LLM trained with information about toxic or harmful chemicals? Yes. Was the LLM trained with information about weapons? It's practically unavoidable.

The LLM is perfectly capable of mashing two concepts together, that's essentially all it does. So will its concoctions work? We'll find out.

[-] DreamlandLividity@lemmy.world 1 points 1 hour ago* (last edited 1 hour ago)

We'll find out.

We won't. The companies don't sort their training data to an extent where they could reliably exclude something. So they won't. They will keep adding bypassable filters on top and pretend it's not their problem people bypass it.

If humans have the language to express something, an llm can arrive at that conclusion. That doesnt mean each one will be valid or technically feasible but by virtue of how they work they can arrive at a recipe for such things. It is the reason why they are "good" at programming and proofs, it can flow probabilistically from the corpus of data.

[-] DreamlandLividity@lemmy.world 3 points 17 hours ago* (last edited 17 hours ago)

Well, ok. But by that logic, so can a monkey smashing keys on a typewriter for long enough. If the LLM is not trained on something, it does not see the connections between the words. So it can generate text that looks like chemistry/bioengineering but chances are it would not be a weapon, just random whatever.

this post was submitted on 16 Nov 2026
252 points (96.3% liked)

Technology

89881 readers
3801 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS