view the rest of the comments
Ask Lemmy
A Fediverse community for open-ended, thought provoking questions
Rules: (interactive)
1) Be nice and; have fun
Doxxing, trolling, sealioning, racism, toxicity and dog-whistling are not welcomed in AskLemmy. Remember what your mother said: if you can't say something nice, don't say anything at all. In addition, the site-wide Lemmy.world terms of service also apply here. Please familiarize yourself with them
2) All posts must end with a '?'
This is sort of like Jeopardy. Please phrase all post titles in the form of a proper question ending with ?
3) No spam
Please do not flood the community with nonsense. Actual suspected spammers will be banned on site. No astroturfing.
4) NSFW is okay, within reason
Just remember to tag posts with either a content warning or a [NSFW] tag. Overtly sexual posts are not allowed, please direct them to either !asklemmyafterdark@lemmy.world or !asklemmynsfw@lemmynsfw.com.
NSFW comments should be restricted to posts tagged [NSFW].
5) This is not a support community.
It is not a place for 'how do I?', type questions.
If you have any questions regarding the site itself or would like to report a community, please direct them to Lemmy.world Support or email info@lemmy.world. For other questions check our partnered communities list, or use the search function.
6) No US Politics.
Please don't post about current US Politics. If you need to do this, try !politicaldiscussion@lemmy.world or !uspolitics@lemmy.world
7) No Hit-and-Run questions.
Please don't delete your post for no apparent reason. If you plan on deleting a question later, say so in the post, or if you feel that you have a good reason to remove it, message a mod beforehand. It's not fair to the ones who took their time to answer, and it's not in the spirit of the community.
8) No Bots.
Posts or comments from bots, LLM's, AIs, Neural Networks, Transformers, or Marvin the Paranoid Android are not welcome in AskLemmy. Real humans only please.
Reminder: The terms of service apply here too.
Partnered Communities:
Logo design credit goes to: tubbadu
My concern is that the current models have been trained on current technology by stealing knowledge from the existing pool of senior and junior engineers as well as a whole load of hobbyists.
If everyone moves up to senior now using LLMs, that's all well and good now, but then there'll be no juniors to steal the grunt work from to train AI and no-one to move up to senior in a decade or two.
Do you really think that the hobbyists are going to be enough to steal from to perpetuate the system in the near future?
It also means that when some new technology comes out there won't be a wealth of knowledge for the AI to consume and regurgitate, so the use of new technologies will be hindered if everyone relies on AI trained on current technology.
I had something about stagnation in the comment at one point, but I guess my attempt to make it implicit didn't quite survive the edit.
I read yours to be about stalling with current tech, which is certainly the case. I was trying to make it explicit that the stagnation is an issue for both current and new technologies that doesn't have anything for AI to be trained on.
Reworded to make that clearer.
That's my concern too. We're already seeing middle school and high school kids out sourcing all their thinking to AI. Once this generation of devs is gone, who's going to replace them? I'm sure there will be SOME people who find a fascination with learning and knowing and trying code on their own. But that won't be enough people.
You act like it is their code ...
The majority of coders "steal" code from other coders on Stack Overflow. This has been happening since coding was invented.
The thing is that it's apparently expected that everyone use AI.
With StackOverflow it was less than the full complement of developers who went there for help, so there was always someone to provide answers.
AI will kill StackOverflow and places like it. AI will create a dearth of new developers, and those that still choose the profession will be AI rotted and unable to move up or advance. They won't post anywhere on the Internet, and even if they do, what they know was derived from StackOverflow before it stopped being updated. That's not even a complete cover of tech now, let alone several years down the line when tech has moved on.
This whole thing is cashing in an investment and in 20 years we're going to be confused about why that investment is no longer accruing interest.
We've already seen models degrading from being trained on LLM-generated data. The big companies were overly eager to follow the EU directive to watermark output. I think that's solely so that they can filter it out when scraping for future training data. They're running out of good training data to steal. I don't imagine they'll be paying a fair wage to anyone generating novel good data.
Entry jobs disappearing is uncharted territory. My latest hire had three years work experience in a very niche field. I'd have a hard time justifying anyone more jr than that for a startup burning investor capital.