301
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 14 Sep 2026
301 points (97.2% liked)
Technology
88132 readers
4407 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 3 years ago
MODERATORS
I would say that AI is becoming much more effective for the tokens produced. I have been running Qwen 3.8 Flash-Next on my new PC. This AI model weighs in at 120b parameters, with another 50b added via an Engram table that costs about an extra 20% in RAM for its parameter count. This is a major jump in world knowledge, and the model in question has 262k context length.
While experimental and with rough edges, this model has been able to use Lingua Gacha to undertake a game translation project - understanding and converting a Chinese game into English.
Agentic AI has become practical on local hardware over this last year, and there looks to be much more refinement to come.
00000000
What we are seeing with Anthropic and the other American companies, is a scramble to protect themselves from the consequences of badly planned data centers and poor practices in AI development. Their Chinese competition has produced much more efficient models, while delivering almost the same level of quality as American offerings. This means that local AI is becoming "good enough", which makes data centres and AI subscriptions unnecessary for many businesses if they distrust the cloud.