461
you are viewing a single comment's thread
view the rest of the comments
[-] Wildmimic@anarchist.nexus 25 points 2 days ago

“This would keep [US] AI token prices high, giving China an opportunity to export cost-effective inference services, supported by abundant electricity supplies,” Ng said.

This sentence contains many layers, and all of them are somewhat wrong in multiple dimensions, in my opinion.

  • AI token costs didn't drop at all since all of this started, they rose significantly because of the increasingly larger models used. Barring an scientific breakthrough, the hardware side is already in the area of physics where further significant improvements are unlikely, as we all saw in the slowdown in performance gains over the last 15 years. And it is in the nature of GenAI that it is computational intensive - all this matrix multiplication is necessary, or else they would have already replaced it.
  • The most important export China has made in the AI space are open weight models like DeepSeek and GLM 5.3, devaluing tokens coming from Anthropic, OpenAI, Meta, and so on.
  • the "abundant electricity supplies" that the US are missing are a direct result of the regulatory capture in the US, which emphasizes power generation using carbohydrates to funnel more money into specific companies instead of widespread solar and wind power adoption with battery storage. (The US has more than enough strategic reasons to strive towards being able to build their own solar and wind generation modules, which would actually create jobs and encourage adoption.)
[-] uriel238@lemmy.blahaj.zone 2 points 1 day ago

I heard that tokens got cheaper, but the models now use more tokens to accomplish the same tasks.

Also, non-AI companies are widely halting tokenmaxxing, instead telling their work staff to use AI for the use-cases that work, and otherwise go back to human methods.

I also heard that engineers ordered to tokenmaxx (and given incentives to do so) would just prompt ridiculously difficult complex problems, and that would burn through and overrun company token budgets.

The metric is not the goal.

this post was submitted on 05 Nov 2026
461 points (97.9% liked)

Technology

89543 readers
3722 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS