The LLM's are not run on the gpu but rather on the cpu "AMD Ryzen AI 400" for the higher model and use therefor the system memory.
My take is a little different. If people really want AI they should pay additional cost and AI should be a addon feature on your PC.
Additional Costs -> more powerful AI centered Chips ( as least as possible power consumption ) which can use much much more local fast memory ( imho 256 GB should be in the long term the minimum ).
That enables local AI's to be the solution for privacy and control of long term costs and i guess in 99% local AI's will do the job fine enough.
Sadly noone will be on our side cause they want to put AI Usage / PC Usage overall behind a monthly subscription in the long term.
Right now we are just as always in the phase of making people depending on a technology.
@columbus the dot.com bubble bursted but some tech stayed. Imho it will be the same with AI ( even more precise different Machine Learning Stuff ). ML has been around before the hype and there will be ML after the hype.
https://datacentremagazine.com/news/ibm-ceo-questions-trillions-in-data-centre-spending
^^^ but this should make clear that the current way will most likely end in a big crash for capital IMHO.
@dual_sport_dork @silence7 good times
@themurphy @rigatti There is one difference ... LLM's can't be more efficient there is an inherent limitation to the technology.
https://blog.dshr.org/2021/03/internet-archive-storage.html
In 2021 they used 200PB and they for sure didn't make a copy of the complete internet. Now ask yourself if all this information without loosing informations can fit into a 1TB Model ?? ( Sidenote deepseek r1 is 404GB so not even 1TB ) ... local llm's usually < 16GB ...
This technology has been and will be never able to 100% replicate the original informations.
It has a certain use ( Machine Learning has been used much longer already ) but not what people want it to be (imho).
@TheBat @grue how do you define not working correctly ? ...
the GFX Card booted
the GFX Card rendered the desktop
the GFX Card rendered Games
... the only issue it wasn't as fast as possible ...
-> solution on windows -> you report and get a new driver or you get a new driver cause you don't know that you don't have the max performance
-> solution on linux -> you report and get a new driver or you get a new driver cause you don't know that you don't have the max performance
^^^ where is the difference ?
IMHO -> you wouldn't need to write up such an article if people would think that AI adds an value to their life which is in replacable.
Example:
As of now AI is a big toy which you try to justify the use. A google search / fulltext search is much more efficient than using a AI Summary which you should by definition check after anyway.
You try to justify that we spending more electricity on a technology where we already have working solutions and will need those working solutions in the future too.
PS: I personally think the fundamental flaw in your article is that you define something can get replaced which is often not the case or you don't compare it to the current most used solution. Example -> Most books aren't printed anymore but only digitally published. The books which are printed needs to be printed as reference and to archive it long term or are printed for book lovers. So you can't say there will be 3000W less because it's not printed anymore.
@michaelmrose @swordgeek I 100% agree that Mozilla is important but it's also clear that currently their is not enough business to keep Mozilla going. I don't blame them for trying to make a Business , i blame them for not following their former values. You can make a business and still mostly follow values ( look for example to GOG ).
And what i don't like the most is the change from opt in to opt out. Every new feature most users don't want. You can argue that they know this and make it harder and harder to turn off those new "features" . The last time it was hidden in a sub menu in the settings ( switching off sending data to their ad service ) now it's hidden in about:config.
I guess next time you need 3rd party patches and compile the browser yourself to switch a "feature" off.
@Canconda who knows how many people get moved by this topic. Let's say noone believed in >1.4m people signing a petition for game preservation either ... noone would have believed that europeans say that US Tech Companies should be regulated even if it means worse tarrifs ... if you already give up before trying to change something you lost already. From my point of view this creates something which can be used in a really bad way for content moderation ( some would call it censorship ).
@DarkSideOfTheMoon @1984 and all this additional JavaScript and Elements and makes the side's just horrible slow. Compare this with CSS+HTML only sides omg how good they can feel ... I also prefer nowadays text mode browsers again, cause a good readable font + focus on what is important ... the content itself. I really get pissed if websites with public content can't be run anymore without javascript (wtf is up with you guys ?) ....
I would also think that https://www.vintagestory.at/ is in a good shape to compete for a great minecraft like game ;)
glog78
0 post score0 comment score
@blaggle42 @solrize
https://www.w3tutorials.net/blog/firefox-add-ons-how-to-install-my-own-local-add-on-extension-permanently-in-firefox/
There er multiple ways but yes they don't make it easy cause the want to make the attack vector aka ( a "friend" sent you a email with the "hottest new" firefox extension ) as small as possible.