Any sufficiently analyzed magic is indistinguishable from ~~science~~ bullshit!
From "Girl Genius"
Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.
This is not debate club. Unless it’s amusing debate.
For actually-good tech, you want our NotAwfulTech community
Any sufficiently analyzed magic is indistinguishable from ~~science~~ bullshit!
From "Girl Genius"
idly, replying from offsite? I see you use ^
but that makes subscript on lemmy instead of strikethrough
or I guess it's a style choice I'm not familiar with :D
oh, right as I send this, I see the update. lawl
I should have used the preview ^_^
PS: Again!
Lemmy Posting Casino
I maaaaaay have just done a thing, because this was just an absolutely phenomenal fedi domain
will see if I change my mind by next year
Creation Date: 2024-09-09T14:09:21Z
Nice one
the renewal price is 🤨 but I'll decide by then
Y'know what, I started out agreeing with the author, but now I realize that their critique is fundamentally not technical enough to hit the mark.
Meta and Google own half of the fiber optic cables supplying internet services across continents.
This is the only part of this article I'll endorse. Y'know how this happened, right? Google bought dark fiber that was laid by the USA and privatized repeatedly. Meta set up Internet.org, a project that put phones with free Facebook into the hands of ~~exploitable~~ impoverished folks around the world, and then lobbied local governments to subsidize fiber rollouts to handle the induced demand. At some point, you gotta suck it up and start blaming capitalism, not only oligarchs or trusts, for this situation.
The cloud is a lie.
The clouds are products and services. They are a consumer's understanding of the underlying infrastructure. It's a lot more work than a mere fib!
Over a decade or more, while our politicians were busy sub-tweeting fascists for clout, GAMM was buying up all the infrastructure it could carry. … The production cost of data storage plummeted by 94% in just ten years. You can't sell 50GB plans to college kids who own M2 Macbook Pros with a terabyte of solid-state storage.
Okay, now read between the lines. If an oligopoly (1) buys many warehouse-scale computers, (2) in an environment where prices are rapidly dropping on new hardware, (3) in a market which already provided basic local compute to all of your customers, then this is going to produce a massive second-hand market from all of the smaller shops which were using commodity hardware until they got displaced. Google, Apple, and Meta all purchase custom datacenter hardware at a scale which requires a consortium merely to ensure that the motherboards are printed fast enough, obsoleting workstations from Dell and HP.
This has led to something of a boon for USA homelabs. I can purchase RAM-heavy workstations at less than $1/GiB, disks are at least half a TiB, small form factors are available as long as you're willing to do some BIOS work, rackables are something like $100/U, etc. We're talking discounts of 90-95%. In my house, a $200 workstation has more disk, RAM, cores, and system stability than a $600 gaming desktop, and the only thing missing is purple gamer LED strips.
Amazon controls 35% of the cloud computing market and has created a tight seal around its customer base. … Amazon is mostly quiet as the frontrunner in the cloud computing market.
The author hasn't worked in the business. That's fine, but it means they don't know that AWS is not secure in its position. AWS is only tolerated because product managers ask for it, not because engineers like it; AWS is shit. For comparison, Google Cloud is fine but expensive and a third of the services are bad, Microsoft Azure is awful aside from their k8s, and Meta doesn't operate a public cloud.
Yes, if everyone open-sources its AI models, they cannot build a moat on proprietary software. However, Google's memo fails to mention that it already has the infrastructure to run computing-hungry AI models and that infrastructure is wildly expensive to build.
Click through to their side rant. This is where I realized that the author could be more clueful. If any of GAMM train another Llama-sized model, and it is at all good, somebody will put it up on Bittorrent and leak it to 4chan. This is literally how we got Llama. There is no moat.
Don’t get me wrong, open-source tech is great and important, and wonderful. But it’s not like the average person runs a Large Language Model on their Mac to make grocery lists. If you are, in fact, doing this, you are a nerd and I love you. But you’re not the average user.
He is a year behind in a field where things change every few months. See RWKV's recent blog post. There is no moat.
So, who gives a shit if Meta put Llama on Github for free? … Read the terms and conditions. Llama is not open-source.
You naïve motherfucker, we the neighbors took it from Meta and we will take it again. There is no moat.
Mark Zuckerberg is a capable businessman who understands the industry better than most tech founders. I don’t know the guy personally, but look at the facts.
This is the most sneerable part of the article for me. You're supposed to be a writer and humanist. It should be obvious after doing maybe five minutes of research that Zuck thinks of himself as a modern-day Octavian. Same haircut, same daily routine, same politics. Zuck is exactly the kind of person to hire a private navy to win a civil war for him by sailing off to defeat a pirate captain while he sits on a beach and idly thinks of how cool it will be to rule the Roman Empire.
Because why give a shit who sells the milk jars when you own the motherfucking cows, baby!
Have you seen the prices on the pre-owned cow market lately? Maybe milk is just permanently getting cheaper. The existence of Big Dairy and government cheese doesn't preclude local dairies, either.
My tip for this guy: Look up this new company "nVidia", they make computer chips or something, I dunno. I wonder if they ever do anything anti-competitive~
One of said engineers here, and YMMV.
I would probably pick AWS over the others for most practical things as long as I had a reasonable support contract.
AWS is only tolerated because product managers ask for it, not because engineers like it; AWS is shit.
Yes, but the competition is hardly much better. Well, maybe Google is, I didn't touch it much back when I still did public cloud stuff. Azure leads with "look, our VPS offering is called 'Virtual Machines' instead of 'EC2', isn't that simple?" and then proceeds to make everything even clunkier and more complicated than AWS. And don't get me started on the difference in technical and customer support from the two.
There is no moat.
You keep reiterating this, but I still need you to explain the implications. Ok sure, you can run a model on a home computer. Nonwithstanding that those models still amount to overhyped novelty toys, home computers are also capable of running servers, databases, APIs, office suites, you name it. Still, corporations and even consumers are renting these as SaaS and will continue to do so in the foreseeable future.
The AI fad is highly hype driven, so there's still incentive to be the one who trains the latest, biggest and shiniest model, and that still takes datacenters' worth of specialized compute and training data. LLM-based AI is an industry built on FOMO. How long until that shiny new LLM torrent you got from 4chan is so last season?
And the OP is correct. Llama is not open source. "The neighbors" only took it from Meta in the same sense warez sites have taken software forever. Only in this case the developer was the one committing the copyright infringement.
I hear you. You're largely right, and I think it's a perspective shift.
… explain the implications.
I need to write a longer post about the justification (basically, what is a moat anyway?) but without a moat, a computation vendor can't profit from their capital investment. This kills the OpenAI.
Bonus sneer: Zuck is obsessed with the Roman Empire and Latin culture. I have a Facebook challenge coin with a Latin inscription surrounding an Earth criss-crossed with circular paths. Here's my [implied] translation: "[Stretching] our reach around the world, we are the connection [between people]." Do the pieces fit yet?
I wasn't aware that the big four were buying the transport infra too
it’s very bad news if so — we won’t even have the option to escape these assholes if they own all of the fabric of the network
actual fucking anti-monopoly enforcement cannot come goddamn soon enough
in before some fucking asshole posts “but how can it be a monopoly when it’s 4 companies colluding to control the entire market HMMMM? do you just hate capitalism and success?”
Uhm, actually the correct term is ~~epheb~~ oligopoly.
oh fuck you crossed the libertarian streams, now the thread’s gonna be destroyed by bears
Wait but you already have this literal system for internet service in the USA, no? Isn't it literally four companies that partitioned the country into their ISP fiefdoms?
So nothing would change is what you're saying?
we have that fucking nightmare for residential service; what I’m saying is if they own the substrate, we’ll get that same fucking nightmare everywhere else too. and as we’ve seen in the US, it’s very easy for a broken regulator to see 2-4 companies colluding and decide that’s not a monopoly and no action is needed
it's a shame that packet radio is so fucking slow
They got tired of all the "SV keeps re-inventing trains and buses à la carcinisation"* memes and decided to remove them from public consciousness altogether
*Yes, I did initially misread "transport" as "public transport" and not "internet transport" even after skimming the article. No, I will not change this joke. Yes, I look like a fool now, but when silicon valley vertically integrates away your precious commute I'll look like the best damn prediction marketeer out there.
I autocorrected it to transit in my head (because that's the term of art and unfortunately I am cursed with that tier of networking exposure) but it also threw me for a moment
and then I groaned because, as you remarked, it's also true in the respect of these dipshits trying to take cars and buses and trains
Me, a network goblin: wait what do they mean physical layer or did meta try to buy TCP somehow?
Well I was aware of Google Fiber for years now, but the other three are indeed a surprise.
Especially Facebook? Like what the fuck do you need that for? Your business is entirely Instagram ads?
years ago facebook got extremely into owning the channel in multiple ways (for the reasons outlined in that post). the FreeBasics program, Libra, etc. all kinds of shit
because if you own the channel, you can charge others any amount you want for access, while giving yourself ~~special treatment~~ "having different internal cost structures between business units" (cf. amazon, as doctorow's written in recent years)
also, this stuff isn't "google fiber" only as in the residential/muni shit but also the undersea this-links-countries kind: https://cloud.google.com/blog/products/infrastructure/learn-about-googles-subsea-cables