In case of the revolutionary LLM technology we have quality in = garbage out also!
Were you invited to the lavish opening party with the flamingos and the dancers at the huge mansion with two pools and all that?
If yes then you're definitely the mark.
The real test is whether you're included in the 5 person Signal group they coordinate the date and time to dump
I'm sure a bunch of people buy knowing it'll collapse, but thing they're so smart and savvy they'll sell it just in time to get rich
a thermodynamics startup
what
Like what do they do, find ways to increase entropy faster? Or are they bootstrapping thermodynamics from first principles to disrupt the field of physics with blockchain-powered quantum synergy
Correct answers are correct answers. The only thing LLMs typically are bad at, are things that are seldom discussed or have some ambiguity behind them.
Lol what, how many questions you ask in your life are entirely unambiguous and devoid of nuance? That sounds like a you issue.
but i still think that it’s a little suspect on the grounds that we have no idea how many times they had to restart training due to the model borking, other experiments and hidden cost
Oh ye, I totally agree on this one. This entire genAI enterprise insults me on a fundamental level as a CS researcher, there's zero transparency or reproducibility, no one reviews these claims, it's a complete shitshow from terrible, terrible benchmarks, through shoddy methodology, up to untestable and bonkers claims.
I have zero good faith for the press, though, they're experts in painting any and all tech claims in the best light possible like their lives fucking depend on it. We wouldn't be where we are right now if anyone at any "reputable" newspaper like WSJ asked one (1) question to Sam Altman like 3 years ago.
Okay I mean, I hate to somehow come to the defense of a slop company? But WSJ saying nonsense is really not their fault, like even that particular quote clearly says "DeepSeek said training one" cost $5.6M. That's just a true statement. No one in their right mind includes the capital expenditure in that, the same way when you say "it took us 100h to train a model" that doesn't include building a data center in those 100h.
Beside whether they actually lied or not, it's still immensely funny to me that they could've just told a blatant lie nobody factchecked and it shook the market to the fucking core wiping off like billions in valuation. Very real market based on very real fundamentals run by very serious adults.
It also takes literally 1.5s to search and find out what it was
I didn't read it because I don't think there's much emphasis on it in school outside of the anglosphere, but the 2005 movie was a classic, must've watched it a dozen times. Now that I recall who the director was, though, I kinda understand why you don't talk much about it anymore...
don’t even get me started on “whole language learning” and “new math”
I don't know what "whole language learning" is, and I'm way too young to have experience it, but wasn't the curriculum before "new math" like arithmetic and nothing else? In other words, not math at all?
I didn't read much into it but from what I did it seems like they started teaching children actual math like algebra and logic and parents got frustrated because they were too stupid to help with homework anymore. Brings into my mind the whole "math was cool before they involved letters" thing that makes me want to throw a book at someone.
dan brown’s shitty novels about the dude who deciphers symbols or whatever (it was the one with anti-matter)
Ah yes, litrtuere
Turns out software engineering cannot be easily solved with a ~~small shell script~~ large language model.
The author of the article appears to be a genuine ML engineer, although some of his takes aged like fine milk. He seems to be shilling Google a bit too much for my taste. However, the sneer content is good nonetheless.
First off, the "Devin solves a task on Upwork" demo is 1. cherry picked, 2. not even correctly solved.
Second, and this is the absolutely fantastic golden nugget here, to show off its "bug solving capability" it creates its own nonsensical bugs and then reverses them. It's the ideal corporate worker, able to appear busy by creating useless work for itself out of thin air.
It also takes over 6 hours to perform this task, which would be reasonable for an experienced software engineer, but an experienced software engineer's workflow doesn't include burning a small nuclear explosion worth of energy while coding and then not actually solving the task. We don't drink that much coffee.
The next demo is a bait-and-switch again. In this case I think the author of the article fails to sneer quite as much as it's worthy -- the task the AI solves is writing test cases for finding the Least Common Multiple modulo a number. Come on, that task is fucking trivial, all those tests are oneliners! It's famously much easier to verify modulo arithmetic than it is to actually compute it. And it takes the AI an hour to do it!
It is a bit refreshing though that it didn't turn out DEVIN is just Dinesh, Eesha, Vikram, Ishani, and Niranjan working for $2/h from a slum in India.
Self-reporting studies are, in fact, studies.