this post was submitted on 20 Dec 2024
3 points (100.0% liked)
Artificial Intelligence
1367 readers
2 users here now
Welcome to the AI Community!
Let's explore AI passionately, foster innovation, and learn together. Follow these guidelines for a vibrant and respectful community:
- Be kind and respectful.
- Share high-quality contributions.
- Stay on-topic.
- Enhance accessibility.
- Verify information.
- Encourage meaningful discussions.
You can access the AI Wiki at the following link: AI Wiki
Let's create a thriving AI community together!
founded 1 year ago
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
LLMs are not programmed in a traditional way. The actual code is quite small. It mostly runs backprop, filters the data. It is already easily generated by LLMs.
Okay, fair enough ... but what I tried to say, you know, that point when an AGI will generate the next AGI ... it seems to me that we are getting close.
AGI or human level intelligence has a hardware problem. Fabs are not going to be autonomous within 20 years. Novel lithography and cleaning methods are difficult for large groups of humans. LLMs do not provide much assistance in semiconductor design. We are not even remotely close to manufacturing the infrastructure necessary to run human level intelligence software.
Yes, for the hardware, of course. But, if there is large gains to be made in the software (conception ? design ?) then maybe we will see the type of rapid (self improving) change i am expecting.
(... or maybe not since some of these changes are inspired by mimicking what happens inside the brain)
Large gains were due to scaling the hardware, and data. The training algorithms didn't change much, transformers allowed for higher parallelization. There are no signs of the process becoming self-improving. Agentic performance is horrible as you can see with Claude (15% of tasks successful).
What happens in the brain is a big mystery, and thus it cannot be mimicked. Biological neural networks do not exist, because the synaptic cleft is an artifact. The living neurons are round, and the axons are the result of dehydration with ethanol or xylene.
Most scientists would not believe that. But if you are right in some way, we are very far of what I said here before. Clearly it's not me who will convince you otherwise. I wish you the best, take care 😌