Singularity

131 readers
1 users here now

Everything pertaining to the technological singularity and related topics, e.g. AI, human enhancement, etc.

founded 1 year ago
MODERATORS
26
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/singularity by /u/Gothsim10 on 2024-10-17 22:02:48+00:00.


Project page: LAPA (latentactionpretraining.github.io)

Abstract

We introduce Latent Action Pretraining for general Action models (LAPA), the first unsupervised method for pretraining Vision-Language-Action (VLA) models without ground-truth robot action labels. Existing Vision-Language-Action models require action labels typically collected by human teleoperators during pretraining, which significantly limits possible data sources and scale. In this work, we propose a method to learn from internet-scale videos that do not have robot action labels. We first train an action quantization model leveraging VQ- VAE-based objective to learn discrete latent actions between image frames, then pretrain a latent VLA model to predict these latent actions from observations and task descriptions, and finally finetune the VLA on small-scale robot manipulation data to map from latent to robot actions. Experimental results demonstrate that our method significantly outperforms existing techniques that train robot manipulation policies from large-scale videos. Furthermore, it outperforms the state-of- the-art VLA model trained with robotic action labels on real-world manipulation tasks that require language conditioning, generalization to unseen objects, and semantic generalization to unseen instructions. Training only on human manipulation videos also shows positive transfer, opening up the potential for leveraging web-scale data for robotics foundation model.

27
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/singularity by /u/SkyGazert on 2024-10-17 22:49:35+00:00.

28
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/singularity by /u/Gothsim10 on 2024-10-17 21:23:29+00:00.

Original Title: Russ Tedrake, VP of Robotics Research at Toyota Research Institute (TRI), talks about Large Behavior Models. Boston Dynamics and TRI announced a research partnership yesterday to leverage TRI's Large Behavior Models for Atlas.

29
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/singularity by /u/alexpeet on 2024-10-17 20:06:15+00:00.

30
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/singularity by /u/Gothsim10 on 2024-10-17 23:47:08+00:00.

31
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/singularity by /u/gbomb13 on 2024-10-17 20:29:50+00:00.

32
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/singularity by /u/Gothsim10 on 2024-10-17 19:56:41+00:00.

33
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/singularity by /u/Gothsim10 on 2024-10-17 19:34:51+00:00.

Original Title: Demis Hassabis says it is wrong to think of AI as being just another technology; he says it will be "epochal defining" and will soon cure all diseases, solve climate and energy problems and enrich our lives

34
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/singularity by /u/GutiV on 2024-10-17 17:11:54+00:00.


I know some people are just super active and good at sharing relevant news or tweets, but... isn't this a little weird? It makes me wonder: Are these accounts genuinely providing content that the community wants, or is it just a case of a couple of users (even, possibly, bots) dominating the conversation?

In a sub that's all about actively thinking and discussing the future, this comes across as pure propaganda to me.

Not trying witch hunt, nor am I going to call out the accounts (you do that yourself if you want to verify, and it also helps to tag their names if you have RES).

Just curious about what everyone thinks.

35
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/singularity by /u/Gothsim10 on 2024-10-17 18:12:07+00:00.

36
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/singularity by /u/Gothsim10 on 2024-10-17 17:31:57+00:00.

37
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/singularity by /u/After_Self5383 on 2024-10-17 17:04:31+00:00.

Original Title: Yann LeCun: "I said that reaching Human-Level AI "will take several years if not a decade." Sam Altman says "several thousand days" which is at least 2000 days (6 years) or perhaps 3000 days (9 years). So we're not in disagreement. [...] In any case, it's not going to be in the next year or two."


I said that reaching Human-Level AI "will take several years if not a decade."

Sam Altman says "several thousand days" which is at least 2000 days (6 years) or perhaps 3000 days (9 years). So we're not in disagreement.

But I think the distribution has a long tail: it could take much longer than that. In AI, it almost always takes longer.

In any case, it's not going to be in the next year or two.

38
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/singularity by /u/spinozasrobot on 2024-10-17 17:00:20+00:00.

39
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/singularity by /u/Gothsim10 on 2024-10-17 16:20:25+00:00.

40
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/singularity by /u/Kanute3333 on 2024-10-17 13:53:35+00:00.

41
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/singularity by /u/Kitchen_Task3475 on 2024-10-17 13:27:47+00:00.


We have now alphafold-3 that can predict protein structure, we were told that's a big deal. Crisper should be a mature technology by now, everyone now has a P.hd student in their pocket which should accelerate technology progress, next generation is gonna be much smarter now that every student has their own Aristotle.

Supposedly people don't even have to learn to code now. Midjourney generates concept art, other software generate 3D meshes from images. Audio labs generate sounds, voice, effects. We have software that generate animations. When do we see indie boom 2.0 in the video games space? When one man can create a triple AAA game?

The first indie boom in the 2010s was amaaizing. Hades, Celeste, Minecraft, Stardew Valley, Undertale...etc

42
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/singularity by /u/Gothsim10 on 2024-10-17 13:08:47+00:00.

Original Title: "Can robots learn skills from YouTube without complex video processing? Our LLM-driven bi-level programming shows it’s possible! By chaining a VLM and LLM in a bi-level framework, we use the “chain rule” to guide reward search directly from video demos"

43
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/singularity by /u/Gothsim10 on 2024-10-17 11:42:43+00:00.

44
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/singularity by /u/Gothsim10 on 2024-10-17 11:33:57+00:00.

Original Title: According to Similarweb, ChatGPT reportedly reached 3.1 billion visits in September 2024, a 112% year-over-year increase, surpassing Bing in US traffic with 442.9 million visits compared to Bing's 404.3 million

45
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/singularity by /u/Gothsim10 on 2024-10-17 10:57:10+00:00.

Original Title: Sam Altman says the most important piece of knowledge discovered in his lifetime was that scaling AI models leads to unbelievable, predictable improvements in intelligence and he wondered if he was crazy or in a cult when he tried to explain it to others and they didn't understand

46
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/singularity by /u/Gothsim10 on 2024-10-17 10:12:00+00:00.

47
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/singularity by /u/Gothsim10 on 2024-10-17 10:09:26+00:00.

Original Title: The G1 robot made by Unitree can perform a standing long jump of up to 1.4 meters, possibly the longest jump ever achieved by a humanoid robot of its size in the world, standing only 1.32 meters tall.

48
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/singularity by /u/NoCapNova99 on 2024-10-17 06:23:17+00:00.

49
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/singularity by /u/Anen-o-me on 2024-10-17 00:17:48+00:00.

50
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/singularity by /u/MetaKnowing on 2024-10-17 02:44:40+00:00.

view more: ‹ prev next ›