1110
deepseek (lemmy.ml)
you are viewing a single comment's thread
view the rest of the comments
[-] Tartas1995@discuss.tchncs.de 5 points 2 years ago* (last edited 2 years ago)

I am not necessarily got intellectual property but as long as they want to have IPs on their shit, they should respect everyone else's. That is what is immoral.

How is it made sparsely? The training time for e.g. chatgtp 4 was 4 months. Chatgtp 3.5 was released in November 2023, chatgtp 4 was released in March 2024. How many months are between that? Oh look at that... They train their ai 24/7. For chatgtp 4 training, they consumed 7200MWh. The average American household consumes a little less than 11000kWh per year. They consumed in 1/3 of the time, 654 times the energy of the average American household. So in a year, they consume around 2000 times the electricity of an average American household. That is just training. And that is just electricity. We don't even talk about the water. We are also ignoring that they are scaling up. So if they would which they didn't, use the same resources to train their next models.

Edit: sidenote, in 2024, chatgtp was projected to use 226.8 GWh.

[-] daniskarma@lemmy.dbzer0.com 4 points 2 years ago* (last edited 2 years ago)

2000 times, given your approximations as correct, the usage of a household for something that's used by millions, or potentially billions, of people it's not bad at all.

Probably comparable with 3d movies or many other industrial computer uses, like search indexers.

[-] Tartas1995@discuss.tchncs.de 4 points 2 years ago* (last edited 2 years ago)

Yeah, but then they start "gaming"...

I just edited my comment, just no wonder you missed it.

In 2024, chatgtp was projected to use 226.8 GWh. You see, if people are "gaming" 24/7, it is quite wasteful.

Edit: just in case, it isn't obvious. The hardware needs to be produced. The data collected. And they are scaling up. So my point was that even if you do locally sometimes a little bit of LLM, there is more energy consumed then just the energy used for that 1 prompt.

[-] Zos_Kia@lemmynsfw.com 1 points 2 years ago

Yeah it's ridiculous. GPT-4 serves billions of tokens every day so if you take that into account the cost per token is very very low.

this post was submitted on 28 Jan 2025
1110 points (97.6% liked)

Microblog Memes

12335 readers
3764 users here now

A place to share screenshots of Microblog posts, whether from Mastodon, tumblr, ~~Twitter~~ X, KBin, Threads or elsewhere.

Created as an evolution of White People Twitter and other tweet-capture subreddits.

RULES:

  1. Your post must be a screen capture of a microblog-type post that includes the UI of the site it came from, preferably also including the avatar and username of the original poster. Including relevant comments made to the original post is encouraged.
  2. Your post, included comments, or your title/comment should include some kind of commentary or remark on the subject of the screen capture. Your title must include at least one word relevant to your post.
  3. You are encouraged to provide a link back to the source of your screen capture in the body of your post.
  4. Current politics and news are allowed, but discouraged. There MUST be some kind of human commentary/reaction included (either by the original poster or you). Just news articles or headlines will be deleted.
  5. Doctored posts/images and AI are allowed, but discouraged. You MUST indicate this in your post (even if you didn't originally know). If an image is found to be fabricated or edited in any way and it is not properly labeled, it will be deleted.
  6. Absolutely no NSFL content.
  7. Be nice. Don't take anything personally. Take political debates to the appropriate communities. Take personal disagreements & arguments to private messages.
  8. No advertising, brand promotion, or guerrilla marketing.

RELATED COMMUNITIES:

founded 3 years ago
MODERATORS