this post was submitted on 17 Feb 2024
267 points (100.0% liked)
Technology
37735 readers
322 users here now
A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.
Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.
Subcommunities on Beehaw:
This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
No, it's really not.
Firstly, while the data may be public, it's not "free". Scraping reddit and using it to train an AI would likely contravene their terms of use, you'd end up facing similar copyright issues that the current generation of bots has.
Secondly, scraped data would be incomplete, you wouldn't get anything edited or "deleted", which would surely be available if you paid them. The edits and deletes would be very valuable for AI training.
Thirdly, you would get the meta that reddit has. Geolocation, user agent, alt accounts, browsing habits, et cetera.
Fourthly, you wouldn't get exclusivity. Locking out a competitor is worth something.
Idk why you are talking about scraping when I said API?
And is all that information in the training contract?
I assumed that when you said "it's just an API" you were saying you're paying $60m for an API as opposed to scraping for free.
Is all what information in the training contract?