There was an article recently about this (too lazy to search it). It's already starting to happen. If most of the content they train on is the internet and more internet content is created by LLMs without being tagged as AI generated content (can't be guaranteed by all actors), then it's inevitable. High signal training data is out the window.
green_light_stop
joined 1 year ago
There are also techniques where data centers do offline storage by writing out to a high volume storage medium (I heard blueray as an example, especially because it's cheap) and storing it in racks. All automated of course. This let's them store huge quantities of infrequently accessed data (most of it) in a more efficient way. Not everything has to be online and ready to go, as long as it's capable of being made available on demand.
Well now I'm grabbing ramen for dinner.
The pork looks incredible. Is that from a flattop? oven broil?
I agree. I much prefer text stuff. It's hard deny the shift though. Looking at TikTok as an extreme example, a whole generation is getting their news from someone doing a dance while two other videos play of cutting playdough. I'm not saying it's wrong, but I do think it's really hurting our ability as a species to exist without attention hacking.
If you've managed to exist outside of that band of information exchange, I commend you.
Attention spans. News content these days are moving to video other text to better grab your attention. When everything is really engaging, you have to be more engaging than that to get seen.
The number of articles out about the latest and greatest game updates from a few hours ago which are rehashing patches released a week or more ago drive me nuts. How many times do I have to wade through multiple screens of preamble to find out that content is being recycled from week old news.
But yes, the ratio of low signal to high signal content is crazy in general. I get that people have to make a living and want to do it via communicating on YouTube/articles/... but I feel we've really lost access to high quality content. ChatGPT and other LLMs are going to make this wayyyyyyy worse.
Content recommendation algorithms push for length and frequency, which inevitably means meeting the quantity bar is more important than quality. Meanwhile we have really thought out high quality content buried in a mountain of clickbait and those creators both don't get as good monetization or exposure. It's a sad system :(. I want to see more ErrantSignal quality bar and less clickbait please.
Super cool, blew my mind! I would love to see it in operation. The logistics from the machine side + the storage heuristics for when to store to a disc that's write-only sounds like a really cool problem.