Technology
This is the official technology community of Lemmy.ml for all news related to creation and use of technology, and to facilitate civil, meaningful discussion around it.
Ask in DM before posting product reviews or ads. All such posts otherwise are subject to removal.
Rules:
1: All Lemmy rules apply
2: Do not post low effort posts
3: NEVER post naziped*gore stuff
4: Always post article URLs or their archived version URLs as sources, NOT screenshots. Help the blind users.
5: personal rants of Big Tech CEOs like Elon Musk are unwelcome (does not include posts about their companies affecting wide range of people)
6: no advertisement posts unless verified as legitimate and non-exploitative/non-consumerist
7: crypto related posts, unless essential, are disallowed
view the rest of the comments
The gall of Cloudflare to think they can be the arbitrator of scraping… this is what happen when all y’all give a singular publicly-traded, US-based major control of the general internet infrastructure by purposefully letting them man-in-the-middle your production sites. Now they get to sell access to what was once an open internet. Instead every time Clouflare or Fastly go down, half of the internet goes down with them.
They don't think they're the arbitrer of scraping dumbass, this is a service they're selling to websites who don't want AI scrapers taking adnatage of them.
They are precisely deciding who can scrape what by sitting in the middle of like 30% of internet traffic & denying access. There is no way to tell if this ‘scraping’ is for research, hobby, commercial, or “AI” purposes; conveniently if it can make Cloudflare money, they’ll let you charge a toll. If Cloudflare cared about AI issues, they wouldn’t be having unpaid users solve/train their hCAPTCHA models just for visiting a site from Tor, a VPN, or even just a non-‘Western’ IP address. The fact that folks/businesses bought into this centralization is frightening—with little open access to information or allowing folks to stay anonymous (whatever their motivation).
Also don’t dare call someone “dumbass” if you can’t be bothered to turn on spell check or understand how commas work.
Them being able to offer this service, and them proxying 30% of the internet are completely unrelated. Any other company could offer this scrape protection if they wanted, with roughly the same cost of entry.
You can hate cloudflare all you like, but only a certified dumbass would try to pretend this feature is somehow enabled by their market dominance...
A US corporation cornering the market then charging their own fees to use the service (surfing & scraping are basically the same action)? Never seen this before. Sounds uber evil—I couldn’t airbnbelieve it.