this post was submitted on 09 Jul 2023
437 points (98.9% liked)

Programming

17313 readers
251 users here now

Welcome to the main community in programming.dev! Feel free to post anything relating to programming here!

Cross posting is strongly encouraged in the instance. If you feel your post or another person's post makes sense in another community cross post into it.

Hope you enjoy the instance!

Rules

Rules

  • Follow the programming.dev instance rules
  • Keep content related to programming in some way
  • If you're posting long videos try to add in some form of tldr for those who don't want to watch videos

Wormhole

Follow the wormhole through a path of communities [email protected]



founded 2 years ago
MODERATORS
 

https://radar.cloudflare.com/domains

Source of this is from Matthew Prince, Co-founder & CEO of Cloudflare posted at 11:34 Jul 9,2023. It was posted to his twitter (@eastdakota). Not linking to twitter bc don't want a deadlink next time twitter makes API changes. And not to drive traffic to twitter :D

Edit: July 11th update, arstechnica published a detailed explanation

https://arstechnica.com/tech-policy/2023/07/twitter-is-tanking-amid-threads-surging-popularity-analysts-say/

top 34 comments
sorted by: hot top controversial new old
[–] [email protected] 61 points 1 year ago (3 children)

Feels like a “no shit, Sherlock” headline but good to see hard proof. Disappointed in it only being a small amount tho

[–] [email protected] 15 points 1 year ago

I think it's more of a "thank God" moment than anything. The way shits been going these past few years it's completely possible thier traffic could have gone up. Just because.

[–] [email protected] 14 points 1 year ago (1 children)

to be fair, the original poster used the word "tanking" and he knows a thing or two about DNS. I thought "tanking" was too click-baity and toned it down :D

[–] abhibeckert 3 points 1 year ago* (last edited 1 year ago) (1 children)

Tanking is accurate - they were the 32nd highest traffic domain and now they're 42nd (fell even further since that screenshot was taken).

Ten places, when you're that close to the highest traffic domains on the internet, is massive. Twitter has gone from similar traffic to Bing to having less traffic than Spotify.

Worse though - more than half of their losses over six months happened in the last week or two.

[–] [email protected] 1 points 1 year ago

what surprised me here is how much traffic bing gets 😅 integrating with AI was a real pro move, it seems.

Any insight into how much the reduction in traffic is just restricting API usage and actual user interaction? Surely there is a correlation in more API usage (if not just scraping) would drive more engagement?

[–] [email protected] 3 points 1 year ago (1 children)

The dip is small but the enormous debt Elon put on its back will definitely kill it soon enough.

[–] [email protected] 34 points 1 year ago (2 children)

While I would love to see Twitter auguring straight into the ground, Twitter’s API changes would explain some portion of this traffic changes. I wonder if there are any other proxy measures for audience engagement as separate from basic traffic

[–] robolemmy 14 points 1 year ago

Between the egregious API pricing and the recent login requirement, this traffic graph makes perfect sense.

I agree that we need some measure of actual engaged human beings before we start dancing on twitter’s grave.

[–] [email protected] 3 points 1 year ago

very good point

[–] golamas1999 17 points 1 year ago (1 children)

I just deleted my Facebook and Twitter.

[–] [email protected] 1 points 1 year ago

Like just now? Why both?

[–] tallwookie 13 points 1 year ago (1 children)

oh god, hopefully Musk can sue his way into making more people use it!! /s

[–] [email protected] 7 points 1 year ago (5 children)

Does Twitter use Cloudflare? I hate anything Elon and want him to fail, but it would be kinda crazy for the CEO of a company I use services with to broadcast an embarrassing indicator to the world that my business isn’t going well.

[–] [email protected] 16 points 1 year ago* (last edited 1 year ago)

I dont know to what capacity twitter uses cloudflare but cloudflare is rather ubiquitous. Even if twitter didn't have services with cloudflare, when a user's device resolves the domain name "twitter.com" to an IP address, it might go through Cloudflare's DNS servers. And givien the ubiquity of Cloudflare DNS, this is likely frequently. By monitoring the DNS queries for Twitter.com, Cloudflare can estimate the traffic volume by analyzing the number and frequency of requests received.

I don't know why cloudflare's CEO would do that or where he keeps his huge steel balls, but today I learned I can mine Cloudflare's internet usage data. And I might have found a new hobby!

Cloudflare Radar has an API that gives access to Cloudflare’s data on global Internet traffic..

Radar’s API is free, allowing academics, data sleuths and other web enthusiasts to investigate Internet usage across the globe.

[–] KingKRool 5 points 1 year ago

I suspect DNS rankings from Cloudflare DNS lookups (1.1.1.1) makes more sense as the source of the data. However Twitter/Musk are refusing to pay rent and were even refusing to pay vendors like Google Cloud in an attempt to save cash and renegotiate prices. So I wouldn't be that shocked if Cloudflare terminated them for non-payment and publicly shamed them. Even then I think it's unlikely they'd do it like this as Cloudflare probably wouldn't want to concern their other customers.

[–] [email protected] 3 points 1 year ago

They use Atlanta Metro, AWS and GCP as far as I know. I want to say they own the Oregon DC but can't remember.

[–] MostlyBirds 3 points 1 year ago (1 children)

Ok but you'd actually be paying what you owe for the services you receive, presumably.

[–] [email protected] 8 points 1 year ago* (last edited 1 year ago)

see comment above, but in short twitter need not hire cloudflare for services. Cloudflare plays an important role in the backbone of the internet. If twitter is resolved through cloudflare's DNS, cloudflare can estimate the volume of traffic to Twitter.com. This appears what had happened given the published graph is "DNS ranking". FYI, and for mine as well as I just discovered, we can generate that graph by our selves by using cloudflare's Radar API

[–] TheGod 2 points 1 year ago

Internet usage data were never secrets.

[–] [email protected] 7 points 1 year ago (1 children)

What is actually meassured there? "Line goes down" is not necessary a bad thing:-)

[–] [email protected] 16 points 1 year ago (1 children)

It measures the most popular sites by dns lookup. Twitter fell from 32nd to 39th.

[–] [email protected] 4 points 1 year ago (1 children)

This data is ugly. Label your axes. It could be 0.1% or a 25% drop.

[–] [email protected] 13 points 1 year ago

Did you even try to find them? I'm on my phone and I still had no trouble locating them.

[–] [email protected] 2 points 1 year ago (1 children)

Where on the radar dashboard can I see that exact graph?

[–] [email protected] 6 points 1 year ago

You'd have to make some API calls after you apply for a token. I am trying to replicate the graph for myself as we speak. Didn't know Cloudflare had this gold mine:

Cloudflare Radar has an API that gives access to Cloudflare’s data on global Internet traffic..

Radar’s API is free, allowing academics, data sleuths and other web enthusiasts to investigate Internet usage across the globe.

[–] iatenine 1 points 1 year ago

Can this be used to see how Reddit has fared YTD by month?