this post was submitted on 29 Jun 2023
163 points (98.8% liked)

Data is Beautiful

5031 readers
1 users here now

A place to share and discuss visual representations of data: Graphs, charts, maps, etc.

DataIsBeautiful is for visualizations that effectively convey information. Aesthetics are an important part of information visualization, but pretty pictures are not the sole aim of this subreddit.

A place to share and discuss visual representations of data: Graphs, charts, maps, etc.

  A post must be (or contain) a qualifying data visualization.

  Directly link to the original source article of the visualization
    Original source article doesn't mean the original source image. Link to the full page of the source article as a link-type submission.
    If you made the visualization yourself, tag it as [OC]

  [OC] posts must state the data source(s) and tool(s) used in the first top-level comment on their submission.

  DO NOT claim "[OC]" for diagrams that are not yours.

  All diagrams must have at least one computer generated element.

  No reposts of popular posts within 1 month.

  Post titles must describe the data plainly without using sensationalized headlines. Clickbait posts will be removed.

  Posts involving American Politics, or contentious topics in American media, are permissible only on Thursdays (ET).

  Posts involving Personal Data are permissible only on Mondays (ET).

Please read through our FAQ if you are new to posting on DataIsBeautiful. Commenting Rules

Don't be intentionally rude, ever.

Comments should be constructive and related to the visual presented. Special attention is given to root-level comments.

Short comments and low effort replies are automatically removed.

Hate Speech and dogwhistling are not tolerated and will result in an immediate ban.

Personal attacks and rabble-rousing will be removed.

Moderators reserve discretion when issuing bans for inappropriate comments. Bans are also subject to you forfeiting all of your comments in this community.

Originally r/DataisBeautiful

founded 2 years ago
MODERATORS
163
submitted 2 years ago* (last edited 2 years ago) by JanoRis to c/dataisbeautiful
 

During the Reddit Blackout i made a graph showing the posts and comments/day (Link).

Some days ago i was asked to make an Update so here it is.

Source Data is from here and contains the same Data as some may know from here. Only difference is that the post and comment count is summed over the day.

EDIT:

The Original Post Data contained inconsistent Data points on each day (see here).

This is the corrected Chart, which uses the difference in Post IDs between the days to calculate the daily number (adjusted to s between the api calls):

I also adjusted the values to 10^6 and adjusted the y-axis ranges, I hope this makes it easier on the eyes.

For people complaining on the mixed chart: Double column looks bad with 2Y-Axis, and double lines looks too empty. 2Y-Axis are necessary cause of the difference in scaling of the posts and comments data, only other option would be an axis break.

you are viewing a single comment's thread
view the rest of the comments
[–] JanoRis 5 points 2 years ago (4 children)

Hi, thanks for your work and good point.

It is as you said, I am just summing the data since I don't know the Post and Comment Id format and how to convert it into a number. Is it Base64?

Here an Overview over your coverage though:

I guess this explains the higher number on the 8-9th. There seems to be a timeframe with 30 second pull intervalls on these days

[–] RaiderBDev 1 points 2 years ago (3 children)

Almost, it's base 36. I'm using these functions for converting them. The ID is incremented for each new post/comment. So the difference between the last and first post ID of a day, is the total number of posts on that day. In that coverage you can see pretty well the 2 days where my internet was struggling and when I switched to cloud hosting.

[–] JanoRis 2 points 2 years ago (2 children)

Thanks, I adjusted the counting using the ID now.

Is it ok if I make another Update using your source data next week? Or are you gonna stop the tracker on the 1st July cause of the API changes? If I am not mistaken it shouldn't get hit by the changes since the API calls are too low right?

[–] RaiderBDev 1 points 2 years ago (1 children)

Yeah that looks more like it.
You can make however many posts you want :)
I will keep it running for at least a week or two after July 1st, then I'll have to see, because the subreddit related data is growing quite quickly (300MB) and the per minute chart is quite dense now.

[–] JanoRis 1 points 2 years ago

Perfect thanks :)