this post was submitted on 29 Jun 2023
163 points (98.8% liked)
Data is Beautiful
5032 readers
38 users here now
A place to share and discuss visual representations of data: Graphs, charts, maps, etc.
DataIsBeautiful is for visualizations that effectively convey information. Aesthetics are an important part of information visualization, but pretty pictures are not the sole aim of this subreddit.
A place to share and discuss visual representations of data: Graphs, charts, maps, etc.
A post must be (or contain) a qualifying data visualization.
Directly link to the original source article of the visualization
Original source article doesn't mean the original source image. Link to the full page of the source article as a link-type submission.
If you made the visualization yourself, tag it as [OC]
[OC] posts must state the data source(s) and tool(s) used in the first top-level comment on their submission.
DO NOT claim "[OC]" for diagrams that are not yours.
All diagrams must have at least one computer generated element.
No reposts of popular posts within 1 month.
Post titles must describe the data plainly without using sensationalized headlines. Clickbait posts will be removed.
Posts involving American Politics, or contentious topics in American media, are permissible only on Thursdays (ET).
Posts involving Personal Data are permissible only on Mondays (ET).
Please read through our FAQ if you are new to posting on DataIsBeautiful.
Commenting Rules
Don't be intentionally rude, ever.
Comments should be constructive and related to the visual presented. Special attention is given to root-level comments.
Short comments and low effort replies are automatically removed.
Hate Speech and dogwhistling are not tolerated and will result in an immediate ban.
Personal attacks and rabble-rousing will be removed.
Moderators reserve discretion when issuing bans for inappropriate comments. Bans are also subject to you forfeiting all of your comments in this community.
Originally r/DataisBeautiful
founded 2 years ago
MODERATORS
Hi, I'm the creator of the blackout tracker. I have a question, which I'm too lazy to verify myself. To get the total number of posts/comments per day, did you sum up all the data points
perMinutevalues over the day or did you take the difference between the first and last ID of the day? If you went for the first option, did you account for the time between each post? Because the time between each data point can vary, since I stopped and restarted the server multiple times, during which no data was collected. Also if you look at the time frame on blackout.photon-reddit.com the peaks and lows over the 2 days visually looks a lot lower than in your graph.Hi, thanks for your work and good point.
It is as you said, I am just summing the data since I don't know the Post and Comment Id format and how to convert it into a number. Is it Base64?
Here an Overview over your coverage though:
I guess this explains the higher number on the 8-9th. There seems to be a timeframe with 30 second pull intervalls on these days
Almost, it's base 36. I'm using these functions for converting them. The ID is incremented for each new post/comment. So the difference between the last and first post ID of a day, is the total number of posts on that day. In that coverage you can see pretty well the 2 days where my internet was struggling and when I switched to cloud hosting.
Thanks, I adjusted the counting using the ID now.
Is it ok if I make another Update using your source data next week? Or are you gonna stop the tracker on the 1st July cause of the API changes? If I am not mistaken it shouldn't get hit by the changes since the API calls are too low right?
Yeah that looks more like it.
You can make however many posts you want :)
I will keep it running for at least a week or two after July 1st, then I'll have to see, because the subreddit related data is growing quite quickly (300MB) and the per minute chart is quite dense now.
Perfect thanks :)