this post was submitted on 27 Jun 2023
14 points (100.0% liked)

Comradeship // Freechat

263 readers
1 users here now

Talk about whatever, respecting the rules established by Lemmygrad. Failing to comply with the rules will grant you a few warnings, insisting on breaking them will grant you a beautiful shiny banwall.

A community for comrades to chat and talk about whatever doesn't fit other communities

founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 9 points 2 years ago (2 children)

Are the Democrats/NYT left now? Either way, thanks for that! Are you planning to do more analyses like these in the future? It'd be cool to plot time series of the strings "middle class" , "homeless" and "mentally ill" against each other. Maybe even add in dicier social topics such as "reparations".

Also from a glance at your code, it is not clear to me if the data you collected is for only US news or include worldwide. Did you control for that?

[–] Ragdoll_X 3 points 2 years ago* (last edited 2 years ago) (1 children)

In the eyes of Republicans basically everyone who doesn't want to genocide queer people is a "far left communist" now lol

Are you planning to do more analyses like these in the future?

If you mean with regards to keywords that appear on the NYT and how public opinion is changing then probably no, but later I can make a visualization for the terms that you mentioned. (I've run out of API calls for now.)

I do plan on continuing to write articles and make videos on politics from a leftist perspective though. One thing I'm working on right now is collecting some evidence on how conservatism is harmful to kids. Here's a sneak peek of one of the graphs I made.

Also from a glance at your code, it is not clear to me if the data you collected is for only US news or include worldwide. Did you control for that?

I did not. The API doesn't seem to have an option to filter different languages, but after querying a few words in Spanish to see if any results came up the only matches I got were from articles in English that referenced something in Spanish, like the name of a company or shows and events.

I even tried querying the title and some phrases from this article in Spanish but nothing came up, so it looks like the results only include articles written in English.

[–] [email protected] 2 points 2 years ago (1 children)

I do plan on continuing to write articles and make videos on politics from a leftist perspective though. One thing I’m working on right now is collecting some evidence on how conservatism is harmful to kids. Here’s a sneak peek of one of the graphs I made.

Do keep us posted! Work like that is greatly appreciated. That new one seems rather controversial and complex though, take your time to make sure it comes out good without hurrying too much. I'm rather rusty on the data science stuff, but if you need any help or opinion feel free to contact me.

API

That is a good too, but what I meant there was news about the USA vs, say, news about the UK or Iran. The context of which country is being talked about could also influence the word frequency in ways that might be hard to predict. Since you're debunking that specific claim about article frequency it wasn't necessary though.

Also it seems you accidentally published your NYT API key on the github repo. Not sure if that could be an issue, but I thought I should let you know.

[–] Ragdoll_X 2 points 2 years ago

Oh no that's quite alright, I already disabled that API key after publishing the article ~~though I probably should have just edited it out of the file in the first place~~

[–] Ragdoll_X 0 points 2 years ago

I finished the graph with the terms you requested and a few more: https://ragdollx.substack.com/i/120075647/edit