Programming

17651 readers

375 users here now

Welcome to the main community in programming.dev! Feel free to post anything relating to programming here!

Cross posting is strongly encouraged in the instance. If you feel your post or another person's post makes sense in another community cross post into it.

Hope you enjoy the instance!

Rules

Follow the programming.dev instance rules
Keep content related to programming in some way
If you're posting long videos try to add in some form of tldr for those who don't want to watch videos

Wormhole

Follow the wormhole through a path of communities [email protected]

founded 2 years ago

MODERATORS

[email protected]

Any data scientists out there? What's your go to programming language and tools for your work? (lm.paradisus.day)

submitted 2 weeks ago by [email protected] to c/[email protected]

30 comments fedilink hide all child comments

No surprise I use python, but I've recently started experimenting with polars instead of pandas. I've enjoyed it so far, but Im not sure if the benefits for my team's work will be enough to outweigh the cost of moving from our existing pandas/numpy code over to polars.

I've also started playing with grafana, as a quick dashboarding utility to make some basic visualizations on some live production databases.

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 3 points 2 weeks ago (1 children)

I like pandas but sometimes figuring out the simplest of shit is so complicated

[–] [email protected] 1 points 2 weeks ago (1 children)

I learned SQL before pandas. It's still tabular data, but the mechanisms to mutate/modify/filter the data are different methodologies. It took a long time to get comfy with pandas. It wasnt until I understood that the way you interact with a database table and a dataframe are very different, that I started to finally get a grasp on pandas.

[–] Xraygoggles 1 points 2 weeks ago (1 children)

Wow, I feel seen. Currently fighting this battle, any tips or resources you found helpful?

I think it's the index(?), aggregation, and order of operations I'm struggling with the most.

[–] [email protected] 1 points 2 weeks ago (1 children)

First off, understanding the different data structure from a high level is mandatory. I would understand the difference between a dataframe, series, and index are. Further, learn how numpy's ndarrays play a role.

From there, unfortunately, I had to learn by doing...or rather struggling. It was one question at a time to stack overflow, like "how to filter on a column in pandas". Maybe in the modern era of LLMs, this part might be easier. And eventually, I learned some patterns and internalized the data structures.

[–] Xraygoggles 1 points 2 weeks ago

Thank you for taking the time, the perspective is helpful. Same answer as everything else then.

Just be more stubborn than the problem. =)